00000001:02000400:2.0F:1787384203.822381:0:3305:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg345-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1787384224.037717:0:3527:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg345-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1787384225.563337:0:3590:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1043 MB/s 00000001:01000000:3.0:1787384225.814419:0:3590:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 772 MB/s 00000001:01000000:1.0F:1787384226.066882:0:3590:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3403 MB/s 00000020:02000000:0.0:1787384226.739198:0:3620:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_113_ga48d3e3 00000400:02000000:2.0:1787384227.510723:0:3635:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.203.145@tcp [8/256/0/180] 00008000:02000000:2.0:1787384230.716775:0:3784:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1787384289.733047:0:5749:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg345-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787384302.365342:0:6499:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787384302.365350:0:6499:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1787384302.365351:0:6499:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787384302.365480:0:6499:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000005fe6a6fa 00000080:02000400:3.0:1787384302.365490:0:6499:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1787384302.373762:0:6499:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1787384302.373774:0:6499:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787384302.373826:0:6499:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000796b800c) 00000020:00000080:3.0:1787384302.373843:0:6499:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787384302.436269:0:6499:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787384302.436338:0:6499:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:3.0:1787384302.473162:0:6499:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787384302.473367:0:6499:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787384302.473375:0:6499:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787384302.473385:0:6499:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7ef423838fba22ba 00000020:01000004:3.0:1787384302.473391:0:6499:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1787384302.473395:0:6499:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787384302.473400:0:6499:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005fe6a6fa from MGS 00000020:01000004:3.0:1787384302.473404:0:6499:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787384302.473412:0:6499:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000da25c175) 00000020:00000080:3.0:1787384302.473422:0:6499:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787384302.473552:0:6499:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005fe6a6fa from MGS, refs=2 00080000:01000000:3.0:1787384302.473558:0:6499:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787384302.473563:0:6499:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7ef423838fba22c8 00000100:00100000:3.0:1787384302.473670:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787384302.473940:0:6499:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787384302.473946:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1787384302.474436:0:6499:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787384302.474444:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787384302.475456:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787384302.475678:0:6499:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787384302.475683:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787384302.477467:0:6499:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787384302.477543:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787384302.478208:0:6499:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787384302.478215:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787384302.479149:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384302.479153:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384302.479155:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384302.479398:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384302.479400:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384302.479402:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384302.480137:0:6499:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787384302.483686:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1787384302.730123:0:6499:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2759 MB/s 00000001:01000000:2.0:1787384302.980115:0:6499:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2811 MB/s 00000001:01000000:2.0:1787384303.230818:0:6499:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 494 MB/s 00000001:01000000:3.0:1787384303.481352:0:6499:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 763 MB/s 00080000:10000000:3.0:1787384303.487118:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:3.0:1787384303.495296:0:6499:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1787384303.495886:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787384303.495987:0:6499:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787384303.496029:0:6499:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1787384303.496159:0:6499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787384303.496181:0:6499:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787384303.496481:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787384303.496620:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787384303.496626:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787384303.497198:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787384303.497205:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787384303.497490:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787384303.497496:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787384303.500068:0:6499:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787384303.500089:0:6499:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.145@tcp' 00000020:01000004:2.0:1787384303.500090:0:6499:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787384303.500236:0:6499:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.145@tcp (typ=mgc) 00000100:00080000:0.0:1787384303.500491:0:6518:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1787384303.500580:0:6499:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.145@tcp (0000000060f6d815) 00000020:00000080:2.0:1787384303.500598:0:6499:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787384303.500717:0:6499:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000077207be1@MGC192.168.203.145@tcp: add connection 192.168.203.145@tcp at head 00010000:00010000:2.0:1787384303.501145:0:6499:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.145@tcp-0 is initialized 00000040:01000000:2.0:1787384303.501214:0:6499:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.145@tcp ctxt 1 is initialized 10000000:01000000:1.0:1787384303.502146:0:6519:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787384303.502188:0:6499:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.145@tcp (uuid ca80b7f5-0e34-441a-981f-ebff717028c4) 00000020:00000080:1.0:1787384303.502206:0:6499:0:(genops.c:1406:class_connect()) connect: client ca80b7f5-0e34-441a-981f-ebff717028c4, cookie 0x7ef423838fba22d6 00000100:00080000:1.0:1787384303.502215:0:6499:0:(import.c:510:import_select_connection()) MGC192.168.203.145@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787384303.502220:0:6499:0:(import.c:624:import_select_connection()) MGC192.168.203.145@tcp: import 0000000077207be1 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:1.0:1787384303.502258:0:6499:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000cbdb5451 x1874208203210880/t0(0) o250->MGC192.168.203.145@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787384303.502277:0:6499:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import ca80b7f5-0e34-441a-981f-ebff717028c4->MGS 00000020:01000004:1.0:1787384303.502292:0:6499:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787384303.502310:0:6499:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787384303.502327:0:6499:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000f59e1c35) 00000020:00000080:1.0:1787384303.502338:0:6499:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787384303.507487:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cbdb5451 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ca80b7f5-0e34-441a-981f-ebff717028c4:3650:1874208203210880:0@lo:250: 00000100:00100000:3.0:1787384303.507583:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384303.507659:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203210880 00000100:00100000:3.0:1787384303.507666:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203210880 00000100:00100000:3.0:1787384303.507698:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787384303.507704:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096867fbc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3650:x1874208203210880:12345-0@lo:250: 00010000:00080000:3.0:1787384303.507729:0:6515:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from ca80b7f5-0e34-441a-981f-ebff717028c4@0@lo t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:3.0:1787384303.507763:0:6515:0:(genops.c:1406:class_connect()) connect: client ca80b7f5-0e34-441a-981f-ebff717028c4, cookie 0x7ef423838fba22e4 00000100:00080000:3.0:1787384303.507919:0:6515:0:(import.c:65:import_set_state_nolock()) 0000000082a15d81 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787384303.507965:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096867fbc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+5:3650:x1874208203210880:12345-0@lo:250: Request processed in 260us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384303.507973:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787384303.508012:0:3650:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.145@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787384303.508020:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.145@tcp: connect to target with instance 0 00000100:00080000:3.0:1787384303.508026:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.145@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787384303.508030:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787384303.508033:0:3650:0:(import.c:65:import_set_state_nolock()) 0000000077207be1 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787384303.508036:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787384303.508051:0:3650:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787384303.508056:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cbdb5451 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ca80b7f5-0e34-441a-981f-ebff717028c4:3650:1874208203210880:0@lo:250: 00000100:00100000:1.0:1787384303.511963:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787384303.512113:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787384303.512118:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787384303.517960:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787384303.517972:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787384303.525090:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787384303.525129:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787384303.526943:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787384303.527098:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787384303.527104:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787384303.528356:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787384303.528365:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00010000:00010000:3.0:1787384303.544116:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384303.600030:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787384303.600221:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787384303.600227:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787384303.602497:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787384303.602513:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787384303.605207:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787384303.605408:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787384303.605414:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787384303.606496:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787384303.606506:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787384303.608028:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787384303.608199:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787384303.608213:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787384303.609221:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787384303.609230:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787384303.610471:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787384303.610642:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787384303.610647:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787384303.611506:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787384303.611514:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787384303.632232:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787384303.632541:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787384303.632556:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787384303.643472:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787384303.643489:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787384303.645311:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787384303.645325:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787384303.646320:0:6499:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787384303.646348:0:6499:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1787384303.646353:0:6499:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.145@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787384303.646454:0:6499:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.145@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787384303.646486:0:6499:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.145@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1787384303.646491:0:6499:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787384303.646492:0:6499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787384303.646494:0:6499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787384303.646495:0:6499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787384303.646496:0:6499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787384303.646498:0:6499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787384303.646499:0:6499:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787384303.646500:0:6499:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787384303.646502:0:6499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787384303.646503:0:6499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787384303.646504:0:6499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787384303.646505:0:6499:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787384303.646507:0:6499:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1787384303.646509:0:6499:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787384303.646510:0:6499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787384303.646511:0:6499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787384303.646512:0:6499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787384303.646513:0:6499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787384303.646514:0:6499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787384303.646515:0:6499:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787384303.646516:0:6499:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787384303.646517:0:6499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787384303.646518:0:6499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787384303.646518:0:6499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787384303.646519:0:6499:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787384303.646557:0:6499:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787384303.646584:0:6499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bd37194d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:6499:1874208203211008:0@lo:253: 00000100:00100000:0.0:1787384303.646661:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384303.646758:0:6499:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c972a8ef going to sleep for 11 seconds 00000100:00100000:2.0:1787384303.646883:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203211008 00000100:00100000:2.0:1787384303.646890:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203211008 00000100:00100000:2.0:1787384303.646928:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787384303.646941:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e1608f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+5:6499:x1874208203211008:12345-0@lo:253: 20000000:01000000:2.0:1787384303.646983:0:6516:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787384303.646985:0:6516:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1787384303.647884:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787384303.647949:0:6516:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1787384303.648204:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787384303.649064:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1787384303.649300:0:6516:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787384303.649304:0:6516:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1787384303.649309:0:6516:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1787384303.649313:0:6516:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1787384303.649336:0:6516:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1787384303.649481:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787384303.649676:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1787384303.649691:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787384303.649710:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1787384303.649728:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1787384303.649743:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1787384303.650032:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1787384303.650042:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1787384303.650057:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1787384303.650063:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1787384303.650076:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1787384303.650082:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1787384303.650096:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1787384303.650130:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1787384303.650163:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787384303.650169:0:6516:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1787384303.650178:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787384303.650431:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1787384303.650442:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787384303.650459:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1787384303.650474:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1787384303.650490:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1787384303.650499:0:6516:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1787384303.650524:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1787384303.650533:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787384303.650546:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1787384303.650561:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1787384303.650587:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1787384303.650595:0:6516:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1787384303.650616:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1787384303.650623:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1787384303.650644:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1787384303.650659:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1787384303.650718:0:6516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1787384303.650742:0:6516:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1787384303.650748:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1787384303.652349:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1787384303.652604:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1787384303.652628:0:6516:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.145@tcp for mdt 20000000:01000000:3.0:1787384303.652630:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.145@tcp (null) (null) (null) 00000040:00080000:3.0:1787384303.652647:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1787384303.652652:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787384303.652664:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1787384303.652669:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.145@tcp (null) (null) 00000040:00080000:3.0:1787384303.652682:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1787384303.652689:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1787384303.652716:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1787384303.652734:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1787384303.652906:0:6516:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787384303.652910:0:6516:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787384303.652914:0:6516:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787384303.652956:0:6516:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787384303.652959:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787384303.653343:0:6540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1787384303.653506:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1787384303.653528:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1787384303.653544:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:3.0:1787384303.653553:0:6516:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787384303.653555:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787384303.654004:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1787384303.654152:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1787384303.654171:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1787384303.654184:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1787384303.654195:0:6516:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787384303.654197:0:6516:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1787384303.654207:0:6516:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787384303.654209:0:6516:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787384303.654213:0:6516:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1787384303.654219:0:6516:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1787384303.654528:0:6542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1787384303.654732:0:6516:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1787384303.666450:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1787384303.666493:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1787384303.666519:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1787384303.666541:0:6516:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787384303.666561:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000053e28eab/0x7ef423838fba22eb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.666588:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000053e28eab/0x7ef423838fba22eb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.666597:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000053e28eab/0x7ef423838fba22eb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.666603:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000053e28eab/0x7ef423838fba22eb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.666608:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000053e28eab/0x7ef423838fba22eb lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.666614:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000053e28eab/0x7ef423838fba22eb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.666621:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000053e28eab already unused, calling callback (00000000cf2a782c) 00010000:00010000:3.0:1787384303.666625:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000053e28eab/0x7ef423838fba22eb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.666650:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000053e28eab/0x7ef423838fba22eb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.666662:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000053e28eab/0x7ef423838fba22eb lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.666669:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000053e28eab/0x7ef423838fba22eb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.666674:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000053e28eab/0x7ef423838fba22eb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787384303.666691:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787384303.680685:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e1608f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+5:6499:x1874208203211008:12345-0@lo:253: Request processed in 33736us (34017us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384303.680706:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787384303.681075:0:6499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bd37194d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:6499:1874208203211008:0@lo:253: 10000000:01000000:0.0:1787384303.681091:0:6499:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787384303.681094:0:6499:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787384303.681096:0:6499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787384303.681097:0:6499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787384303.681098:0:6499:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1787384303.681099:0:6499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787384303.681101:0:6499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787384303.681102:0:6499:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787384303.681103:0:6499:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787384303.681105:0:6499:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787384303.681107:0:6499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787384303.681108:0:6499:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787384303.681125:0:6499:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005fe6a6fa from lustre-MDT0000 10000000:01000000:0.0:1787384303.681154:0:6499:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787384303.681157:0:6499:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787384303.681160:0:6499:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff98f8f96899c0 10000000:01000000:0.0:1787384303.681166:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787384303.681173:0:6499:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff98f8f96899c0 from 1 10000000:01000000:0.0:1787384303.681175:0:6499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787384303.681207:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: 00000000d40a99bf/0x7ef423838fba22f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384303.681220:0:6499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: 00000000d40a99bf/0x7ef423838fba22f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384303.681227:0:6499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: 00000000d40a99bf/0x7ef423838fba22f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384303.681242:0:6499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bd37194d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:6499:1874208203211136:0@lo:101: 00000100:00100000:0.0:1787384303.681375:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384303.681494:0:6499:0:(client.c:2702:ptlrpc_set_wait()) set 0000000034324ae6 going to sleep for 11 seconds 00000100:00100000:3.0:1787384303.681542:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203211136 00000100:00100000:3.0:1787384303.681547:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203211136 00000100:00100000:3.0:1787384303.681601:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787384303.681608:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005957dfea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+5:6499:x1874208203211136:12345-0@lo:101: 00010000:00010000:3.0:1787384303.681620:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384303.681632:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000053e28eab/0x7ef423838fba22f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba22f2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.681652:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000053e28eab/0x7ef423838fba22f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba22f2 expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.681660:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000053e28eab/0x7ef423838fba22f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba22f2 expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.681679:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000053e28eab, rc 0) 00000100:00100000:3.0:1787384303.681904:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005957dfea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+6:6499:x1874208203211136:12345-0@lo:101: Request processed in 295us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384303.681911:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787384303.681998:0:6499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bd37194d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:6499:1874208203211136:0@lo:101: 00010000:00010000:0.0:1787384303.682011:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: 00000000d40a99bf/0x7ef423838fba22f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba22f9 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384303.682019:0:6499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: 00000000d40a99bf/0x7ef423838fba22f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba22f9 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384303.682069:0:6499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bd37194d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:6499:1874208203211264:0@lo:501: 00000100:00100000:0.0:1787384303.682095:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384303.682150:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203211264 00000100:00100000:3.0:1787384303.682154:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203211264 00000100:00100000:3.0:1787384303.682176:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787384303.682181:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b9a09b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+6:6499:x1874208203211264:12345-0@lo:501: 00000100:00100000:3.0:1787384303.682255:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b9a09b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+6:6499:x1874208203211264:12345-0@lo:501: Request processed in 73us (160us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787384303.682269:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787384303.682512:0:6499:0:(client.c:2702:ptlrpc_set_wait()) set 0000000034324ae6 going to sleep for 11 seconds 00000100:00100000:0.0:1787384303.682527:0:6499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bd37194d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:6499:1874208203211264:0@lo:501: 10000000:01000000:0.0:1787384303.682554:0:6499:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787384303.682610:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: 00000000d40a99bf/0x7ef423838fba22f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba22f9 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384303.682619:0:6499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: 00000000d40a99bf/0x7ef423838fba22f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba22f9 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384303.682627:0:6499:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98f8c896e000 10000000:01000000:0.0:1787384303.682631:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787384303.682635:0:6499:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98f8c896e000 10000000:01000000:0.0:1787384303.682638:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787384303.682640:0:6499:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff98f8c896e000 from 1 10000000:01000000:0.0:1787384303.682642:0:6499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787384303.682657:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: 0000000002d5df61/0x7ef423838fba2300 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384303.682675:0:6499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: 0000000002d5df61/0x7ef423838fba2300 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384303.682682:0:6499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: 0000000002d5df61/0x7ef423838fba2300 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384303.682703:0:6499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bd37194d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:6499:1874208203211392:0@lo:101: 00000100:00100000:0.0:1787384303.682728:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384303.682793:0:6499:0:(client.c:2702:ptlrpc_set_wait()) set 0000000034324ae6 going to sleep for 11 seconds 00000100:00100000:2.0:1787384303.682961:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203211392 00000100:00100000:2.0:1787384303.682966:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203211392 00000100:00100000:2.0:1787384303.683034:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787384303.683040:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f72520e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+6:6499:x1874208203211392:12345-0@lo:101: 00010000:00010000:2.0:1787384303.683048:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384303.683059:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d9095b65/0x7ef423838fba2307 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba2300 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384303.683075:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d9095b65/0x7ef423838fba2307 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba2300 expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384303.683083:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d9095b65/0x7ef423838fba2307 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2300 expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384303.683091:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d9095b65, rc 0) 00000100:00100000:2.0:1787384303.683127:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f72520e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+7:6499:x1874208203211392:12345-0@lo:101: Request processed in 88us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384303.683133:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787384303.683183:0:6499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bd37194d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:6499:1874208203211392:0@lo:101: 00010000:00010000:0.0:1787384303.683194:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: 0000000002d5df61/0x7ef423838fba2300 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2307 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384303.683201:0:6499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: 0000000002d5df61/0x7ef423838fba2300 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2307 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384303.683211:0:6499:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787384303.683224:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: 0000000002d5df61/0x7ef423838fba2300 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2307 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384303.683230:0:6499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: 0000000002d5df61/0x7ef423838fba2300 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2307 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384303.683235:0:6499:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787384303.683238:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787384303.683242:0:6499:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98f8c896e000 10000000:01000000:0.0:1787384303.683245:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787384303.683247:0:6499:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787384303.683255:0:6499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787384303.683277:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: 00000000631d474f/0x7ef423838fba230e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384303.683284:0:6499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: 00000000631d474f/0x7ef423838fba230e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384303.683290:0:6499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: 00000000631d474f/0x7ef423838fba230e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384303.683301:0:6499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bd37194d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:6499:1874208203211520:0@lo:101: 00000100:00100000:0.0:1787384303.683324:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384303.683507:0:6499:0:(client.c:2702:ptlrpc_set_wait()) set 0000000034324ae6 going to sleep for 11 seconds 00000100:00100000:3.0:1787384303.683596:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203211520 00000100:00100000:3.0:1787384303.683601:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203211520 00000100:00100000:3.0:1787384303.683621:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787384303.683626:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000069b0ac6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+7:6499:x1874208203211520:12345-0@lo:101: 00010000:00010000:3.0:1787384303.683633:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384303.683641:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f0e8aff2/0x7ef423838fba2315 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba230e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.683656:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f0e8aff2/0x7ef423838fba2315 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba230e expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.683662:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f0e8aff2/0x7ef423838fba2315 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba230e expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.683668:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f0e8aff2, rc 0) 00000100:00100000:3.0:1787384303.683708:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000069b0ac6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+8:6499:x1874208203211520:12345-0@lo:101: Request processed in 82us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384303.683720:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787384303.683954:0:6499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bd37194d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:6499:1874208203211520:0@lo:101: 00010000:00010000:0.0:1787384303.683963:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: 00000000631d474f/0x7ef423838fba230e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2315 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384303.683970:0:6499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: 00000000631d474f/0x7ef423838fba230e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2315 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384303.684033:0:6499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bd37194d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:6499:1874208203211648:0@lo:501: 00000100:00100000:0.0:1787384303.684059:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384303.684080:0:6499:0:(client.c:2702:ptlrpc_set_wait()) set 0000000034324ae6 going to sleep for 11 seconds 00000100:00100000:3.0:1787384303.684169:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203211648 00000100:00100000:3.0:1787384303.684173:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203211648 00000100:00100000:3.0:1787384303.684191:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787384303.684196:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024dd7656 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+8:6499:x1874208203211648:12345-0@lo:501: 00000100:00100000:3.0:1787384303.684296:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024dd7656 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+9:6499:x1874208203211648:12345-0@lo:501: Request processed in 100us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384303.684303:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787384303.684417:0:6499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bd37194d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:6499:1874208203211648:0@lo:501: 00000100:00100000:0.0:1787384303.684443:0:6499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bd37194d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:6499:1874208203211776:0@lo:503: 00000100:00100000:0.0:1787384303.684478:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384303.684504:0:6499:0:(client.c:2702:ptlrpc_set_wait()) set 0000000034324ae6 going to sleep for 11 seconds 00000100:00100000:3.0:1787384303.684559:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203211776 00000100:00100000:3.0:1787384303.684564:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203211776 00000100:00100000:3.0:1787384303.684590:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787384303.684595:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce880ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+9:6499:x1874208203211776:12345-0@lo:503: 00000100:00100000:3.0:1787384303.684670:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce880ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+9:6499:x1874208203211776:12345-0@lo:503: Request processed in 74us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384303.684676:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787384303.684827:0:6499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bd37194d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:6499:1874208203211776:0@lo:503: 00000100:00100000:3.0:1787384303.685130:0:6543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cbdd97bd pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:6543:1874208203211904:0@lo:502: 00000100:00100000:3.0:1787384303.685172:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384303.685237:0:6543:0:(client.c:2702:ptlrpc_set_wait()) set 000000000b63c7c5 going to sleep for 11 seconds 00000100:00100000:2.0:1787384303.685397:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203211904 00000100:00100000:2.0:1787384303.685402:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203211904 00000100:00100000:1.0:1787384303.685490:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787384303.685499:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c6c3983 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+9:6543:x1874208203211904:12345-0@lo:502: 00000100:00100000:1.0:1787384303.685623:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c6c3983 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+9:6543:x1874208203211904:12345-0@lo:502: Request processed in 126us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384303.685630:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787384303.685724:0:6543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cbdd97bd pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:6543:1874208203211904:0@lo:502: 00000020:01000000:3.0:1787384303.685744:0:6543:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787384303.685754:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384303.685757:0:6543:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787384303.685762:0:6543:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787384303.685765:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787384303.685791:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000038edef90) 00000020:00000080:3.0:1787384303.685809:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787384303.685815:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787384303.685893:0:6543:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787384303.685900:0:6543:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7ef423838fba2323 00000020:00000080:3.0:1787384303.686117:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787384303.686121:0:6543:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787384303.686125:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384303.686126:0:6543:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787384303.686128:0:6543:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787384303.686132:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384303.686133:0:6543:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787384303.686136:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787384303.686142:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000046412860) 00000020:00000080:3.0:1787384303.686151:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787384303.686155:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787384303.686157:0:6543:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787384303.686159:0:6543:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787384303.686165:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787384303.686201:0:6543:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005fe6a6fa from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787384303.686218:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000047528939) 00000020:00000080:3.0:1787384303.686227:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787384303.686306:0:6543:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787384303.686312:0:6543:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7ef423838fba2338 00000020:00000080:3.0:1787384303.686412:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787384303.686418:0:6543:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787384303.686422:0:6543:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x7ef423838fba233f 00080000:01000000:3.0:1787384303.686427:0:6543:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787384303.686430:0:6543:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7ef423838fba2346 00080000:10000000:3.0:1787384303.686936:0:6543:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1787384303.687070:0:6543:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1787384303.695047:0:6543:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1787384303.763175:0:6543:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1787384303.763504:0:6543:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1787384303.766672:0:6543:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1787384303.767076:0:6543:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787384303.770549:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000004a672a1e) 00000020:00000080:0.0:1787384303.770580:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1787384303.770911:0:6543:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787384303.770920:0:6543:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7ef423838fba2354 00000020:00000080:1.0:1787384303.772634:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1787384303.773622:0:6543:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:0.0:1787384303.776486:0:6543:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:0.0:1787384303.779534:0:6543:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:0.0:1787384303.782134:0:6543:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:0.0:1787384303.784111:0:6543:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:1.0:1787384303.786381:0:6543:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:1.0:1787384303.788021:0:6543:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x7ef423838fba235b 00000020:00000080:2.0:1787384303.788349:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787384303.788361:0:6543:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384303.788366:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384303.788368:0:6543:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787384303.788378:0:6543:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787384303.788382:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384303.788383:0:6543:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787384303.788386:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787384303.788387:0:6543:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787384303.788390:0:6543:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384303.788392:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384303.788393:0:6543:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787384303.788395:0:6543:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787384303.788398:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384303.788399:0:6543:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787384303.788403:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787384303.788442:0:6543:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1787384303.789114:0:6543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d5419b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:6543:1874208203212032:0@lo:502: 00000100:00100000:2.0:1787384303.789193:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384303.789282:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203212032 00000100:00100000:0.0:1787384303.789290:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203212032 00000100:00100000:0.0:1787384303.789339:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787384303.789341:0:6543:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a562f8fd going to sleep for 11 seconds 00000100:00100000:0.0:1787384303.789346:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aacd1078 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+9:6543:x1874208203212032:12345-0@lo:502: 00000100:00100000:0.0:1787384303.789464:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aacd1078 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+9:6543:x1874208203212032:12345-0@lo:502: Request processed in 118us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384303.789472:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787384303.789637:0:6543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d5419b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:6543:1874208203212032:0@lo:502: 00000020:01000000:2.0:1787384303.789664:0:6543:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384303.789669:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384303.789671:0:6543:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1787384303.789675:0:6543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1787384303.789800:0:6499:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1787384303.789894:0:6499:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787384303.789914:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: 00000000631d474f/0x7ef423838fba230e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2315 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384303.789925:0:6499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: 00000000631d474f/0x7ef423838fba230e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2315 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384303.789944:0:6499:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98f8c896e000 from 1 10000000:01000000:0.0:1787384303.789947:0:6499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787384303.790091:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: 00000000c2acb1f3/0x7ef423838fba2362 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.790097:0:6499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: 00000000c2acb1f3/0x7ef423838fba2362 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.790110:0:6499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: 00000000c2acb1f3/0x7ef423838fba2362 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384303.790122:0:6499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bd37194d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:6499:1874208203212160:0@lo:101: 00000100:00100000:3.0:1787384303.790145:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384303.790166:0:6499:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e8b4598f going to sleep for 11 seconds 00000100:00100000:1.0:1787384303.790183:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203212160 00000100:00100000:1.0:1787384303.790188:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203212160 00000100:00100000:1.0:1787384303.790218:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787384303.790225:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069059c9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+9:6499:x1874208203212160:12345-0@lo:101: 00010000:00010000:1.0:1787384303.790238:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384303.790250:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003e1348bc/0x7ef423838fba2369 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba2362 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384303.790324:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003e1348bc/0x7ef423838fba2369 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba2362 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384303.790335:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003e1348bc/0x7ef423838fba2369 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2362 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384303.790343:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003e1348bc, rc 0) 00000100:00100000:1.0:1787384303.790396:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069059c9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+10:6499:x1874208203212160:12345-0@lo:101: Request processed in 171us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384303.790402:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787384303.790470:0:6499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bd37194d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:6499:1874208203212160:0@lo:101: 00010000:00010000:3.0:1787384303.790481:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: 00000000c2acb1f3/0x7ef423838fba2362 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2369 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.790488:0:6499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: 00000000c2acb1f3/0x7ef423838fba2362 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2369 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384303.791164:0:6499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cbdd97bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:6499:1874208203212288:0@lo:256: 00000100:00100000:3.0:1787384303.791206:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384303.791242:0:6499:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e8b4598f going to sleep for 11 seconds 00000100:00100000:0.0:1787384303.791347:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203212288 00000100:00100000:0.0:1787384303.791353:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203212288 00000100:00100000:0.0:1787384303.791439:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787384303.791447:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef3aad61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+10:6499:x1874208203212288:12345-0@lo:256: 20000000:01000000:0.0:1787384303.791461:0:6516:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787384303.791466:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787384303.791535:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef3aad61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+10:6499:x1874208203212288:12345-0@lo:256: Request processed in 90us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384303.791542:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787384303.791602:0:6499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cbdd97bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:6499:1874208203212288:0@lo:256: 10000000:01000000:3.0:1787384303.792234:0:6499:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787384303.792244:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: 00000000c2acb1f3/0x7ef423838fba2362 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2369 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.792253:0:6499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: 00000000c2acb1f3/0x7ef423838fba2362 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2369 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384303.792270:0:6499:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98f8c896e000 from 1 10000000:01000000:3.0:1787384303.792273:0:6499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787384303.792305:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: 00000000545d62be/0x7ef423838fba2370 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.792311:0:6499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: 00000000545d62be/0x7ef423838fba2370 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.792318:0:6499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: 00000000545d62be/0x7ef423838fba2370 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384303.792331:0:6499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cbdd97bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:6499:1874208203212416:0@lo:101: 00000100:00100000:3.0:1787384303.792366:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384303.792402:0:6499:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e8b4598f going to sleep for 11 seconds 00000100:00100000:2.0:1787384303.792962:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203212416 00000100:00100000:2.0:1787384303.792970:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203212416 00000100:00100000:2.0:1787384303.793027:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787384303.793036:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000acf99875 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+10:6499:x1874208203212416:12345-0@lo:101: 00010000:00010000:2.0:1787384303.793047:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384303.793062:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b655cb76/0x7ef423838fba2377 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba2370 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384303.793083:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b655cb76/0x7ef423838fba2377 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba2370 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384303.793103:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b655cb76/0x7ef423838fba2377 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2370 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384303.793111:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b655cb76, rc 0) 00000100:00100000:2.0:1787384303.793161:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000acf99875 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+11:6499:x1874208203212416:12345-0@lo:101: Request processed in 127us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384303.793179:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787384303.793347:0:6499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cbdd97bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:6499:1874208203212416:0@lo:101: 00010000:00010000:3.0:1787384303.793362:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: 00000000545d62be/0x7ef423838fba2370 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2377 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.793369:0:6499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: 00000000545d62be/0x7ef423838fba2370 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2377 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384303.793427:0:6499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cbdd97bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:6499:1874208203212544:0@lo:501: 00000100:00100000:3.0:1787384303.793459:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384303.793467:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203212544 00000100:00100000:0.0:1787384303.793471:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203212544 00000100:00100000:3.0:1787384303.793476:0:6499:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e8b4598f going to sleep for 11 seconds 00000100:00100000:0.0:1787384303.793503:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787384303.793593:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016ca77c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+11:6499:x1874208203212544:12345-0@lo:501: 00000100:00100000:0.0:1787384303.793860:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016ca77c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+11:6499:x1874208203212544:12345-0@lo:501: Request processed in 270us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384303.793868:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787384303.793890:0:6499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cbdd97bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:6499:1874208203212544:0@lo:501: 00000100:00100000:3.0:1787384303.793914:0:6499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cbdd97bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:6499:1874208203212672:0@lo:503: 00000100:00100000:3.0:1787384303.793951:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384303.794015:0:6499:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e8b4598f going to sleep for 11 seconds 00000100:00100000:2.0:1787384303.794101:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203212672 00000100:00100000:2.0:1787384303.794104:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203212672 00000100:00100000:2.0:1787384303.794147:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787384303.794152:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000757f5a71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+11:6499:x1874208203212672:12345-0@lo:503: 00000040:00080000:2.0:1787384303.794175:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787384303.794214:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000757f5a71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+11:6499:x1874208203212672:12345-0@lo:503: Request processed in 62us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384303.794220:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787384303.794284:0:6499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cbdd97bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:6499:1874208203212672:0@lo:503: 00000040:00080000:1.0:1787384303.795207:0:6547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1787384303.795355:0:6499:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1787384303.795382:0:6499:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787384303.795396:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: 00000000545d62be/0x7ef423838fba2370 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2377 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.795406:0:6499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: 00000000545d62be/0x7ef423838fba2370 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2377 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384303.795446:0:6499:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787384303.795448:0:6499:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98f8c896e000 10000000:01000000:3.0:1787384303.795451:0:6499:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98f8c896e000 10000000:01000000:3.0:1787384303.795455:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787384303.795460:0:6499:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98f8c896e000 from 1 10000000:01000000:3.0:1787384303.795462:0:6499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787384303.795482:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: 0000000071ea88e4/0x7ef423838fba237e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.795489:0:6499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: 0000000071ea88e4/0x7ef423838fba237e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.795496:0:6499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: 0000000071ea88e4/0x7ef423838fba237e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384303.795521:0:6499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cbdd97bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:6499:1874208203212800:0@lo:101: 00000100:00100000:3.0:1787384303.795579:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384303.795609:0:6499:0:(client.c:2702:ptlrpc_set_wait()) set 00000000762e6e64 going to sleep for 11 seconds 00000100:00100000:0.0:1787384303.795774:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203212800 00000100:00100000:0.0:1787384303.795803:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203212800 00000100:00100000:0.0:1787384303.795896:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787384303.795905:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b43f445b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+11:6499:x1874208203212800:12345-0@lo:101: 00010000:00010000:0.0:1787384303.795915:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384303.795927:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b2ee5036/0x7ef423838fba2385 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba237e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384303.795945:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b2ee5036/0x7ef423838fba2385 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba237e expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384303.795961:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b2ee5036/0x7ef423838fba2385 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba237e expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384303.795969:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b2ee5036, rc 0) 00000100:00100000:0.0:1787384303.796004:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b43f445b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+12:6499:x1874208203212800:12345-0@lo:101: Request processed in 102us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384303.796011:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787384303.796435:0:6499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cbdd97bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:6499:1874208203212800:0@lo:101: 00010000:00010000:3.0:1787384303.796449:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: 0000000071ea88e4/0x7ef423838fba237e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2385 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.796457:0:6499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: 0000000071ea88e4/0x7ef423838fba237e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2385 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384303.796522:0:6499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cbdd97bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:6499:1874208203212928:0@lo:501: 00000100:00100000:3.0:1787384303.796542:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384303.796996:0:6499:0:(client.c:2702:ptlrpc_set_wait()) set 00000000762e6e64 going to sleep for 11 seconds 00000100:00100000:2.0:1787384303.797603:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203212928 00000100:00100000:2.0:1787384303.797610:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203212928 00000100:00100000:3.0:1787384303.797714:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787384303.797723:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003288935c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+12:6499:x1874208203212928:12345-0@lo:501: 00000100:00100000:3.0:1787384303.798090:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003288935c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+12:6499:x1874208203212928:12345-0@lo:501: Request processed in 368us (1546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384303.798098:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787384303.798169:0:6499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cbdd97bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:6499:1874208203212928:0@lo:501: 00000100:00100000:0.0:1787384303.798216:0:6499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000052bb2616 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:6499:1874208203213056:0@lo:503: 00000100:00100000:0.0:1787384303.798266:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384303.798289:0:6499:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f304db0b going to sleep for 11 seconds 00000100:00100000:1.0:1787384303.798325:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203213056 00000100:00100000:1.0:1787384303.798328:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203213056 00000100:00100000:1.0:1787384303.798357:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787384303.798362:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000885e6009 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+12:6499:x1874208203213056:12345-0@lo:503: 00000100:00100000:1.0:1787384303.798438:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000885e6009 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+12:6499:x1874208203213056:12345-0@lo:503: Request processed in 75us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384303.798452:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787384303.798638:0:6499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000052bb2616 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:6499:1874208203213056:0@lo:503: 00000100:00100000:3.0:1787384303.799064:0:6548:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e7c22d93 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:6548:1874208203213184:0@lo:502: 00000100:00100000:3.0:1787384303.799094:0:6548:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384303.799121:0:6548:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bf513df4 going to sleep for 11 seconds 00000100:00100000:1.0:1787384303.799159:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203213184 00000100:00100000:1.0:1787384303.799163:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203213184 00000100:00100000:1.0:1787384303.799191:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787384303.799196:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a89d54a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+12:6548:x1874208203213184:12345-0@lo:502: 00000100:00100000:1.0:1787384303.799272:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a89d54a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+12:6548:x1874208203213184:12345-0@lo:502: Request processed in 76us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384303.799279:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787384303.799403:0:6548:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e7c22d93 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:6548:1874208203213184:0@lo:502: 00000020:01000004:3.0:1787384303.799446:0:6548:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787384303.799459:0:6548:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000de34b730) 00000020:00000080:3.0:1787384303.799476:0:6548:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1787384303.799629:0:6548:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005fe6a6fa from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787384303.799633:0:6548:0:(tgt_mount.c:187:server_put_mount()) put mount 000000005fe6a6fa from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787384303.799635:0:6548:0:(obd_mount.c:710:lustre_put_lsi()) put 000000005fe6a6fa 4 00010000:00080000:3.0:1787384303.799666:0:6548:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002a3041b6@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.145@tcp at head 00010000:00010000:3.0:1787384303.805554:0:6548:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1787384303.805682:0:6548:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787384303.805735:0:6548:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787384303.805749:0:6548:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x7ef423838fba2393 00000100:00080000:3.0:1787384303.805759:0:6548:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787384303.805773:0:6548:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000002a3041b6 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:3.0:1787384303.806097:0:6548:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e7c22d93 x1874208203213312/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787384303.806126:0:6548:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787384303.806200:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e7c22d93 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874208203213312:0@lo:38: 00000100:00100000:2.0:1787384303.806277:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384303.806378:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203213312 00000100:00100000:3.0:1787384303.806384:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203213312 00000100:00100000:3.0:1787384303.806420:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787384303.806426:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5419b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1874208203213312:12345-0@lo:38: 00000100:00100000:3.0:1787384303.806489:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5419b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1874208203213312:12345-0@lo:38: Request processed in 62us (212us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787384303.806496:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787384303.806616:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787384303.806623:0:3650:0:(import.c:65:import_set_state_nolock()) 000000002a3041b6 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787384303.806628:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787384303.806631:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e7c22d93 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874208203213312:0@lo:38: 00000100:00100000:0.0:1787384303.812084:0:6548:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000081be6e32 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:6548:1874208203213440:0@lo:502: 00000100:00100000:0.0:1787384303.812161:0:6548:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384303.812213:0:6548:0:(client.c:2702:ptlrpc_set_wait()) set 0000000085f6048d going to sleep for 11 seconds 00000100:00100000:2.0:1787384303.812460:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203213440 00000100:00100000:2.0:1787384303.812467:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203213440 00000100:00100000:2.0:1787384303.812515:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787384303.812523:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000121cde19 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+12:6548:x1874208203213440:12345-0@lo:502: 00000100:00100000:2.0:1787384303.812664:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000121cde19 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+12:6548:x1874208203213440:12345-0@lo:502: Request processed in 142us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384303.812672:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787384303.812949:0:6548:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000081be6e32 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:6548:1874208203213440:0@lo:502: 00000040:00080000:0.0:1787384303.812974:0:6548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1787384303.813091:0:6499:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1787384303.813112:0:6499:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787384303.813132:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: 0000000071ea88e4/0x7ef423838fba237e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2385 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384303.813142:0:6499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: 0000000071ea88e4/0x7ef423838fba237e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2385 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787384303.813204:0:6499:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787384303.813207:0:6499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787384303.813208:0:6499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787384303.813209:0:6499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787384303.813210:0:6499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787384303.813212:0:6499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787384303.813213:0:6499:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787384303.813214:0:6499:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787384303.813216:0:6499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787384303.813217:0:6499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787384303.813218:0:6499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787384303.813220:0:6499:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787384303.813223:0:6499:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1787384303.813225:0:6499:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787384303.813226:0:6499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787384303.813227:0:6499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787384303.813233:0:6499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787384303.813233:0:6499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787384303.813234:0:6499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787384303.813235:0:6499:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787384303.813236:0:6499:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787384303.813237:0:6499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787384303.813237:0:6499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787384303.813238:0:6499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787384303.813239:0:6499:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787384303.813254:0:6499:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787384303.813504:0:6499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000faba93fb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:6499:1874208203213568:0@lo:253: 00000100:00100000:1.0:1787384303.813543:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384303.813582:0:6499:0:(client.c:2702:ptlrpc_set_wait()) set 000000003aded173 going to sleep for 11 seconds 00000100:00100000:2.0:1787384303.813673:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203213568 00000100:00100000:2.0:1787384303.813678:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203213568 00000100:00100000:2.0:1787384303.813717:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787384303.813722:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065581b1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+12:6499:x1874208203213568:12345-0@lo:253: 20000000:01000000:2.0:1787384303.813741:0:6516:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787384303.813752:0:6516:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787384303.819505:0:6516:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787384303.819556:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787384303.819880:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065581b1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+12:6499:x1874208203213568:12345-0@lo:253: Request processed in 6154us (6333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384303.819893:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787384303.820050:0:6499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000faba93fb pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:6499:1874208203213568:0@lo:253: 10000000:01000000:1.0:1787384303.820064:0:6499:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787384303.820067:0:6499:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787384303.820069:0:6499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787384303.820070:0:6499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787384303.820071:0:6499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787384303.820072:0:6499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787384303.820073:0:6499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787384303.820075:0:6499:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787384303.820076:0:6499:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787384303.820077:0:6499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787384303.820078:0:6499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787384303.820080:0:6499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787384303.820081:0:6499:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787384303.820095:0:6499:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1787384303.821613:0:6537:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787384303.821621:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787384303.821642:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ea038151/0x7ef423838fba239a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.821658:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003e1348bc/0x7ef423838fba2369 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2362 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.821665:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ea038151/0x7ef423838fba239a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.821713:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003e1348bc/0x7ef423838fba2369 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba2362 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.821729:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003e1348bc/0x7ef423838fba2369 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba2362 expref: 11 pid: 6515 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384303.821742:0:6537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000795c2a05 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874208203213696:0@lo:104: 00000100:00100000:3.0:1787384303.821814:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384303.821882:0:6537:0:(client.c:2702:ptlrpc_set_wait()) set 0000000056b25fe1 going to sleep for 11 seconds 00000100:00100000:0.0:1787384303.822930:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203213696 00000100:00100000:0.0:1787384303.822941:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203213696 00000100:00100000:0.0:1787384303.822990:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787384303.822998:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea796673 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+3:6537:x1874208203213696:12345-0@lo:104: 00010000:00010000:0.0:1787384303.823021:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: 00000000c2acb1f3/0x7ef423838fba2362 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2369 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384303.823089:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787384303.823094:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea796673 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+3:6537:x1874208203213696:12345-0@lo:104: Request processed in 97us (1281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384303.823101:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787384303.823142:0:6537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000795c2a05 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874208203213696:0@lo:104: 00010000:00010000:0.0:1787384303.823163:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ea038151/0x7ef423838fba239a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.824835:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384303.824846:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: 00000000c2acb1f3/0x7ef423838fba2362 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2369 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.824857:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c2acb1f3 already unused, calling callback (000000000cd6bff3) 10000000:00010000:3.0:1787384303.824861:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: 00000000c2acb1f3/0x7ef423838fba2362 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba2369 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.824869:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: 00000000c2acb1f3/0x7ef423838fba2362 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba2369 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787384303.824875:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: 00000000c2acb1f3/0x7ef423838fba2362 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba2369 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384303.824880:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787384303.824926:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: 00000000c2acb1f3/0x7ef423838fba2362 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2369 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.824933:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787384303.824956:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: 00000000c2acb1f3/0x7ef423838fba2362 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2369 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.824963:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: 00000000c2acb1f3/0x7ef423838fba2362 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2369 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.824983:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384303.824985:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384303.824986:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384303.825967:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b5647789 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203213824:0@lo:103: 00000100:00100000:0.0:1787384303.826028:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384303.826216:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203213824 00000100:00100000:3.0:1787384303.826224:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203213824 00010000:00010000:3.0:1787384303.826249:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003e1348bc/0x7ef423838fba2369 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba2362 expref: 12 pid: 6515 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384303.826299:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787384303.826307:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081be6e32 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+12:3652:x1874208203213824:12345-0@lo:103: 00010000:00010000:3.0:1787384303.826319:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384303.826324:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003e1348bc/0x7ef423838fba2369 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba2362 expref: 12 pid: 6515 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.826334:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003e1348bc/0x7ef423838fba2369 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba2362 expref: 12 pid: 6515 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.826347:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003e1348bc/0x7ef423838fba2369 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba2362 expref: 12 pid: 6515 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.826360:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ea038151/0x7ef423838fba239a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.826366:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ea038151/0x7ef423838fba239a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787384303.826379:0:6507:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004758733s 00010000:00010000:3.0:1787384303.826383:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ea038151/0x7ef423838fba239a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.826389:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ea038151/0x7ef423838fba239a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.826395:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ea038151/0x7ef423838fba239a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.826400:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ea038151/0x7ef423838fba239a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.826412:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ea038151 already unused, calling callback (00000000cf2a782c) 00010000:00010000:3.0:1787384303.826415:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ea038151/0x7ef423838fba239a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.826420:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ea038151/0x7ef423838fba239a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.826431:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ea038151/0x7ef423838fba239a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384303.826440:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384303.826472:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081be6e32 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+11:3652:x1874208203213824:12345-0@lo:103: Request processed in 167us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384303.826479:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787384303.826602:0:6537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ea038151/0x7ef423838fba239a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384303.826609:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ea038151/0x7ef423838fba239a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384303.826614:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ea038151/0x7ef423838fba239a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384303.826650:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b5647789 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203213824:0@lo:103: 00080000:10000000:1.0:1787384303.829346:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:1.0:1787384303.829727:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1787384303.830053:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:0.0:1787384303.830386:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1787384303.830590:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:0.0:1787384303.831481:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1787384303.833595:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:0.0:1787384303.834391:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1787384303.835489:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1787384303.835708:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1787384303.836646:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:0.0:1787384303.837015:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:0.0:1787384303.840423:0:6499:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1787384303.849938:0:6499:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1787384303.850088:0:6554:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:0.0:1787384303.851094:0:6553:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1787384303.851100:0:6553:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1787384303.855230:0:6499:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787384303.859083:0:6499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787384303.859509:0:6499:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787384303.859521:0:6499:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787384303.859648:0:6499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787384303.860315:0:6554:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787384303.864626:0:6554:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787384303.864711:0:6554:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787384303.864716:0:6554:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:3.0:1787384303.867172:0:6499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787384303.871962:0:6499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787384303.872066:0:6499:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787384303.872334:0:6499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787384303.872576:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:3.0:1787384303.874502:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1787384303.874674:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1787384303.875083:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1787384303.875215:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1787384303.875354:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1787384303.875489:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1787384303.875656:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1787384303.876172:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1787384303.876364:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1787384303.876499:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1787384303.876673:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1787384303.877041:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1787384303.877172:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1787384303.877644:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1787384303.877889:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1787384303.878010:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1787384303.878287:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1787384303.878441:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1787384303.878895:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1787384303.879037:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1787384303.879179:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1787384303.879339:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1787384303.879476:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1787384303.879625:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1787384303.880063:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1787384303.880368:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1787384303.880508:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1787384303.880769:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1787384303.881008:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1787384303.881163:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1787384303.881829:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1787384303.881978:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1787384303.882167:0:6499:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1787384303.886296:0:6499:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787384303.886335:0:6499:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffac6941c5f988 00100000:10000000:3.0:1787384303.886344:0:6499:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787384303.887265:0:6499:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787384303.887279:0:6499:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.145@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787384303.887301:0:6499:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1787384303.887314:0:6499:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1787384303.889262:0:6499:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787384303.889471:0:6499:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1787384304.567070:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384305.594002:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384306.617325:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384307.646934:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787384308.208981:0:6799:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg345-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787384308.667795:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787384309.177110:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787384309.177120:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787384309.177122:0:469:0:(import.c:65:import_set_state_nolock()) 000000002a3041b6 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787384309.177134:0:469:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000002a3041b6 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:2.0:1787384309.177153:0:469:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008227c44e x1874208203214080/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787384309.177189:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008227c44e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874208203214080:0@lo:38: 00000100:00100000:2.0:1787384309.177249:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384309.178304:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203214080 00000100:00100000:2.0:1787384309.178313:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203214080 00000100:00100000:2.0:1787384309.178363:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787384309.178369:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000083694e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1874208203214080:12345-0@lo:38: 00010000:00080000:2.0:1787384309.178393:0:6523:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:2.0:1787384309.178424:0:6523:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x7ef423838fba23a1 00000004:00100000:2.0:1787384309.178459:0:6523:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787384309.178581:0:6523:0:(import.c:65:import_set_state_nolock()) 0000000032249220 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787384309.178651:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000083694e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874208203214080:12345-0@lo:38: Request processed in 281us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384309.178658:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787384309.178699:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000008227c44e x1874208203214080/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787384319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787384309.178714:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787384309.178720:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787384309.178737:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787384309.178739:0:3650:0:(import.c:65:import_set_state_nolock()) 000000002a3041b6 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787384309.178744:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008227c44e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874208203214080:0@lo:38: 00000100:00100000:3.0:1787384309.178968:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a5c12014 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203213952:0@lo:400: 00000100:00100000:3.0:1787384309.179005:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384309.179167:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203213952 00000100:00100000:2.0:1787384309.179172:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203213952 00000100:00100000:2.0:1787384309.179329:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787384309.179338:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011cc2c85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+11:3653:x1874208203213952:12345-0@lo:400: 00000100:00100000:2.0:1787384309.179381:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011cc2c85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+11:3653:x1874208203213952:12345-0@lo:400: Request processed in 45us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384309.179388:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787384309.179712:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a5c12014 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203213952:0@lo:400: 00000020:00000004:2.0:1787384309.231111:0:6851:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787384309.231300:0:6851:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787384309.687266:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384310.712015:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384311.735025:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787384312.224392:0:6953:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787384312.224584:0:6953:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787384312.760326:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787384313.270853:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787384313.270861:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98f8c896e000 from 3 10000000:01000000:0.0:1787384313.270866:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787384313.270909:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: 000000007ae0d451/0x7ef423838fba23a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384313.270920:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: 000000007ae0d451/0x7ef423838fba23a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384313.270928:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: 000000007ae0d451/0x7ef423838fba23a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384313.270950:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009db6613d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203214208:0@lo:101: 00000100:00100000:0.0:1787384313.271013:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384313.271080:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e2c71148 going to sleep for 11 seconds 00000100:00100000:2.0:1787384313.271179:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203214208 00000100:00100000:2.0:1787384313.271207:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203214208 00000100:00100000:2.0:1787384313.271378:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787384313.271401:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d665bd6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+11:6519:x1874208203214208:12345-0@lo:101: 00010000:00010000:2.0:1787384313.271424:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384313.271437:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000645b4c93/0x7ef423838fba23af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba23a8 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384313.271473:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000645b4c93/0x7ef423838fba23af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba23a8 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384313.271483:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000645b4c93/0x7ef423838fba23af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba23a8 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384313.271491:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000645b4c93, rc 0) 00000100:00100000:2.0:1787384313.271559:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d665bd6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+12:6519:x1874208203214208:12345-0@lo:101: Request processed in 149us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384313.271566:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787384313.271702:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009db6613d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203214208:0@lo:101: 00010000:00010000:1.0:1787384313.271733:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: 000000007ae0d451/0x7ef423838fba23a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba23af expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384313.271742:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: 000000007ae0d451/0x7ef423838fba23a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba23af expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384313.271887:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000faba93fb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203214336:0@lo:256: 00000100:00100000:1.0:1787384313.271943:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384313.279829:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set 0000000058a55e71 going to sleep for 11 seconds 00000100:00100000:0.0:1787384313.279964:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203214336 00000100:00100000:0.0:1787384313.279974:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203214336 00000100:00100000:0.0:1787384313.280104:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787384313.280138:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0806c63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+12:6519:x1874208203214336:12345-0@lo:256: 20000000:01000000:0.0:1787384313.280202:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787384313.280243:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787384313.280247:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787384313.280453:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0806c63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+12:6519:x1874208203214336:12345-0@lo:256: Request processed in 328us (8497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384313.280463:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787384313.280544:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000faba93fb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203214336:0@lo:256: 10000000:01000000:0.0:1787384313.280625:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787384313.280633:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: 000000007ae0d451/0x7ef423838fba23a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba23af expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384313.280643:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: 000000007ae0d451/0x7ef423838fba23a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba23af expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384313.792909:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384314.295086:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003e0848cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203214592:0@lo:400: 00000100:00100000:0.0:1787384314.295201:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384314.295321:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384314.295340:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e426ad03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203214464:0@lo:400: 00000100:00100000:3.0:1787384314.295385:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384314.295436:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203214464 00000100:00100000:3.0:1787384314.295446:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203214464 00000100:00100000:3.0:1787384314.295512:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787384314.295522:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c686dae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+12:3653:x1874208203214464:12345-0@lo:400: 00000100:00100000:3.0:1787384314.295581:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c686dae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+12:3653:x1874208203214464:12345-0@lo:400: Request processed in 60us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384314.295590:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787384314.295646:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e426ad03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203214464:0@lo:400: 00000100:00100000:2.0:1787384314.296415:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203214592 00000100:00100000:2.0:1787384314.296424:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203214592 00000100:00100000:2.0:1787384314.296475:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787384314.296483:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017a50eb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203214592:12345-0@lo:400: 00000100:00100000:2.0:1787384314.310900:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017a50eb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203214592:12345-0@lo:400: Request processed in 14404us (15686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384314.310922:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787384314.311114:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003e0848cd x1874208203214592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384314.311134:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003e0848cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203214592:0@lo:400: 00010000:00010000:1.0:1787384314.809229:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384315.832742:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384316.856190:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384317.878919:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384318.920105:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384319.414945:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a3e8daf7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203214720:0@lo:400: 00000100:00100000:1.0:1787384319.415013:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384319.415087:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a88db7db pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203214848:0@lo:400: 00000100:00100000:1.0:1787384319.415116:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384319.415168:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203214720 00000100:00100000:1.0:1787384319.415177:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203214720 00000100:00100000:1.0:1787384319.415216:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787384319.415223:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000380cd032 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+12:3652:x1874208203214720:12345-0@lo:400: 00000100:00100000:1.0:1787384319.415265:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000380cd032 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+12:3652:x1874208203214720:12345-0@lo:400: Request processed in 42us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384319.415272:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787384319.415302:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203214848 00000100:00100000:1.0:1787384319.415305:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203214848 00000100:00100000:1.0:1787384319.415325:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787384319.415330:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058888da8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203214848:12345-0@lo:400: 00000100:00100000:1.0:1787384319.415368:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058888da8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203214848:12345-0@lo:400: Request processed in 38us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384319.415375:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787384319.415410:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a88db7db x1874208203214848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384319.415421:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a88db7db pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203214848:0@lo:400: 00000100:00100000:1.0:1787384319.415455:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a3e8daf7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203214720:0@lo:400: 00010000:00010000:1.0:1787384319.927121:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384320.957236:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384321.982140:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384323.005690:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787384323.780249:0:7451:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787384323.780254:0:7451:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787384323.780255:0:7451:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787384323.780390:0:7451:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 0000000074b540ac 00000020:01000004:2.0:1787384323.780406:0:7451:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1787384323.780421:0:7451:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787384323.780442:0:7451:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (000000004f7a461d) 00000020:00000080:2.0:1787384323.780459:0:7451:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787384323.863856:0:7451:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1787384323.863935:0:7451:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:3.0:1787384323.881629:0:7451:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787384323.883181:0:7451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1787384323.883192:0:7451:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787384323.883204:0:7451:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7ef423838fba23bd 00000020:01000004:3.0:1787384323.883250:0:7451:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1787384323.883273:0:7451:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.145@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787384323.883276:0:7451:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.145@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787384323.883282:0:7451:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1787384323.883310:0:7451:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1787384323.883313:0:7451:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.145@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1787384323.919220:0:7451:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.145@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787384323.920143:0:7451:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.145@tcp, index=0001, flags=0x20061 00000020:01000004:3.0:1787384323.920150:0:7451:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787384323.920151:0:7451:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787384323.920152:0:7451:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384323.920154:0:7451:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384323.920154:0:7451:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384323.920156:0:7451:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384323.920157:0:7451:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787384323.920158:0:7451:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787384323.920159:0:7451:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787384323.920160:0:7451:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384323.920162:0:7451:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787384323.920165:0:7451:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:3.0:1787384323.920168:0:7451:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787384323.920169:0:7451:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787384323.920171:0:7451:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384323.920172:0:7451:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384323.920173:0:7451:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384323.920184:0:7451:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384323.920185:0:7451:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787384323.920186:0:7451:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787384323.920187:0:7451:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787384323.920188:0:7451:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384323.920188:0:7451:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787384323.920218:0:7451:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787384323.920234:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006ecfe422 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203214976:0@lo:253: 00000100:00100000:3.0:1787384323.920298:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384323.920628:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 0000000053111788 going to sleep for 11 seconds 00000100:00100000:2.0:1787384323.921217:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203214976 00000100:00100000:2.0:1787384323.921227:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203214976 00000100:00100000:2.0:1787384323.921286:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787384323.921295:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c50e9e7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+12:7451:x1874208203214976:12345-0@lo:253: 20000000:01000000:2.0:1787384323.921427:0:6516:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787384323.921440:0:6516:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:2.0:1787384323.921444:0:6516:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:2.0:1787384323.921447:0:6516:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:2.0:1787384323.921488:0:6516:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:3.0:1787384323.928132:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787384323.928686:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1787384323.928708:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787384323.928728:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1787384323.928743:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1787384323.928756:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1787384323.929092:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:3.0:1787384323.929102:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:3.0:1787384323.929115:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:3.0:1787384323.929120:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:3.0:1787384323.929130:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:3.0:1787384323.929133:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:3.0:1787384323.929144:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1787384323.929157:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1787384323.929418:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:3.0:1787384323.929439:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.145@tcp (null) (null) (null) 00000040:00080000:3.0:1787384323.929455:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:3.0:1787384323.929461:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787384323.929475:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:3.0:1787384323.929481:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.145@tcp (null) (null) 00000040:00080000:3.0:1787384323.929493:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:3.0:1787384323.929499:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1787384323.929954:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1787384323.930038:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1787384323.930052:0:6516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1787384323.930136:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:3.0:1787384323.930144:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:3.0:1787384323.930155:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1787384323.930168:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1787384323.930182:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:3.0:1787384323.930187:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:3.0:1787384323.930198:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1787384323.930213:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1787384323.930217:0:6516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:3.0:1787384323.930400:0:6516:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1787384323.930409:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:1.0:1787384323.933953:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1787384323.934957:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1787384323.935060:0:6516:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.145@tcp for mdt 20000000:01000000:3.0:1787384323.935063:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.145@tcp (null) (null) (null) 00000040:00080000:3.0:1787384323.935082:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1787384323.935089:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787384323.935103:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1787384323.935108:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.145@tcp (null) (null) 00000040:00080000:3.0:1787384323.935123:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1787384323.935130:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:3.0:1787384323.935142:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:3.0:1787384323.935156:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:3.0:1787384323.935216:0:6516:0:(mgs_llog.c:3431:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:3.0:1787384323.935225:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1787384323.936994:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:3.0:1787384323.938222:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1787384323.938248:0:6516:0:(mgs_llog.c:3489:mgs_write_log_osp_to_mdt()) add nid 192.168.203.145@tcp for mdt 20000000:01000000:3.0:1787384323.938250:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.145@tcp (null) (null) (null) 00000040:00080000:3.0:1787384323.938269:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1787384323.938287:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787384323.938303:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1787384323.938308:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.145@tcp (null) (null) 00000040:00080000:3.0:1787384323.938321:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1787384323.938328:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:3.0:1787384323.938340:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1787384323.938355:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:3.0:1787384323.938377:0:6516:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787384323.938381:0:6516:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787384323.938385:0:6516:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787384323.938443:0:6516:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787384323.938446:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787384323.942479:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1787384323.942540:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1787384323.942556:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1787384323.943118:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1787384323.943145:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1787384323.943165:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1787384323.943175:0:6516:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787384323.943177:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787384323.943761:0:7460:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1787384323.943822:0:7460:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1787384323.943841:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1787384323.944031:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:3.0:1787384323.944053:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:3.0:1787384323.944066:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:3.0:1787384323.944078:0:6516:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1787384323.944080:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787384323.945311:0:7461:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1787384323.945349:0:7461:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1787384323.945364:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:3.0:1787384323.946046:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1787384323.946073:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1787384323.946116:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:3.0:1787384323.946131:0:6516:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787384323.946134:0:6516:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787384323.946139:0:6516:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1787384323.946145:0:6516:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1787384323.947224:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1787384323.947342:0:6516:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787384323.965821:0:6516:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787384323.965863:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003e1348bc/0x7ef423838fba23c4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.965883:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000053e28eab/0x7ef423838fba22f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba22f2 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.965906:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f0e8aff2/0x7ef423838fba2315 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba230e expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.965912:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b2ee5036/0x7ef423838fba2385 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba237e expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.965919:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003e1348bc/0x7ef423838fba23c4 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.965959:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b2ee5036/0x7ef423838fba2385 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba237e expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.965972:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b2ee5036/0x7ef423838fba2385 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba237e expref: 12 pid: 6516 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384323.965986:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a3e8daf7 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874208203215104:0@lo:104: 00000100:00100000:1.0:1787384323.966046:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787384323.966098:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f0e8aff2/0x7ef423838fba2315 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba230e expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.966106:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f0e8aff2/0x7ef423838fba2315 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba230e expref: 12 pid: 6516 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384323.966115:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000088e04c2 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874208203215232:0@lo:104: 00000100:00100000:1.0:1787384323.966133:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384323.966164:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203215104 00000100:00100000:1.0:1787384323.966172:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203215104 00000100:00100000:1.0:1787384323.966208:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203215232 00000100:00100000:1.0:1787384323.966211:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203215232 00000100:00100000:1.0:1787384323.966233:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787384323.966239:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a88db7db pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+4:6516:x1874208203215104:12345-0@lo:104: 00010000:00010000:1.0:1787384323.966250:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: 0000000071ea88e4/0x7ef423838fba237e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2385 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.966295:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787384323.966300:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a88db7db pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+4:6516:x1874208203215104:12345-0@lo:104: Request processed in 62us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384323.966306:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787384323.966323:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787384323.966329:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004357bb5a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+3:6516:x1874208203215232:12345-0@lo:104: 00010000:00010000:1.0:1787384323.966335:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: 00000000631d474f/0x7ef423838fba230e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2315 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.966366:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787384323.966370:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004357bb5a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+3:6516:x1874208203215232:12345-0@lo:104: Request processed in 43us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384323.966375:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787384323.966390:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787384323.966394:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: 0000000071ea88e4/0x7ef423838fba237e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2385 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.966401:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000071ea88e4 already unused, calling callback (000000000cd6bff3) 10000000:00010000:1.0:1787384323.966404:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: 0000000071ea88e4/0x7ef423838fba237e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba2385 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.966411:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: 0000000071ea88e4/0x7ef423838fba237e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba2385 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787384323.966427:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: 0000000071ea88e4/0x7ef423838fba237e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba2385 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384323.966443:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787384323.966469:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: 0000000071ea88e4/0x7ef423838fba237e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2385 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.966476:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787384323.966491:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: 0000000071ea88e4/0x7ef423838fba237e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2385 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.966497:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: 0000000071ea88e4/0x7ef423838fba237e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2385 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.966509:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384323.966512:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: 00000000631d474f/0x7ef423838fba230e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2315 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.966517:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000631d474f already unused, calling callback (000000000cd6bff3) 10000000:00010000:1.0:1787384323.966519:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: 00000000631d474f/0x7ef423838fba230e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba2315 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.966524:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: 00000000631d474f/0x7ef423838fba230e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba2315 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787384323.966529:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: 00000000631d474f/0x7ef423838fba230e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba2315 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384323.966533:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787384323.966552:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: 00000000631d474f/0x7ef423838fba230e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2315 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.966569:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787384323.966582:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: 00000000631d474f/0x7ef423838fba230e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2315 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.966587:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: 00000000631d474f/0x7ef423838fba230e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2315 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.966596:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384323.966597:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384323.966599:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384323.966605:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384323.966634:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008b9e81dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203215360:0@lo:103: 00000100:00100000:1.0:1787384323.966661:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384323.966696:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000f483259 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203215488:0@lo:103: 00000100:00100000:1.0:1787384323.966719:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384323.966752:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203215360 00000100:00100000:1.0:1787384323.966755:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203215360 00010000:00010000:1.0:1787384323.966770:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b2ee5036/0x7ef423838fba2385 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba237e expref: 13 pid: 6516 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384323.966809:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203215488 00000100:00100000:1.0:1787384323.966813:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203215488 00010000:00010000:1.0:1787384323.966823:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f0e8aff2/0x7ef423838fba2315 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba230e expref: 14 pid: 6516 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384323.966835:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787384323.966840:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0460f75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+14:3654:x1874208203215360:12345-0@lo:103: 00010000:00010000:1.0:1787384323.966861:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384323.966865:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b2ee5036/0x7ef423838fba2385 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba237e expref: 14 pid: 6516 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.966873:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b2ee5036/0x7ef423838fba2385 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba237e expref: 14 pid: 6516 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.966885:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384323.966913:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0460f75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+14:3654:x1874208203215360:12345-0@lo:103: Request processed in 73us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384323.966919:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787384323.966931:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787384323.966936:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000059bfb68 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+13:3651:x1874208203215488:12345-0@lo:103: 00010000:00010000:1.0:1787384323.966943:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384323.966947:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f0e8aff2/0x7ef423838fba2315 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba230e expref: 13 pid: 6516 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.966955:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f0e8aff2/0x7ef423838fba2315 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba230e expref: 13 pid: 6516 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.966963:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384323.966984:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000059bfb68 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+13:3651:x1874208203215488:12345-0@lo:103: Request processed in 49us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384323.966989:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787384323.967023:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000f483259 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203215488:0@lo:103: 00000100:00100000:1.0:1787384323.967045:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008b9e81dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203215360:0@lo:103: 00010000:00010000:1.0:1787384323.967067:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000053e28eab/0x7ef423838fba22f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba22f2 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.967086:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000053e28eab/0x7ef423838fba22f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba22f2 expref: 12 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384323.967095:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008b9e81dd pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874208203215616:0@lo:104: 00000100:00100000:1.0:1787384323.967117:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384323.967135:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203215616 00000100:00100000:1.0:1787384323.967138:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203215616 00000100:00100000:1.0:1787384323.967154:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787384323.967159:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000f483259 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+3:6516:x1874208203215616:12345-0@lo:104: 00010000:00010000:1.0:1787384323.967166:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: 00000000d40a99bf/0x7ef423838fba22f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba22f9 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.967197:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787384323.967201:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000f483259 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+3:6516:x1874208203215616:12345-0@lo:104: Request processed in 43us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384323.967206:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787384323.967219:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384323.967222:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: 00000000d40a99bf/0x7ef423838fba22f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba22f9 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.967227:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d40a99bf already unused, calling callback (000000000cd6bff3) 10000000:00010000:1.0:1787384323.967230:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: 00000000d40a99bf/0x7ef423838fba22f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba22f9 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.967235:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: 00000000d40a99bf/0x7ef423838fba22f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba22f9 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787384323.967240:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: 00000000d40a99bf/0x7ef423838fba22f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba22f9 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384323.967251:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787384323.967268:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: 00000000d40a99bf/0x7ef423838fba22f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba22f9 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.967274:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787384323.967282:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: 00000000d40a99bf/0x7ef423838fba22f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba22f9 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.967287:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: 00000000d40a99bf/0x7ef423838fba22f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba22f9 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.967298:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384323.967300:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384323.967301:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384323.967315:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008a7a792c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203215744:0@lo:103: 00000100:00100000:1.0:1787384323.967338:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384323.967363:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203215744 00000100:00100000:1.0:1787384323.967366:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203215744 00010000:00010000:1.0:1787384323.967379:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000053e28eab/0x7ef423838fba22f9 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba22f2 expref: 13 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384323.967395:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787384323.967400:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007421707 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+13:3652:x1874208203215744:12345-0@lo:103: 00010000:00010000:1.0:1787384323.967406:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384323.967409:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000053e28eab/0x7ef423838fba22f9 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba22f2 expref: 13 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.967417:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000053e28eab/0x7ef423838fba22f9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba22f2 expref: 13 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.967450:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003e1348bc/0x7ef423838fba23c4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.967457:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003e1348bc/0x7ef423838fba23c4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.967468:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003e1348bc/0x7ef423838fba23c4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.967474:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003e1348bc/0x7ef423838fba23c4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.967480:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003e1348bc/0x7ef423838fba23c4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.967485:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003e1348bc/0x7ef423838fba23c4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.967490:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003e1348bc already unused, calling callback (00000000cf2a782c) 00010000:00010000:1.0:1787384323.967493:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003e1348bc/0x7ef423838fba23c4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.967500:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003e1348bc/0x7ef423838fba23c4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.967507:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003e1348bc/0x7ef423838fba23c4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.967516:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384323.967543:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007421707 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+13:3652:x1874208203215744:12345-0@lo:103: Request processed in 144us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384323.967557:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787384323.967584:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008a7a792c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203215744:0@lo:103: 00000100:00100000:1.0:1787384323.967599:0:6516:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e33f6af8 going to sleep for 11 seconds 00010000:00010000:1.0:1787384323.967608:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b2ee5036/0x7ef423838fba2385 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba237e expref: 12 pid: 6516 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384323.967616:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a3e8daf7 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874208203215104:0@lo:104: 00010000:00010000:1.0:1787384323.967624:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f0e8aff2/0x7ef423838fba2315 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba230e expref: 11 pid: 6516 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384323.967632:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000088e04c2 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874208203215232:0@lo:104: 00010000:00010000:1.0:1787384323.967639:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000053e28eab/0x7ef423838fba22f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba22f2 expref: 10 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384323.967646:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008b9e81dd pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874208203215616:0@lo:104: 00010000:00010000:1.0:1787384323.967658:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003e1348bc/0x7ef423838fba23c4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.967666:0:6516:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003e1348bc/0x7ef423838fba23c4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.967671:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003e1348bc/0x7ef423838fba23c4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.967676:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003e1348bc/0x7ef423838fba23c4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787384323.967691:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1787384323.970185:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c50e9e7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+9:7451:x1874208203214976:12345-0@lo:253: Request processed in 48884us (49879us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384323.970200:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787384323.970297:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006ecfe422 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203214976:0@lo:253: 10000000:01000000:0.0:1787384323.970310:0:7451:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1787384323.970313:0:7451:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787384323.970315:0:7451:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787384323.970317:0:7451:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787384323.970318:0:7451:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1787384323.970319:0:7451:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787384323.970320:0:7451:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787384323.970331:0:7451:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787384323.970333:0:7451:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787384323.970335:0:7451:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787384323.970336:0:7451:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787384323.970356:0:7451:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000074b540ac from lustre-MDT0001 10000000:01000000:0.0:1787384323.970384:0:7451:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1787384323.970387:0:7451:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1787384323.970393:0:7451:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98f8f96899c0 local copy 10000000:01000000:0.0:1787384323.970397:0:7451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787384323.970437:0:7451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: 00000000397e1cf3/0x7ef423838fba23cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384323.970448:0:7451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.145@tcp lock: 00000000397e1cf3/0x7ef423838fba23cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384323.970456:0:7451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: 00000000397e1cf3/0x7ef423838fba23cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384323.970473:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006572915b pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203215872:0@lo:101: 00000100:00100000:0.0:1787384323.970508:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384323.970543:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 0000000032f44075 going to sleep for 11 seconds 00000100:00100000:3.0:1787384323.970600:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203215872 00000100:00100000:3.0:1787384323.970614:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203215872 00000100:00100000:3.0:1787384323.970675:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787384323.970682:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000073fa76c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+9:7451:x1874208203215872:12345-0@lo:101: 00010000:00010000:3.0:1787384323.970693:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384323.970704:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f03ce1e6/0x7ef423838fba23d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba23cb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384323.970724:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f03ce1e6/0x7ef423838fba23d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba23cb expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384323.970732:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f03ce1e6/0x7ef423838fba23d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba23cb expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384323.970739:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f03ce1e6, rc 0) 00000100:00100000:3.0:1787384323.970768:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000073fa76c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+10:7451:x1874208203215872:12345-0@lo:101: Request processed in 87us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384323.970774:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787384323.970935:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006572915b pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203215872:0@lo:101: 00010000:00010000:0.0:1787384323.970946:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: 00000000397e1cf3/0x7ef423838fba23cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x7ef423838fba23d2 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384323.970954:0:7451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: 00000000397e1cf3/0x7ef423838fba23cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7ef423838fba23d2 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384323.971036:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006572915b pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203216000:0@lo:501: 00000100:00100000:0.0:1787384323.971061:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384323.971090:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 0000000032f44075 going to sleep for 11 seconds 00000100:00100000:3.0:1787384323.971193:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203216000 00000100:00100000:3.0:1787384323.971197:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203216000 00000100:00100000:3.0:1787384323.971226:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787384323.971232:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000531583c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+10:7451:x1874208203216000:12345-0@lo:501: 00000100:00100000:3.0:1787384323.971296:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000531583c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+10:7451:x1874208203216000:12345-0@lo:501: Request processed in 65us (235us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787384323.971303:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787384323.971429:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006572915b pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203216000:0@lo:501: 10000000:01000000:2.0:1787384323.971449:0:7451:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.145@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787384323.971468:0:7451:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.145@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787384323.971473:0:7451:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: 00000000397e1cf3/0x7ef423838fba23cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7ef423838fba23d2 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384323.971480:0:7451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: 00000000397e1cf3/0x7ef423838fba23cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7ef423838fba23d2 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384323.971485:0:7451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.145@tcp lock: 00000000397e1cf3/0x7ef423838fba23cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7ef423838fba23d2 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384323.971504:0:7451:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787384323.971525:0:7451:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98f8f5698000 10000000:01000000:2.0:1787384323.971535:0:7451:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787384323.971539:0:7451:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff98f8f96899c0 10000000:01000000:2.0:1787384323.971542:0:7451:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787384323.971545:0:7451:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff98f8f96899c0 from 1 10000000:01000000:2.0:1787384323.971547:0:7451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787384323.971618:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384323.971680:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: 00000000397e1cf3/0x7ef423838fba23cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x7ef423838fba23d2 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.971688:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000397e1cf3 already unused, calling callback (000000000cd6bff3) 10000000:00010000:1.0:1787384323.971691:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: 00000000397e1cf3/0x7ef423838fba23cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x7ef423838fba23d2 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.971698:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: 00000000397e1cf3/0x7ef423838fba23cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x7ef423838fba23d2 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787384323.971704:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: 00000000397e1cf3/0x7ef423838fba23cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x7ef423838fba23d2 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384323.971708:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787384323.971727:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: 00000000397e1cf3/0x7ef423838fba23cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x7ef423838fba23d2 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.971733:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787384323.971762:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: 00000000397e1cf3/0x7ef423838fba23cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x7ef423838fba23d2 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.971768:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: 00000000397e1cf3/0x7ef423838fba23cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x7ef423838fba23d2 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384323.971917:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008b9e81dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203216128:0@lo:103: 00000100:00100000:3.0:1787384323.971948:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787384323.972078:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384323.972080:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384323.972082:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384323.972093:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203216128 00000100:00100000:1.0:1787384323.972098:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203216128 00000100:00100000:1.0:1787384323.972137:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787384323.972144:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a049576e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca80b7f5-0e34-441a-981f-ebff717028c4+10:3653:x1874208203216128:12345-0@lo:103: 00010000:00010000:1.0:1787384323.972160:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384323.972172:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f03ce1e6/0x7ef423838fba23d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ef423838fba23cb expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384323.972186:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384323.972229:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a049576e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca80b7f5-0e34-441a-981f-ebff717028c4+9:3653:x1874208203216128:12345-0@lo:103: Request processed in 85us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384323.972237:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787384323.972319:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008b9e81dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203216128:0@lo:103: 00010000:00010000:2.0:1787384323.972364:0:7451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: 00000000099bbf1a/0x7ef423838fba23d9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384323.972372:0:7451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: 00000000099bbf1a/0x7ef423838fba23d9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384323.972379:0:7451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: 00000000099bbf1a/0x7ef423838fba23d9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384323.972392:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008227c44e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203216256:0@lo:101: 00000100:00100000:2.0:1787384323.972420:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384323.972481:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 000000004e23bd12 going to sleep for 11 seconds 00000100:00100000:0.0:1787384323.972515:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203216256 00000100:00100000:0.0:1787384323.972520:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203216256 00000100:00100000:0.0:1787384323.972588:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787384323.972595:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c2b8f195 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+9:7451:x1874208203216256:12345-0@lo:101: 00010000:00010000:0.0:1787384323.972604:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384323.972613:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009597cbed/0x7ef423838fba23e0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba23d9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384323.972640:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009597cbed/0x7ef423838fba23e0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba23d9 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384323.972649:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009597cbed/0x7ef423838fba23e0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba23d9 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384323.972656:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009597cbed, rc 0) 00000100:00100000:0.0:1787384323.972724:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c2b8f195 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+10:7451:x1874208203216256:12345-0@lo:101: Request processed in 130us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384323.972730:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787384323.972976:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008227c44e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203216256:0@lo:101: 00010000:00010000:2.0:1787384323.972987:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: 00000000099bbf1a/0x7ef423838fba23d9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba23e0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384323.972996:0:7451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: 00000000099bbf1a/0x7ef423838fba23d9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba23e0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384323.973014:0:7451:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787384323.973064:0:7451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: 00000000099bbf1a/0x7ef423838fba23d9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba23e0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384323.973070:0:7451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: 00000000099bbf1a/0x7ef423838fba23d9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba23e0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384323.973092:0:7451:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98f8f5698000 10000000:01000000:2.0:1787384323.973096:0:7451:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787384323.973099:0:7451:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff98f8f5698000 from 1 10000000:01000000:2.0:1787384323.973102:0:7451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787384323.973129:0:7451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: 0000000089728173/0x7ef423838fba23e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384323.973135:0:7451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: 0000000089728173/0x7ef423838fba23e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384323.973142:0:7451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: 0000000089728173/0x7ef423838fba23e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384323.973154:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008227c44e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203216384:0@lo:101: 00000100:00100000:2.0:1787384323.973181:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384323.973202:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 000000004e23bd12 going to sleep for 11 seconds 00000100:00100000:3.0:1787384323.973246:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203216384 00000100:00100000:3.0:1787384323.973256:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203216384 00000100:00100000:3.0:1787384323.973320:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787384323.973327:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab81fef7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+10:7451:x1874208203216384:12345-0@lo:101: 00010000:00010000:3.0:1787384323.973334:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384323.973342:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c2acb1f3/0x7ef423838fba23ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba23e7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384323.973356:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c2acb1f3/0x7ef423838fba23ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba23e7 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384323.973364:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c2acb1f3/0x7ef423838fba23ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba23e7 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384323.973370:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c2acb1f3, rc 0) 00000100:00100000:3.0:1787384323.973405:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab81fef7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+11:7451:x1874208203216384:12345-0@lo:101: Request processed in 79us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384323.973411:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787384323.973707:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008227c44e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203216384:0@lo:101: 00010000:00010000:2.0:1787384323.973718:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: 0000000089728173/0x7ef423838fba23e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba23ee expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384323.973724:0:7451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: 0000000089728173/0x7ef423838fba23e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba23ee expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384323.973736:0:7451:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787384323.973822:0:7451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: 0000000089728173/0x7ef423838fba23e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba23ee expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384323.973829:0:7451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: 0000000089728173/0x7ef423838fba23e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba23ee expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384323.973842:0:7451:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787384323.973846:0:7451:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787384323.973850:0:7451:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98f8f5698000 10000000:01000000:2.0:1787384323.973853:0:7451:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787384323.973856:0:7451:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1787384323.973858:0:7451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787384323.973875:0:7451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: 00000000a73db248/0x7ef423838fba23f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384323.973881:0:7451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: 00000000a73db248/0x7ef423838fba23f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384323.973887:0:7451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: 00000000a73db248/0x7ef423838fba23f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384323.973898:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008227c44e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203216512:0@lo:101: 00000100:00100000:2.0:1787384323.973926:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384323.973950:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 000000004e23bd12 going to sleep for 11 seconds 00000100:00100000:3.0:1787384323.974103:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203216512 00000100:00100000:3.0:1787384323.974109:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203216512 00000100:00100000:3.0:1787384323.974142:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787384323.974149:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000073122d76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+11:7451:x1874208203216512:12345-0@lo:101: 00010000:00010000:3.0:1787384323.974155:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384323.974164:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000044829060/0x7ef423838fba23fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba23f5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384323.974177:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000044829060/0x7ef423838fba23fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba23f5 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384323.974184:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000044829060/0x7ef423838fba23fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba23f5 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384323.974202:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000044829060, rc 0) 00000100:00100000:3.0:1787384323.974230:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000073122d76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+12:7451:x1874208203216512:12345-0@lo:101: Request processed in 82us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384323.974236:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787384323.974336:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008227c44e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203216512:0@lo:101: 00010000:00010000:2.0:1787384323.974346:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: 00000000a73db248/0x7ef423838fba23f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba23fc expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384323.974353:0:7451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: 00000000a73db248/0x7ef423838fba23f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba23fc expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384323.974453:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008227c44e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203216640:0@lo:501: 00000100:00100000:2.0:1787384323.974493:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384323.974707:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 000000004e23bd12 going to sleep for 11 seconds 00000100:00100000:3.0:1787384323.974756:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203216640 00000100:00100000:3.0:1787384323.974761:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203216640 00000100:00100000:3.0:1787384323.974936:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787384323.974943:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000247ff0f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+12:7451:x1874208203216640:12345-0@lo:501: 00000100:00100000:3.0:1787384323.975037:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000247ff0f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+12:7451:x1874208203216640:12345-0@lo:501: Request processed in 94us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384323.975043:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787384323.975204:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008227c44e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203216640:0@lo:501: 00000100:00100000:2.0:1787384323.975234:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008227c44e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203216768:0@lo:503: 00000100:00100000:2.0:1787384323.975277:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384323.975348:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 000000004e23bd12 going to sleep for 11 seconds 00000100:00100000:0.0:1787384323.975412:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203216768 00000100:00100000:0.0:1787384323.975417:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203216768 00000100:00100000:0.0:1787384323.975447:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787384323.975452:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee805e29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+12:7451:x1874208203216768:12345-0@lo:503: 00000100:00100000:0.0:1787384323.975539:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee805e29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+12:7451:x1874208203216768:12345-0@lo:503: Request processed in 86us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384323.975545:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787384323.975758:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008227c44e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203216768:0@lo:503: 00000040:00080000:2.0:1787384323.976020:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787384323.976097:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008227c44e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203216896:0@lo:502: 00000100:00100000:2.0:1787384323.976134:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384323.976154:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 000000004e23bd12 going to sleep for 11 seconds 00000100:00100000:0.0:1787384323.976235:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203216896 00000100:00100000:0.0:1787384323.976239:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203216896 00000100:00100000:0.0:1787384323.976261:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787384323.976266:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b02bccb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+12:7451:x1874208203216896:12345-0@lo:502: 00000100:00100000:0.0:1787384323.976342:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b02bccb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+12:7451:x1874208203216896:12345-0@lo:502: Request processed in 76us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384323.976350:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787384323.976426:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008227c44e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203216896:0@lo:502: 00000040:00080000:2.0:1787384323.976737:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787384323.976764:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:2.0:1787384323.976813:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:2.0:1787384323.976828:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:2.0:1787384323.976841:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:2.0:1787384323.976853:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:2.0:1787384323.976881:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:2.0:1787384323.976896:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:2.0:1787384323.976907:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:2.0:1787384323.976920:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:2.0:1787384323.976932:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:2.0:1787384323.976943:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:2.0:1787384323.976954:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:2.0:1787384323.976966:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:2.0:1787384323.976977:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:2.0:1787384323.976989:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:2.0:1787384323.977001:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:2.0:1787384323.977013:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:2.0:1787384323.977037:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:2.0:1787384323.977048:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:2.0:1787384323.977060:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:2.0:1787384323.977072:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:2.0:1787384323.977096:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:2.0:1787384323.977122:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008227c44e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203217024:0@lo:502: 00000100:00100000:2.0:1787384323.977166:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384323.977192:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 000000004e23bd12 going to sleep for 11 seconds 00000100:00100000:0.0:1787384323.977411:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203217024 00000100:00100000:0.0:1787384323.977417:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203217024 00000100:00100000:0.0:1787384323.977455:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787384323.977461:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a363c778 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+12:7451:x1874208203217024:12345-0@lo:502: 00000100:00100000:0.0:1787384323.977544:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a363c778 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+12:7451:x1874208203217024:12345-0@lo:502: Request processed in 82us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384323.977564:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787384323.977730:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008227c44e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203217024:0@lo:502: 00000040:00080000:2.0:1787384323.977805:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:2.0:1787384323.977814:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:3.0:1787384323.978872:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787384323.978885:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384323.978887:0:7463:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1787384323.978892:0:7463:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1787384323.978895:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787384323.978909:0:7463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000fe191416) 00000020:00000080:3.0:1787384323.978929:0:7463:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:3.0:1787384323.978934:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787384323.979003:0:7463:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787384323.979009:0:7463:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7ef423838fba240a 00000020:00000080:3.0:1787384323.979618:0:7463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1787384323.979635:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787384323.979642:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384323.979644:0:7463:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1787384323.979647:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787384323.979651:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384323.979653:0:7463:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1787384323.979656:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787384323.979671:0:7463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (0000000088beac40) 00000020:00000080:3.0:1787384323.979684:0:7463:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:3.0:1787384323.979688:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787384323.979690:0:7463:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1787384323.979693:0:7463:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1787384323.979698:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787384323.979806:0:7463:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000074b540ac from lustre-MDT0001, refs=2 00000020:00000080:3.0:1787384323.979829:0:7463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (0000000027c3b1dd) 00000020:00000080:3.0:1787384323.979839:0:7463:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:3.0:1787384323.979909:0:7463:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787384323.979916:0:7463:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7ef423838fba241f 00000020:00000080:3.0:1787384323.980026:0:7463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1787384323.980033:0:7463:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787384323.980037:0:7463:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x7ef423838fba2426 00080000:01000000:3.0:1787384323.980042:0:7463:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787384323.980045:0:7463:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7ef423838fba242d 00080000:10000000:3.0:1787384323.980483:0:7463:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1787384323.980614:0:7463:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:2.0:1787384324.027765:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384324.075274:0:7463:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1787384324.076049:0:7463:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1787384324.080190:0:7463:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787384324.081021:0:7463:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787384324.104233:0:7463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1787384324.104246:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787384324.104252:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384324.104254:0:7463:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1787384324.104257:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787384324.104263:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384324.104264:0:7463:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1787384324.104267:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787384324.104272:0:7463:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.145@tcp to nid 0x20000c0a8cb91 (192.168.203.145@tcp) 00000020:00000080:3.0:1787384324.104306:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787384324.104435:0:7463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000cd3752f3) 00000020:00000080:3.0:1787384324.104455:0:7463:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1787384324.104462:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787384324.105879:0:7463:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1787384324.105889:0:7463:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787384324.105910:0:7463:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7ef423838fba243b 00010000:00080000:3.0:1787384324.105946:0:7463:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c93f6990@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.145@tcp at head 00010000:00010000:3.0:1787384324.111151:0:7463:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:0.0:1787384324.122342:0:7463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787384324.122357:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787384324.122396:0:7463:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787384324.122417:0:7463:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7ef423838fba2442 00000100:00080000:0.0:1787384324.122426:0:7463:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787384324.122438:0:7463:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000c93f6990 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:0.0:1787384324.122484:0:7463:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b365018f x1874208203217152/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787384324.122511:0:7463:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1787384324.122576:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384324.122580:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384324.122582:0:7463:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1787384324.122584:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787384324.122586:0:7463:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1787384324.122587:0:7463:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787384324.122588:0:7463:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787384324.122589:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787384324.122591:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384324.122593:0:7463:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787384324.122600:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787384324.122605:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384324.122606:0:7463:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1787384324.122610:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787384324.122640:0:7463:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787384324.122654:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384324.122657:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384324.122658:0:7463:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1787384324.122660:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787384324.122662:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384324.122663:0:7463:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787384324.122665:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787384324.122667:0:7463:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787384324.122695:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384324.122698:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384324.122699:0:7463:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787384324.122701:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:2.0:1787384324.123307:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b365018f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203217152:0@lo:38: 00000100:00100000:2.0:1787384324.123451:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1787384324.123517:0:7451:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:2.0:1787384324.123545:0:7451:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787384324.123565:0:7451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: 00000000a73db248/0x7ef423838fba23f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba23fc expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384324.123576:0:7451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: 00000000a73db248/0x7ef423838fba23f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba23fc expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384324.123583:0:7451:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98f8f5698000 from 1 10000000:01000000:2.0:1787384324.123586:0:7451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787384324.123611:0:7451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: 00000000a7fff1a7/0x7ef423838fba2449 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384324.123627:0:7451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: 00000000a7fff1a7/0x7ef423838fba2449 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384324.123637:0:7451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: 00000000a7fff1a7/0x7ef423838fba2449 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384324.123651:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d0c639a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203217280:0@lo:101: 00000100:00100000:2.0:1787384324.123680:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384324.123693:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c734d57e going to sleep for 11 seconds 00000100:00100000:2.0:1787384324.123717:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203217152 00000100:00100000:2.0:1787384324.123723:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203217152 00000100:00100000:2.0:1787384324.123750:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787384324.123756:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008227c44e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1874208203217152:12345-0@lo:38: 00010000:00080000:2.0:1787384324.123800:0:6526:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 219 last 0 00000020:00000080:2.0:1787384324.123840:0:6526:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7ef423838fba2450 00000004:00100000:2.0:1787384324.123854:0:6526:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787384324.123859:0:6526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1787384324.124455:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203217280 00000100:00100000:0.0:1787384324.124460:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203217280 00000100:00100000:0.0:1787384324.124496:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787384324.124503:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081f48b2a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+12:7451:x1874208203217280:12345-0@lo:101: 00010000:00010000:0.0:1787384324.124515:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384324.124529:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008231b2c6/0x7ef423838fba2457 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba2449 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384324.124549:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008231b2c6/0x7ef423838fba2457 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba2449 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384324.124559:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008231b2c6/0x7ef423838fba2457 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2449 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384324.124567:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f6f05bf8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874208203217408:0@lo:400: 00010000:00010000:0.0:1787384324.124568:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008231b2c6, rc 0) 00000100:00100000:3.0:1787384324.124621:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384324.124629:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081f48b2a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+13:7451:x1874208203217280:12345-0@lo:101: Request processed in 125us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384324.124637:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787384324.124669:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203217408 00000100:00100000:3.0:1787384324.124674:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203217408 00000100:00100000:3.0:1787384324.124715:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787384324.124722:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed8c09e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874208203217408:12345-0@lo:400: 00000100:00100000:2.0:1787384324.124739:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d0c639a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203217280:0@lo:101: 00010000:00010000:2.0:1787384324.124752:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: 00000000a7fff1a7/0x7ef423838fba2449 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2457 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384324.124761:0:7451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: 00000000a7fff1a7/0x7ef423838fba2449 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2457 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384324.124803:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed8c09e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874208203217408:12345-0@lo:400: Request processed in 80us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384324.124810:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787384324.124837:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f6f05bf8 x1874208203217408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384324.124848:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f6f05bf8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874208203217408:0@lo:400: 00000100:00100000:2.0:1787384324.127759:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d0c639a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203217536:0@lo:256: 00000100:00100000:2.0:1787384324.127872:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384324.128541:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c734d57e going to sleep for 11 seconds 00000100:00100000:1.0:1787384324.128721:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203217536 00000100:00100000:1.0:1787384324.128731:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203217536 00000100:00100000:1.0:1787384324.128775:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787384324.128797:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087f9f5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+13:7451:x1874208203217536:12345-0@lo:256: 20000000:01000000:1.0:1787384324.128819:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787384324.128836:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787384324.128840:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1787384324.128939:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087f9f5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+13:7451:x1874208203217536:12345-0@lo:256: Request processed in 143us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384324.128948:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787384324.129757:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d0c639a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203217536:0@lo:256: 10000000:01000000:3.0:1787384324.130694:0:7451:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787384324.130771:0:7451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: 00000000a7fff1a7/0x7ef423838fba2449 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2457 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.130803:0:7451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: 00000000a7fff1a7/0x7ef423838fba2449 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2457 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384324.130813:0:7451:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98f8f5698000 from 1 10000000:01000000:3.0:1787384324.130816:0:7451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787384324.130852:0:7451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: 000000006dc193ae/0x7ef423838fba245e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.130873:0:7451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: 000000006dc193ae/0x7ef423838fba245e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.130882:0:7451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: 000000006dc193ae/0x7ef423838fba245e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384324.130905:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f6f05bf8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203217664:0@lo:101: 00000100:00100000:3.0:1787384324.130968:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384324.131021:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 0000000033a936ef going to sleep for 11 seconds 00000100:00100000:2.0:1787384324.131767:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203217664 00000100:00100000:2.0:1787384324.131815:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203217664 00000100:00100000:2.0:1787384324.131876:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787384324.131884:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000431f7e9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+13:7451:x1874208203217664:12345-0@lo:101: 00010000:00010000:2.0:1787384324.131897:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384324.131911:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000df8fae64/0x7ef423838fba2465 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba245e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384324.131932:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000df8fae64/0x7ef423838fba2465 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba245e expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384324.131941:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000df8fae64/0x7ef423838fba2465 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba245e expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384324.131949:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000df8fae64, rc 0) 00000100:00100000:2.0:1787384324.131997:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000431f7e9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+14:7451:x1874208203217664:12345-0@lo:101: Request processed in 114us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384324.132004:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787384324.132174:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f6f05bf8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203217664:0@lo:101: 00010000:00010000:3.0:1787384324.132188:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: 000000006dc193ae/0x7ef423838fba245e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2465 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.132196:0:7451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: 000000006dc193ae/0x7ef423838fba245e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2465 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384324.132289:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f6f05bf8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203217792:0@lo:501: 00000100:00100000:3.0:1787384324.132662:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384324.132738:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 0000000033a936ef going to sleep for 11 seconds 00000100:00100000:2.0:1787384324.133277:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203217792 00000100:00100000:2.0:1787384324.133284:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203217792 00000100:00100000:2.0:1787384324.133658:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787384324.133667:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000073326da3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+14:7451:x1874208203217792:12345-0@lo:501: 00000100:00100000:2.0:1787384324.133827:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000073326da3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+14:7451:x1874208203217792:12345-0@lo:501: Request processed in 154us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384324.133835:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787384324.133999:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f6f05bf8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203217792:0@lo:501: 00000100:00100000:0.0:1787384324.134042:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a842fbc5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203217920:0@lo:503: 00000100:00100000:0.0:1787384324.134085:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384324.134107:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 00000000779dee25 going to sleep for 11 seconds 00000100:00100000:2.0:1787384324.134157:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203217920 00000100:00100000:2.0:1787384324.134162:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203217920 00000100:00100000:2.0:1787384324.134179:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787384324.134192:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023e0ace3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+14:7451:x1874208203217920:12345-0@lo:503: 00000040:00080000:2.0:1787384324.134221:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787384324.134279:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023e0ace3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+14:7451:x1874208203217920:12345-0@lo:503: Request processed in 87us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384324.134286:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787384324.135059:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a842fbc5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203217920:0@lo:503: 00000040:00080000:0.0:1787384324.141224:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787384324.141283:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:0.0:1787384324.141670:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:2.0:1787384324.145519:0:6526:0:(import.c:65:import_set_state_nolock()) 000000001d5fb622 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787384324.145681:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008227c44e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1874208203217152:12345-0@lo:38: Request processed in 21922us (22229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384324.145692:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:0.0:1787384324.146147:0:7468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000100:00100000:3.0:1787384324.146229:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787384324.146239:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1787384324.146247:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787384324.146252:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787384324.146254:0:3650:0:(import.c:65:import_set_state_nolock()) 00000000c93f6990 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787384324.146280:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b365018f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203217152:0@lo:38: 00000020:01000000:2.0:1787384324.146407:0:7451:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1787384324.146452:0:7451:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787384324.146471:0:7451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: 000000006dc193ae/0x7ef423838fba245e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2465 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384324.146479:0:7451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: 000000006dc193ae/0x7ef423838fba245e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2465 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384324.147463:0:7451:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787384324.147469:0:7451:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98f8f5698000 10000000:01000000:2.0:1787384324.147472:0:7451:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98f8f5698000 10000000:01000000:2.0:1787384324.147475:0:7451:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787384324.147482:0:7451:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98f8f5698000 from 1 10000000:01000000:2.0:1787384324.147484:0:7451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787384324.147526:0:7451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: 000000003cb748c6/0x7ef423838fba246c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384324.147535:0:7451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: 000000003cb748c6/0x7ef423838fba246c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384324.147542:0:7451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: 000000003cb748c6/0x7ef423838fba246c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384324.147573:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003a0be975 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203218048:0@lo:101: 00000100:00100000:2.0:1787384324.147630:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384324.147683:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a6213ab7 going to sleep for 11 seconds 00000100:00100000:1.0:1787384324.147765:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203218048 00000100:00100000:1.0:1787384324.147773:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203218048 00000100:00100000:1.0:1787384324.147874:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787384324.147882:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000800b5d84 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+14:7451:x1874208203218048:12345-0@lo:101: 00010000:00010000:1.0:1787384324.147894:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384324.147905:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003e1348bc/0x7ef423838fba2473 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba246c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.147928:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003e1348bc/0x7ef423838fba2473 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba246c expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.147949:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003e1348bc/0x7ef423838fba2473 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba246c expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.147957:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003e1348bc, rc 0) 00000100:00100000:1.0:1787384324.148005:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000800b5d84 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+15:7451:x1874208203218048:12345-0@lo:101: Request processed in 124us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384324.148011:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787384324.148061:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003a0be975 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203218048:0@lo:101: 00010000:00010000:3.0:1787384324.148081:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: 000000003cb748c6/0x7ef423838fba246c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2473 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.148089:0:7451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: 000000003cb748c6/0x7ef423838fba246c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2473 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384324.148169:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000752b9206 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203218176:0@lo:501: 00000100:00100000:3.0:1787384324.148197:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384324.148223:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 000000006ea8c638 going to sleep for 11 seconds 00000100:00100000:3.0:1787384324.148389:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787384324.148399:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a842fbc5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203218304:0@lo:41: 00000100:00100000:3.0:1787384324.148439:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384324.148620:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203218304 00000100:00100000:0.0:1787384324.148625:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203218304 00000100:00100000:0.0:1787384324.148657:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787384324.148664:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d27f7d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3652:x1874208203218304:12345-0@lo:41: 00000100:00100000:2.0:1787384324.148667:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203218176 00000100:00100000:2.0:1787384324.148671:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203218176 00000004:00000024:0.0:1787384324.148688:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1787384324.148692:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787384324.148697:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000001d63f15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+15:7451:x1874208203218176:12345-0@lo:501: 00000100:00100000:0.0:1787384324.148723:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d27f7d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3652:x1874208203218304:12345-0@lo:41: Request processed in 61us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384324.148729:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787384324.148807:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000001d63f15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+15:7451:x1874208203218176:12345-0@lo:501: Request processed in 109us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384324.148812:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a842fbc5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203218304:0@lo:41: 00000100:00100000:2.0:1787384324.148814:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787384324.149155:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000752b9206 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203218176:0@lo:501: 00000100:00100000:0.0:1787384324.149183:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e82d9ba1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203218432:0@lo:503: 00000100:00100000:0.0:1787384324.149223:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384324.149238:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f3b8a77d going to sleep for 11 seconds 00000100:00100000:1.0:1787384324.149408:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203218432 00000100:00100000:1.0:1787384324.149413:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203218432 00000100:00100000:1.0:1787384324.149464:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787384324.149472:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de5024de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+15:7451:x1874208203218432:12345-0@lo:503: 00000100:00100000:1.0:1787384324.149554:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de5024de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+15:7451:x1874208203218432:12345-0@lo:503: Request processed in 83us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384324.149561:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787384324.149635:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e82d9ba1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203218432:0@lo:503: 00000040:00080000:0.0:1787384324.150064:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787384324.150133:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e82d9ba1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203218560:0@lo:502: 00000100:00100000:0.0:1787384324.150172:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384324.150195:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f3b8a77d going to sleep for 11 seconds 00000100:00100000:3.0:1787384324.150256:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203218560 00000100:00100000:3.0:1787384324.150261:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203218560 00000100:00100000:3.0:1787384324.150292:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787384324.150298:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c641e116 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+15:7451:x1874208203218560:12345-0@lo:502: 00000100:00100000:3.0:1787384324.150393:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c641e116 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+15:7451:x1874208203218560:12345-0@lo:502: Request processed in 94us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384324.150399:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787384324.150481:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e82d9ba1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203218560:0@lo:502: 00000040:00080000:0.0:1787384324.150924:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787384324.150957:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787384324.150971:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787384324.150990:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787384324.151002:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787384324.151015:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787384324.151028:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787384324.151040:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787384324.151055:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787384324.151067:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787384324.151081:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787384324.151094:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787384324.151109:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787384324.151123:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787384324.151169:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787384324.151193:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787384324.151207:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787384324.151220:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787384324.151233:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787384324.151610:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787384324.151629:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787384324.151643:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787384324.151656:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787384324.151671:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787384324.151684:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1787384324.151696:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1787384324.151710:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1787384324.151723:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:2.0:1787384324.151755:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001af39006 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203218688:0@lo:502: 00000100:00100000:2.0:1787384324.151838:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384324.151871:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 000000009f1cbdd9 going to sleep for 11 seconds 00000100:00100000:1.0:1787384324.151886:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203218688 00000100:00100000:1.0:1787384324.151894:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203218688 00000100:00100000:1.0:1787384324.151937:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787384324.151945:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7faac4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+15:7451:x1874208203218688:12345-0@lo:502: 00000100:00100000:1.0:1787384324.152048:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7faac4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+15:7451:x1874208203218688:12345-0@lo:502: Request processed in 104us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384324.152056:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787384324.152146:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001af39006 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203218688:0@lo:502: 00000040:00080000:2.0:1787384324.152192:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1787384324.152199:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1787384324.153992:0:7469:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1787384324.154009:0:7469:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000bca90a05) 00000020:00000080:0.0:1787384324.154032:0:7469:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1787384324.154240:0:7469:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000074b540ac from lustre-MDT0001, refs=3 00000020:01000004:0.0:1787384324.154245:0:7469:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000074b540ac from lustre-MDT0001, refs=3 00000020:01000004:0.0:1787384324.154248:0:7469:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000074b540ac 3 00010000:00080000:0.0:1787384324.154298:0:7469:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e1e2ef80@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.145@tcp at head 00010000:00010000:0.0:1787384324.156012:0:7469:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:0.0:1787384324.156112:0:7469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1787384324.156156:0:7469:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787384324.156168:0:7469:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x7ef423838fba2481 00000100:00080000:0.0:1787384324.156177:0:7469:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787384324.156189:0:7469:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000e1e2ef80 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:0.0:1787384324.156221:0:7469:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e82d9ba1 x1874208203218816/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787384324.156250:0:7469:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787384324.156290:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e82d9ba1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874208203218816:0@lo:38: 00000100:00100000:2.0:1787384324.156372:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1787384324.157316:0:7469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:0.0:1787384324.157661:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203218816 00000100:00100000:0.0:1787384324.157670:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203218816 00000100:00100000:0.0:1787384324.157712:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787384324.157719:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001af39006 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1874208203218816:12345-0@lo:38: 00010000:00080000:0.0:1787384324.157827:0:6523:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 219 last 0 00000020:01000000:1.0:1787384324.157847:0:7451:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 00000020:00000080:0.0:1787384324.157859:0:6523:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x7ef423838fba2488 00000004:00100000:0.0:1787384324.157874:0:6523:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 10000000:01000000:1.0:1787384324.157877:0:7451:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787384324.157890:0:7451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: 000000003cb748c6/0x7ef423838fba246c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2473 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787384324.157900:0:6523:0:(import.c:65:import_set_state_nolock()) 00000000f87ebeeb : changing import state from RECOVER to FULL 00010000:00010000:1.0:1787384324.157912:0:7451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: 000000003cb748c6/0x7ef423838fba246c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2473 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787384324.157954:0:7451:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787384324.157956:0:7451:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787384324.157957:0:7451:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787384324.157958:0:7451:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787384324.157960:0:7451:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787384324.157961:0:7451:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000100:00100000:0.0:1787384324.157961:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001af39006 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874208203218816:12345-0@lo:38: Request processed in 242us (1591us total) trans 0 rc 0/0 00000020:01000004:1.0:1787384324.157962:0:7451:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787384324.157964:0:7451:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787384324.157965:0:7451:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787384324.157967:0:7451:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787384324.157968:0:7451:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1787384324.157969:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 10000000:01000000:1.0:1787384324.157971:0:7451:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:1.0:1787384324.157973:0:7451:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787384324.157975:0:7451:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787384324.157976:0:7451:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787384324.157977:0:7451:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787384324.157978:0:7451:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787384324.157979:0:7451:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787384324.157980:0:7451:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787384324.157981:0:7451:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787384324.157982:0:7451:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787384324.157983:0:7451:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787384324.157983:0:7451:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787384324.158001:0:7451:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1787384324.158015:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000088e04c2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203218944:0@lo:253: 00000100:00100000:1.0:1787384324.158054:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384324.158086:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 0000000015e3554a going to sleep for 11 seconds 00000100:00100000:0.0:1787384324.158352:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203218944 00000100:00100000:0.0:1787384324.158357:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203218944 00000100:00100000:0.0:1787384324.158393:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787384324.158400:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048bfca1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+15:7451:x1874208203218944:12345-0@lo:253: 20000000:01000000:0.0:1787384324.158417:0:6514:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00010000:00080000:2.0:1787384324.158768:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e82d9ba1 x1874208203218816/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787384334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384324.158834:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787384324.158842:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1787384324.158849:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787384324.158854:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787384324.158857:0:3650:0:(import.c:65:import_set_state_nolock()) 00000000e1e2ef80 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787384324.158863:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e82d9ba1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874208203218816:0@lo:38: 40000000:00080000:2.0:1787384324.158924:0:7470:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 20000000:01000000:0.0:1787384324.159402:0:6514:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1787384324.171946:0:6501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1787384324.172008:0:6514:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787384324.172021:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1787384324.172170:0:6537:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787384324.172179:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787384324.172199:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000dde3f21d/0x7ef423838fba248f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384324.172217:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000645b4c93/0x7ef423838fba23af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba23a8 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384324.172223:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008231b2c6/0x7ef423838fba2457 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2449 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384324.172228:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000dde3f21d/0x7ef423838fba248f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384324.172276:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008231b2c6/0x7ef423838fba2457 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba2449 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384324.172288:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008231b2c6/0x7ef423838fba2457 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba2449 expref: 15 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384324.172301:0:6537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000eedc9b9a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874208203219072:0@lo:104: 00000100:00100000:0.0:1787384324.172308:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048bfca1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+15:7451:x1874208203218944:12345-0@lo:253: Request processed in 13909us (14253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384324.172318:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787384324.172335:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787384324.172392:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000645b4c93/0x7ef423838fba23af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba23a8 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384324.172399:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000645b4c93/0x7ef423838fba23af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba23a8 expref: 14 pid: 6516 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384324.172407:0:6537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009d45e192 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874208203219200:0@lo:104: 00000100:00100000:2.0:1787384324.172436:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384324.172459:0:6537:0:(client.c:2702:ptlrpc_set_wait()) set 000000004a7b5220 going to sleep for 11 seconds 00000100:00100000:0.0:1787384324.172503:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203219072 00000100:00100000:0.0:1787384324.172511:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203219072 00000100:00100000:0.0:1787384324.172545:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203219200 00000100:00100000:0.0:1787384324.172547:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203219200 00000100:00100000:0.0:1787384324.172560:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787384324.172566:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c8b903c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+4:6537:x1874208203219072:12345-0@lo:104: 00010000:00010000:0.0:1787384324.172575:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: 00000000a7fff1a7/0x7ef423838fba2449 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2457 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384324.172632:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787384324.172637:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c8b903c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+4:6537:x1874208203219072:12345-0@lo:104: Request processed in 71us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384324.172642:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787384324.172655:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787384324.172660:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000697cfdd0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+3:6537:x1874208203219200:12345-0@lo:104: 00010000:00010000:0.0:1787384324.172667:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: 000000007ae0d451/0x7ef423838fba23a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba23af expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.172668:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384324.172673:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: 00000000a7fff1a7/0x7ef423838fba2449 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2457 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.172680:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a7fff1a7 already unused, calling callback (000000000cd6bff3) 10000000:00010000:3.0:1787384324.172682:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: 00000000a7fff1a7/0x7ef423838fba2449 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba2457 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384324.172694:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787384324.172697:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000697cfdd0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+3:6537:x1874208203219200:12345-0@lo:104: Request processed in 39us (270us total) trans 0 rc 0/0 00010000:00010000:3.0:1787384324.172699:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: 00000000a7fff1a7/0x7ef423838fba2449 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba2457 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384324.172703:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 10000000:00010000:3.0:1787384324.172706:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: 00000000a7fff1a7/0x7ef423838fba2449 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba2457 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384324.172711:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787384324.172739:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: 00000000a7fff1a7/0x7ef423838fba2449 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2457 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.172747:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787384324.172767:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: 00000000a7fff1a7/0x7ef423838fba2449 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2457 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.172773:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: 00000000a7fff1a7/0x7ef423838fba2449 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2457 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.172806:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384324.172808:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: 000000007ae0d451/0x7ef423838fba23a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba23af expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.172814:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007ae0d451 already unused, calling callback (000000000cd6bff3) 10000000:00010000:3.0:1787384324.172816:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: 000000007ae0d451/0x7ef423838fba23a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba23af expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.172822:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: 000000007ae0d451/0x7ef423838fba23a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba23af expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787384324.172827:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: 000000007ae0d451/0x7ef423838fba23a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba23af expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384324.172838:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787384324.172855:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: 000000007ae0d451/0x7ef423838fba23a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba23af expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.172861:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787384324.172871:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: 000000007ae0d451/0x7ef423838fba23a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba23af expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384324.172875:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1787384324.172876:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: 000000007ae0d451/0x7ef423838fba23a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba23af expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384324.172885:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000097bf5ceb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203219328:0@lo:103: 00010000:00010000:3.0:1787384324.172886:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384324.172888:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384324.172889:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384324.172896:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bc7b9289 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203219456:0@lo:103: 00000100:00100000:1.0:1787384324.172912:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384324.172928:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384324.172942:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203219328 00000100:00100000:3.0:1787384324.172951:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203219456 00000100:00100000:1.0:1787384324.172951:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203219328 00000100:00100000:3.0:1787384324.172953:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203219456 00010000:00010000:3.0:1787384324.172966:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000645b4c93/0x7ef423838fba23af lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba23a8 expref: 16 pid: 6516 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.172966:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008231b2c6/0x7ef423838fba2457 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba2449 expref: 16 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384324.173201:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787384324.173210:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3e8daf7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+16:3651:x1874208203219328:12345-0@lo:103: 00010000:00010000:1.0:1787384324.173220:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384324.173225:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008231b2c6/0x7ef423838fba2457 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba2449 expref: 16 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.173234:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008231b2c6/0x7ef423838fba2457 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba2449 expref: 16 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.173248:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384324.173560:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3e8daf7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+16:3651:x1874208203219328:12345-0@lo:103: Request processed in 344us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384324.173568:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787384324.173584:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787384324.173589:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1ec08c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+15:3653:x1874208203219456:12345-0@lo:103: 00010000:00010000:1.0:1787384324.173597:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384324.173601:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000645b4c93/0x7ef423838fba23af lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba23a8 expref: 15 pid: 6516 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.173609:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000645b4c93/0x7ef423838fba23af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba23a8 expref: 15 pid: 6516 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.173619:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000dde3f21d/0x7ef423838fba248f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.173626:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dde3f21d/0x7ef423838fba248f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787384324.173646:0:6508:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004758733s 00010000:00010000:1.0:1787384324.173650:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dde3f21d/0x7ef423838fba248f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.173657:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dde3f21d/0x7ef423838fba248f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.173663:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000dde3f21d/0x7ef423838fba248f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.173668:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000dde3f21d/0x7ef423838fba248f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.173674:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dde3f21d already unused, calling callback (00000000cf2a782c) 00010000:00010000:1.0:1787384324.173678:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000dde3f21d/0x7ef423838fba248f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.173685:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000dde3f21d/0x7ef423838fba248f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.173693:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000dde3f21d/0x7ef423838fba248f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.173702:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384324.173731:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1ec08c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+15:3653:x1874208203219456:12345-0@lo:103: Request processed in 142us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384324.173750:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787384324.173885:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000097bf5ceb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203219328:0@lo:103: 00010000:00010000:2.0:1787384324.174094:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384324.174125:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008231b2c6/0x7ef423838fba2457 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba2449 expref: 14 pid: 6514 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384324.174136:0:6537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000eedc9b9a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874208203219072:0@lo:104: 00010000:00010000:2.0:1787384324.174150:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000645b4c93/0x7ef423838fba23af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba23a8 expref: 13 pid: 6516 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384324.174157:0:6537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009d45e192 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874208203219200:0@lo:104: 00010000:00010000:2.0:1787384324.174171:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000dde3f21d/0x7ef423838fba248f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384324.174189:0:6537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000dde3f21d/0x7ef423838fba248f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384324.174194:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000dde3f21d/0x7ef423838fba248f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384324.174199:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000dde3f21d/0x7ef423838fba248f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384324.174925:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000088e04c2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:7451:1874208203218944:0@lo:253: 10000000:01000000:0.0:1787384324.174938:0:7451:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1787384324.174941:0:7451:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787384324.174942:0:7451:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787384324.174943:0:7451:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787384324.174944:0:7451:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787384324.174946:0:7451:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787384324.174947:0:7451:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787384324.174957:0:7451:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787384324.174958:0:7451:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787384324.174959:0:7451:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787384324.174961:0:7451:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787384324.174962:0:7451:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787384324.174973:0:7451:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1787384324.182305:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bc7b9289 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203219456:0@lo:103: 00080000:10000000:2.0:1787384324.191807:0:7451:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:2.0:1787384324.192011:0:7451:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1787384324.192252:0:7451:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1787384324.192445:0:7451:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1787384324.194856:0:7451:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1787384324.195102:0:7451:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1787384324.196640:0:7451:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1787384324.196927:0:7451:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1787384324.197112:0:7451:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1787384324.197286:0:7451:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1787384324.197475:0:7451:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:2.0:1787384324.197668:0:7451:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:2.0:1787384324.201313:0:7451:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:2.0:1787384324.201771:0:7475:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:2.0:1787384324.201848:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009d45e192 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7475:1874208203219584:0@lo:700: 00000100:00100000:2.0:1787384324.201941:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384324.201988:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c99fd3d5 going to sleep for 11 seconds 00000040:01000000:3.0:1787384324.202194:0:7451:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1787384324.202198:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203219584 00000100:00100000:3.0:1787384324.202509:0:7476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bc7b9289 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874208203219712:0@lo:1000: 00000100:00100000:3.0:1787384324.202672:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384324.202708:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203219712 00000100:00100000:3.0:1787384324.202713:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203219712 00000100:00100000:3.0:1787384324.202752:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787384324.202766:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000148186ac pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1874208203219712:12345-0@lo:1000: 00000100:00100000:3.0:1787384324.202859:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000148186ac pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1874208203219712:12345-0@lo:1000: Request processed in 93us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384324.202867:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787384324.202877:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203219584 00000100:00100000:3.0:1787384324.202898:0:7476:0:(client.c:2702:ptlrpc_set_wait()) set 0000000033a936ef going to sleep for 11 seconds 00000100:00100000:1.0:1787384324.202912:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787384324.202922:0:7476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bc7b9289 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874208203219712:0@lo:1000: 00000100:00100000:1.0:1787384324.202924:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eedc9b9a pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7475:x1874208203219584:12345-0@lo:700: 00000040:01000000:3.0:1787384324.202954:0:7476:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:3.0:1787384324.202975:0:7476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bc7b9289 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874208203219840:0@lo:700: 00000100:00100000:3.0:1787384324.202999:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384324.203012:0:7476:0:(client.c:2702:ptlrpc_set_wait()) set 000000006ea8c638 going to sleep for 11 seconds 00000100:00100000:2.0:1787384324.203101:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203219840 00000100:00100000:2.0:1787384324.203105:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203219840 00000100:00100000:2.0:1787384324.203156:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787384324.203161:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee9c5ced pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7476:x1874208203219840:12345-0@lo:700: 00000100:00100000:2.0:1787384324.203209:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee9c5ced pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7476:x1874208203219840:12345-0@lo:700: Request processed in 48us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384324.203216:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:01000000:2.0:1787384324.203770:0:7451:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1787384324.203945:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787384324.204442:0:7451:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787384324.204451:0:7451:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:3.0:1787384324.204933:0:7476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bc7b9289 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874208203219840:0@lo:700: 00000100:00100000:3.0:1787384324.204992:0:7476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bc7b9289 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7476:1874208203219968:0@lo:900: 00000100:00100000:3.0:1787384324.205042:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384324.205073:0:7476:0:(client.c:2702:ptlrpc_set_wait()) set 000000006ea8c638 going to sleep for 11 seconds 00000100:00100000:1.0:1787384324.205099:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203219968 00000100:00100000:1.0:1787384324.205105:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203219968 00000100:00100000:1.0:1787384324.205229:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787384324.205238:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4bd3abf pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7476:x1874208203219968:12345-0@lo:900: 00000100:00100000:1.0:1787384324.205318:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4bd3abf pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7476:x1874208203219968:12345-0@lo:900: Request processed in 75us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384324.205324:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787384324.205473:0:7476:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000bc7b9289 x1874208203219968/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787384340 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384324.205484:0:7476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bc7b9289 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7476:1874208203219968:0@lo:900: 00000100:00100000:3.0:1787384324.205675:0:7476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bc7b9289 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874208203220096:0@lo:1000: 00000100:00100000:3.0:1787384324.205706:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384324.205732:0:7476:0:(client.c:2702:ptlrpc_set_wait()) set 0000000043298c31 going to sleep for 11 seconds 00000100:00100000:1.0:1787384324.205769:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203220096 00000100:00100000:1.0:1787384324.205774:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203220096 00000100:00100000:1.0:1787384324.205885:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787384324.205890:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000701b3dbd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1874208203220096:12345-0@lo:1000: 00000100:00100000:1.0:1787384324.205965:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000701b3dbd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1874208203220096:12345-0@lo:1000: Request processed in 75us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384324.205972:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:2.0:1787384324.206028:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787384324.206485:0:7476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bc7b9289 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874208203220096:0@lo:1000: 00000004:00080000:3.0:1787384324.206538:0:7476:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000006ea8c638 with version 0 00000020:00100000:3.0:1787384324.206661:0:7476:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787384324.206668:0:7476:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000bc7b9289 x1874208203220352/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787384324.206694:0:7476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bc7b9289 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874208203220352:0@lo:1000: 00000100:00100000:3.0:1787384324.206724:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384324.206749:0:7476:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c3b7bc39 going to sleep for 11 seconds 00000020:00080000:0.0:1787384324.206832:0:7474:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1787384324.206838:0:7474:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:1.0:1787384324.207290:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203220352 00000100:00100000:1.0:1787384324.207302:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203220352 00000100:00100000:1.0:1787384324.207497:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787384324.207507:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d22fbdd5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1874208203220352:12345-0@lo:1000: 00000040:00080000:2.0:1787384324.207515:0:7451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787384324.207995:0:7451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787384324.208025:0:7451:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1787384324.208157:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787384324.208355:0:7451:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1787384324.209304:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1787384324.209472:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1787384324.209738:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1787384324.210206:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1787384324.210371:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1787384324.212274:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1787384324.212446:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1787384324.214254:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1787384324.214519:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1787384324.214733:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1787384324.214908:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1787384324.215094:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1787384324.215260:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1787384324.215397:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1787384324.215555:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1787384324.215706:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1787384324.216035:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1787384324.216172:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1787384324.216300:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1787384324.216466:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1787384324.216597:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1787384324.216745:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1787384324.216923:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1787384324.217089:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1787384324.217232:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1787384324.217375:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00000001:00080000:2.0:1787384324.221550:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:0.0:1787384324.221868:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d22fbdd5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1874208203220352:12345-0@lo:1000: Request processed in 14359us (15139us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787384324.221882:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:2.0:1787384324.222035:0:7476:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1787384324.222040:0:7476:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787384324.222056:0:7476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bc7b9289 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874208203220352:0@lo:1000: 00000100:00100000:2.0:1787384324.222147:0:7476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000068ca115d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874208203220480:0@lo:1000: 00000100:00100000:2.0:1787384324.222184:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384324.222226:0:7476:0:(client.c:2702:ptlrpc_set_wait()) set 0000000025958376 going to sleep for 11 seconds 00000100:00100000:0.0:1787384324.222366:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203220480 00000100:00100000:0.0:1787384324.222373:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203220480 00000100:00100000:0.0:1787384324.222416:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787384324.222440:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000018c4c125 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1874208203220480:12345-0@lo:1000: 00000100:00100000:0.0:1787384324.222515:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000018c4c125 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1874208203220480:12345-0@lo:1000: Request processed in 91us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384324.222521:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787384324.223153:0:7476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000068ca115d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874208203220480:0@lo:1000: 00000040:00080000:2.0:1787384324.223195:0:7476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1787384324.223227:0:7476:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000c5dc491b with version 1 40000000:02000000:1.0:1787384324.223611:0:6528:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000004:00080000:0.0:1787384324.224203:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000082337bd1 version 1 rpc_version 1 00000020:00100000:0.0:1787384324.224231:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787384324.224239:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000ad96ac06 x1874208203220736/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787384324.224257:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ad96ac06 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1874208203220736:0@lo:1000: 00000100:00100000:0.0:1787384324.224325:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384324.224358:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set 000000002ef28147 going to sleep for 11 seconds 00000100:00100000:0.0:1787384324.224379:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203220736 00000100:00100000:0.0:1787384324.224396:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203220736 00000100:00100000:0.0:1787384324.224449:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787384324.224456:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d1169a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7466:x1874208203220736:12345-0@lo:1000: 00000040:00080000:2.0:1787384324.226764:0:7476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787384324.226883:0:7476:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:2.0:1787384324.227180:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1787384324.227396:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1787384324.227555:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1787384324.227692:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1787384324.227869:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1787384324.228023:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1787384324.228215:0:7451:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1787384324.236232:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:0.0:1787384324.237153:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d1169a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7466:x1874208203220736:12345-0@lo:1000: Request processed in 12693us (12823us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787384324.237180:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:3.0:1787384324.237522:0:7466:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1787384324.237528:0:7466:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787384324.237547:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ad96ac06 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1874208203220736:0@lo:1000: 00000001:00080000:2.0:1787384324.240071:0:7451:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787384324.240113:0:7451:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffac6941c4f988 00100000:10000000:2.0:1787384324.240121:0:7451:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000100:00100000:1.0:1787384324.248060:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eedc9b9a pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7475:x1874208203219584:12345-0@lo:700: Request processed in 45129us (46113us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384324.248075:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000004:3.0:1787384324.248595:0:7451:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787384324.248629:0:7451:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.145@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787384324.248650:0:7451:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787384324.248665:0:7451:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1787384324.249708:0:7451:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787384324.249968:0:7451:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00080000:2.0:1787384324.259329:0:7475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009d45e192 x1874208203219584/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787384340 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384324.259350:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009d45e192 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7475:1874208203219584:0@lo:700: 40000000:02000000:2.0:1787384324.259365:0:7475:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000040:00080000:3.0:1787384324.309731:0:7475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787384324.327863:0:7475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787384324.327940:0:7475:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787384324.327945:0:7475:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:3.0:1787384325.047202:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384326.079448:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384327.096706:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384328.120361:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787384328.939137:0:7721:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg345-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787384329.142940:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384329.655903:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787384329.655927:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c5fd7ce4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203220864:0@lo:41: 00000100:00100000:0.0:1787384329.655992:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384329.656142:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203220864 00000100:00100000:2.0:1787384329.656150:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203220864 00000100:00100000:2.0:1787384329.656202:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787384329.656211:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c38ce42f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203220864:12345-0@lo:41: 00000004:00000024:2.0:1787384329.656251:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1787384329.656296:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c38ce42f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203220864:12345-0@lo:41: Request processed in 87us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384329.656303:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787384329.656343:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c5fd7ce4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203220864:0@lo:41: 00000100:00100000:3.0:1787384329.660829:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787384329.660852:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a049576e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874208203221248:0@lo:400: 00000100:00100000:3.0:1787384329.660912:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384329.660963:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203221248 00000100:00100000:3.0:1787384329.660970:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203221248 00000100:00100000:3.0:1787384329.661023:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787384329.661030:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000752b9206 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874208203221248:12345-0@lo:400: 00000100:00100000:3.0:1787384329.661077:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000752b9206 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874208203221248:12345-0@lo:400: Request processed in 48us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384329.661085:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787384329.661121:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000a049576e x1874208203221248/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384329.661134:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a049576e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874208203221248:0@lo:400: 00000100:00100000:0.0:1787384329.661283:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bc7b9289 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203220992:0@lo:400: 00000100:00100000:0.0:1787384329.661318:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384329.661348:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787384329.661353:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000097bf5ceb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203221120:0@lo:400: 00000100:00100000:0.0:1787384329.661374:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384329.661412:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203221120 00000100:00100000:0.0:1787384329.661416:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203221120 00000100:00100000:0.0:1787384329.661442:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787384329.661448:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000551262f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203221120:12345-0@lo:400: 00000100:00100000:0.0:1787384329.661480:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000551262f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203221120:12345-0@lo:400: Request processed in 33us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384329.661486:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787384329.661509:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000097bf5ceb x1874208203221120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384329.661517:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000097bf5ceb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203221120:0@lo:400: 00000100:00100000:3.0:1787384329.665708:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203220992 00000100:00100000:3.0:1787384329.665723:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203220992 00000100:00100000:3.0:1787384329.665775:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787384329.665810:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000260fbe13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+13:3651:x1874208203220992:12345-0@lo:400: 00000100:00100000:3.0:1787384329.665895:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000260fbe13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+13:3651:x1874208203220992:12345-0@lo:400: Request processed in 86us (4576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384329.665902:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787384329.665997:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bc7b9289 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203220992:0@lo:400: 00000020:00000004:0.0:1787384330.023115:0:7773:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787384330.023321:0:7773:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787384330.168111:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384331.191452:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384332.217037:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787384333.106185:0:7874:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787384333.106364:0:7874:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787384333.239482:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787384334.175688:0:7923:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffcb0dcc610 00000020:00000080:3.0:1787384334.175704:0:7923:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:3.0:1787384334.175709:0:7923:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:3.0:1787384334.175716:0:7923:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcb0dce8a0 20000000:00000080:3.0:1787384334.175722:0:7923:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98f8f5721800 uarg=0000000000000000 20000000:01000000:3.0:1787384334.175765:0:7923:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787384334.175772:0:7923:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787384334.175996:0:7923:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787384334.176075:0:7923:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1787384334.176087:0:7923:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1787384334.183624:0:7923:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787384334.183895:0:7923:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787384334.184288:0:7923:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1787384334.184307:0:7923:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1787384334.184323:0:7923:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787384334.184339:0:7923:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006718ae70/0x7ef423838fba2496 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384334.184355:0:7923:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b655cb76/0x7ef423838fba2377 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2370 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384334.184385:0:7923:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000df8fae64/0x7ef423838fba2465 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba245e expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384334.184391:0:7923:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006718ae70/0x7ef423838fba2496 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384334.184427:0:7923:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000df8fae64/0x7ef423838fba2465 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba245e expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384334.184440:0:7923:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000df8fae64/0x7ef423838fba2465 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba245e expref: 12 pid: 6516 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384334.184453:0:7923:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a049576e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7923:1874208203221376:0@lo:104: 00000100:00100000:3.0:1787384334.184528:0:7923:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787384334.184584:0:7923:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b655cb76/0x7ef423838fba2377 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba2370 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384334.184592:0:7923:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b655cb76/0x7ef423838fba2377 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba2370 expref: 12 pid: 6515 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384334.184600:0:7923:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f6f05bf8 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7923:1874208203221504:0@lo:104: 00000100:00100000:3.0:1787384334.184619:0:7923:0:(client.c:2702:ptlrpc_set_wait()) set 000000000771bab8 going to sleep for 11 seconds 00000100:00100000:0.0:1787384334.184733:0:6506:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787384334.184754:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384334.184774:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203221376 00000100:00100000:0.0:1787384334.184800:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203221376 00000100:00100000:0.0:1787384334.184855:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203221504 00000100:00100000:0.0:1787384334.184858:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203221504 00000100:00100000:0.0:1787384334.184871:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787384334.184877:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000799f167 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+4:7923:x1874208203221376:12345-0@lo:104: 00010000:00010000:0.0:1787384334.184888:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: 000000006dc193ae/0x7ef423838fba245e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2465 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.184950:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787384334.184955:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000799f167 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+4:7923:x1874208203221376:12345-0@lo:104: Request processed in 79us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384334.184962:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787384334.185000:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787384334.185006:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5917d8e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+3:7923:x1874208203221504:12345-0@lo:104: 00010000:00010000:0.0:1787384334.185012:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: 00000000545d62be/0x7ef423838fba2370 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2377 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.185050:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787384334.185054:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5917d8e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+3:7923:x1874208203221504:12345-0@lo:104: Request processed in 50us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384334.185060:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1787384334.185076:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787384334.185081:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: 000000006dc193ae/0x7ef423838fba245e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2465 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.185091:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006dc193ae already unused, calling callback (000000000cd6bff3) 10000000:00010000:0.0:1787384334.185095:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: 000000006dc193ae/0x7ef423838fba245e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba2465 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.185104:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: 000000006dc193ae/0x7ef423838fba245e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba2465 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787384334.185121:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: 000000006dc193ae/0x7ef423838fba245e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba2465 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384334.185127:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787384334.185161:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: 000000006dc193ae/0x7ef423838fba245e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2465 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.185169:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787384334.185203:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: 000000006dc193ae/0x7ef423838fba245e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2465 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.185210:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: 000000006dc193ae/0x7ef423838fba245e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2465 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.185223:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384334.185225:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: 00000000545d62be/0x7ef423838fba2370 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2377 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.185230:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000545d62be already unused, calling callback (000000000cd6bff3) 10000000:00010000:0.0:1787384334.185231:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: 00000000545d62be/0x7ef423838fba2370 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba2377 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.185236:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: 00000000545d62be/0x7ef423838fba2370 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba2377 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787384334.185241:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: 00000000545d62be/0x7ef423838fba2370 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba2377 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384334.185246:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787384334.185263:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: 00000000545d62be/0x7ef423838fba2370 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2377 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.185269:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787384334.185283:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: 00000000545d62be/0x7ef423838fba2370 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2377 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.185288:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: 00000000545d62be/0x7ef423838fba2370 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2377 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.185300:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384334.185301:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384334.185302:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384334.185307:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787384334.185317:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787384334.185319:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98f8f5698000 from 4 10000000:01000000:0.0:1787384334.185322:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787384334.185337:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: 00000000397e1cf3/0x7ef423838fba249d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.185344:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: 00000000397e1cf3/0x7ef423838fba249d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.185350:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: 00000000397e1cf3/0x7ef423838fba249d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384334.185373:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008420d992 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203221888:0@lo:101: 00000100:00100000:0.0:1787384334.185404:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384334.185421:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e7bbed85 going to sleep for 11 seconds 00000100:00100000:0.0:1787384334.185435:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000133f5988 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203221632:0@lo:103: 00000100:00100000:0.0:1787384334.185457:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384334.185497:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a26b933e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203221760:0@lo:103: 00000100:00100000:0.0:1787384334.185520:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384334.185550:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203221888 00000100:00100000:0.0:1787384334.185554:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203221888 00000100:00100000:0.0:1787384334.185582:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787384334.185588:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041133589 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+13:6519:x1874208203221888:12345-0@lo:101: 00010000:00010000:0.0:1787384334.185600:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384334.185611:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007ae0d451/0x7ef423838fba24a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba249d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.185628:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007ae0d451/0x7ef423838fba24a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba249d expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.185636:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007ae0d451/0x7ef423838fba24a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba249d expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.185644:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007ae0d451, rc 0) 00000100:00100000:0.0:1787384334.185671:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041133589 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+14:6519:x1874208203221888:12345-0@lo:101: Request processed in 83us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384334.185676:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787384334.185701:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203221632 00000100:00100000:0.0:1787384334.185704:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203221632 00010000:00010000:0.0:1787384334.185718:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000df8fae64/0x7ef423838fba2465 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba245e expref: 14 pid: 6516 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384334.185735:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203221760 00000100:00100000:0.0:1787384334.185738:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203221760 00010000:00010000:0.0:1787384334.185746:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b655cb76/0x7ef423838fba2377 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba2370 expref: 15 pid: 6515 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384334.185757:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787384334.185768:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5fd7ce4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+15:3654:x1874208203221632:12345-0@lo:103: 00010000:00010000:0.0:1787384334.185798:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384334.185803:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000df8fae64/0x7ef423838fba2465 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba245e expref: 15 pid: 6516 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.185811:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000df8fae64/0x7ef423838fba2465 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba245e expref: 15 pid: 6516 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.185822:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384334.185849:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5fd7ce4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+15:3654:x1874208203221632:12345-0@lo:103: Request processed in 82us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384334.185855:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787384334.185866:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787384334.185871:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad96ac06 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+14:3651:x1874208203221760:12345-0@lo:103: 00010000:00010000:0.0:1787384334.185878:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384334.185882:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b655cb76/0x7ef423838fba2377 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba2370 expref: 14 pid: 6515 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.185889:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b655cb76/0x7ef423838fba2377 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba2370 expref: 14 pid: 6515 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.185898:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006718ae70/0x7ef423838fba2496 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.185903:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006718ae70/0x7ef423838fba2496 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.185914:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006718ae70/0x7ef423838fba2496 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.185931:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006718ae70/0x7ef423838fba2496 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.185936:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006718ae70/0x7ef423838fba2496 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.185941:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006718ae70/0x7ef423838fba2496 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.185945:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006718ae70 already unused, calling callback (00000000cf2a782c) 00010000:00010000:0.0:1787384334.185948:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006718ae70/0x7ef423838fba2496 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.185954:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006718ae70/0x7ef423838fba2496 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.185962:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006718ae70/0x7ef423838fba2496 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.185970:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384334.185997:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad96ac06 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+14:3651:x1874208203221760:12345-0@lo:103: Request processed in 125us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384334.186003:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787384334.186043:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a26b933e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203221760:0@lo:103: 00000100:00100000:0.0:1787384334.186066:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000133f5988 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203221632:0@lo:103: 00000100:00100000:0.0:1787384334.186079:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008420d992 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203221888:0@lo:101: 00010000:00010000:0.0:1787384334.186089:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: 00000000397e1cf3/0x7ef423838fba249d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba24a4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.186106:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: 00000000397e1cf3/0x7ef423838fba249d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba24a4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384334.186145:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008420d992 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203222016:0@lo:256: 00000100:00100000:0.0:1787384334.186174:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384334.186189:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e7bbed85 going to sleep for 11 seconds 00000100:00100000:0.0:1787384334.186203:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203222016 00000100:00100000:0.0:1787384334.186206:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203222016 00000100:00100000:0.0:1787384334.186226:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787384334.186231:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c8f7819 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+14:6519:x1874208203222016:12345-0@lo:256: 20000000:01000000:0.0:1787384334.186243:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787384334.186258:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787384334.186261:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1787384334.186328:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c8f7819 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+14:6519:x1874208203222016:12345-0@lo:256: Request processed in 97us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384334.186335:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787384334.186374:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008420d992 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203222016:0@lo:256: 10000000:01000000:0.0:1787384334.186408:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787384334.186413:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: 00000000397e1cf3/0x7ef423838fba249d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba24a4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.186419:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: 00000000397e1cf3/0x7ef423838fba249d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba24a4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384334.186426:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787384334.186427:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98f8f5698000 from 1 10000000:01000000:0.0:1787384334.186430:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787384334.186451:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: 000000008231b2c6/0x7ef423838fba24ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.186457:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: 000000008231b2c6/0x7ef423838fba24ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.186464:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: 000000008231b2c6/0x7ef423838fba24ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384334.186475:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008420d992 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203222144:0@lo:101: 00000100:00100000:0.0:1787384334.186498:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384334.186513:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e7bbed85 going to sleep for 11 seconds 00000100:00100000:0.0:1787384334.186524:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203222144 00000100:00100000:0.0:1787384334.186527:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203222144 00000100:00100000:0.0:1787384334.186546:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787384334.186551:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000453336d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+14:6519:x1874208203222144:12345-0@lo:101: 00010000:00010000:0.0:1787384334.186557:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384334.186565:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b2ee5036/0x7ef423838fba24b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba24ab expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.186578:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b2ee5036/0x7ef423838fba24b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba24ab expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.186585:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b2ee5036/0x7ef423838fba24b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba24ab expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.186592:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b2ee5036, rc 0) 00000100:00100000:0.0:1787384334.186617:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000453336d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+15:6519:x1874208203222144:12345-0@lo:101: Request processed in 65us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384334.186622:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787384334.186656:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008420d992 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203222144:0@lo:101: 00010000:00010000:0.0:1787384334.186665:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: 000000008231b2c6/0x7ef423838fba24ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba24b2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.186671:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: 000000008231b2c6/0x7ef423838fba24ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba24b2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384334.186715:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008420d992 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203222272:0@lo:501: 00000100:00100000:0.0:1787384334.186739:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384334.186750:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e7bbed85 going to sleep for 11 seconds 00000100:00100000:0.0:1787384334.186760:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203222272 00000100:00100000:0.0:1787384334.186763:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203222272 00000100:00100000:0.0:1787384334.186802:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787384334.186808:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f5ebf3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+15:6519:x1874208203222272:12345-0@lo:501: 00000100:00100000:0.0:1787384334.186906:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f5ebf3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+15:6519:x1874208203222272:12345-0@lo:501: Request processed in 99us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384334.186913:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787384334.186940:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008420d992 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203222272:0@lo:501: 00000100:00100000:0.0:1787384334.186974:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008420d992 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203222400:0@lo:503: 00000100:00100000:0.0:1787384334.186999:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384334.187008:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set 000000008c928e1e going to sleep for 11 seconds 00000100:00100000:0.0:1787384334.187015:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203222400 00000100:00100000:0.0:1787384334.187017:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203222400 00000100:00100000:0.0:1787384334.187030:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787384334.187033:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed6c8e7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+15:6519:x1874208203222400:12345-0@lo:503: 00000100:00100000:0.0:1787384334.187086:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed6c8e7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+15:6519:x1874208203222400:12345-0@lo:503: Request processed in 52us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384334.187097:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787384334.187122:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008420d992 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203222400:0@lo:503: 00010000:00010000:3.0:1787384334.188178:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000df8fae64/0x7ef423838fba2465 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba245e expref: 14 pid: 6516 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384334.192017:0:7923:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a049576e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7923:1874208203221376:0@lo:104: 00010000:00010000:3.0:1787384334.192054:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b655cb76/0x7ef423838fba2377 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba2370 expref: 13 pid: 6515 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384334.192078:0:7923:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f6f05bf8 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7923:1874208203221504:0@lo:104: 00010000:00010000:3.0:1787384334.192102:0:7923:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006718ae70/0x7ef423838fba2496 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384334.192110:0:7923:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006718ae70/0x7ef423838fba2496 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384334.192116:0:7923:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006718ae70/0x7ef423838fba2496 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384334.192121:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006718ae70/0x7ef423838fba2496 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384334.199977:0:7924:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b0460f75 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:7924:1874208203222528:0@lo:502: 00000100:00100000:1.0:1787384334.200056:0:7924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384334.200104:0:7924:0:(client.c:2702:ptlrpc_set_wait()) set 000000009bb61659 going to sleep for 11 seconds 00000100:00100000:0.0:1787384334.200277:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203222528 00000100:00100000:0.0:1787384334.200284:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203222528 00000100:00100000:0.0:1787384334.200332:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787384334.200340:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000494661b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+13:7924:x1874208203222528:12345-0@lo:502: 00000100:00100000:0.0:1787384334.200477:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000494661b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+13:7924:x1874208203222528:12345-0@lo:502: Request processed in 137us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384334.200485:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787384334.200697:0:7924:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b0460f75 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:7924:1874208203222528:0@lo:502: 00000020:01000000:2.0:1787384334.200725:0:7924:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787384334.200736:0:7924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384334.200738:0:7924:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787384334.200745:0:7924:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f8f5698000 00000020:00000080:2.0:1787384334.200747:0:7924:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787384334.200813:0:7924:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:7924:1874208203222656:0@lo:502: 00000100:00100000:2.0:1787384334.200850:0:7924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384334.200867:0:7924:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8ee0493c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384334.201406:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203222656 00000100:00100000:1.0:1787384334.201413:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203222656 00000100:00100000:1.0:1787384334.201453:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787384334.201461:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+13:7924:x1874208203222656:12345-0@lo:502: 00000100:00100000:1.0:1787384334.201574:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+13:7924:x1874208203222656:12345-0@lo:502: Request processed in 113us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384334.201581:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787384334.201712:0:7924:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:7924:1874208203222656:0@lo:502: 00000020:01000000:3.0:1787384334.201735:0:7924:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787384334.201740:0:7924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384334.201742:0:7924:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787384334.201746:0:7924:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1787384334.202061:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787384334.202085:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787384334.202095:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8c0030e00/0x7ef423838fba24ab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba24b2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384334.202106:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8c0030e00/0x7ef423838fba24ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba24b2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384334.202115:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787384334.202117:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98f8c896e000 from 21 10000000:01000000:1.0:1787384334.202120:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787384334.202150:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba24b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384334.202157:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba24b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384334.202165:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba24b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384334.202200:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203222784:0@lo:101: 00000100:00100000:1.0:1787384334.202234:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384334.202678:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d912b180 going to sleep for 11 seconds 00000100:00100000:0.0:1787384334.203440:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203222784 00000100:00100000:0.0:1787384334.203448:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203222784 00000100:00100000:0.0:1787384334.203506:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787384334.203515:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+13:6519:x1874208203222784:12345-0@lo:101: 00010000:00010000:0.0:1787384334.203529:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384334.203544:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8c0031c00/0x7ef423838fba24c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba24b9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.203568:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8c0031c00/0x7ef423838fba24c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba24b9 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.203578:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8c0031c00/0x7ef423838fba24c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba24b9 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.203588:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c0031c00, rc 0) 00000100:00100000:0.0:1787384334.203645:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+14:6519:x1874208203222784:12345-0@lo:101: Request processed in 131us (1409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384334.203652:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787384334.203740:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203222784:0@lo:101: 00010000:00010000:2.0:1787384334.203756:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba24b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba24c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384334.203765:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba24b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba24c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384334.203852:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203222912:0@lo:501: 00000100:00100000:2.0:1787384334.203880:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384334.203905:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8ee049a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787384334.204022:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203222912 00000100:00100000:1.0:1787384334.204027:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203222912 00000100:00100000:1.0:1787384334.204065:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787384334.204072:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+14:6519:x1874208203222912:12345-0@lo:501: 00000100:00100000:1.0:1787384334.204194:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+14:6519:x1874208203222912:12345-0@lo:501: Request processed in 112us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384334.204202:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787384334.204232:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203222912:0@lo:501: 00000100:00100000:1.0:1787384334.204271:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203223040:0@lo:503: 00000100:00100000:1.0:1787384334.204310:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384334.204324:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d912b180 going to sleep for 11 seconds 00000100:00100000:1.0:1787384334.204335:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203223040 00000100:00100000:1.0:1787384334.204338:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203223040 00000100:00100000:1.0:1787384334.204355:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787384334.204371:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+14:6519:x1874208203223040:12345-0@lo:503: 00000100:00100000:1.0:1787384334.204447:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+14:6519:x1874208203223040:12345-0@lo:503: Request processed in 85us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384334.204454:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787384334.204501:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203223040:0@lo:503: 00000100:00100000:1.0:1787384334.204662:0:7925:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:7925:1874208203223168:0@lo:502: 00000100:00100000:1.0:1787384334.204693:0:7925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384334.204712:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203223168 00000100:00100000:1.0:1787384334.204716:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203223168 00000100:00100000:1.0:1787384334.204734:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787384334.204739:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+14:7925:x1874208203223168:12345-0@lo:502: 00000100:00100000:1.0:1787384334.204835:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+14:7925:x1874208203223168:12345-0@lo:502: Request processed in 95us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384334.204849:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787384334.204887:0:7925:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d912ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787384334.204900:0:7925:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:7925:1874208203223168:0@lo:502: 00000100:00100000:1.0:1787384334.204936:0:7925:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:7925:1874208203223296:0@lo:502: 00000100:00100000:1.0:1787384334.204966:0:7925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384334.204983:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203223296 00000100:00100000:1.0:1787384334.204986:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203223296 00000100:00100000:1.0:1787384334.205002:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787384334.205007:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d25f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+14:7925:x1874208203223296:12345-0@lo:502: 00000100:00100000:1.0:1787384334.205061:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d25f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+14:7925:x1874208203223296:12345-0@lo:502: Request processed in 53us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384334.205067:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787384334.205093:0:7925:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d912ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787384334.205106:0:7925:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:7925:1874208203223296:0@lo:502: 00000040:00080000:1.0:1787384334.205123:0:7925:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1787384334.205170:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1787384334.205185:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787384334.205191:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba24b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba24c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384334.205198:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba24b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba24c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384334.205207:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787384334.205209:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98f8c896e000 from 4 10000000:01000000:1.0:1787384334.205212:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787384334.205231:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba24c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384334.205243:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba24c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384334.205250:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba24c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384334.205262:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203223424:0@lo:101: 00000100:00100000:1.0:1787384334.205287:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384334.205301:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d912ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787384334.205313:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203223424 00000100:00100000:1.0:1787384334.205315:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203223424 00000100:00100000:1.0:1787384334.205348:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787384334.205353:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d945a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+14:6519:x1874208203223424:12345-0@lo:101: 00010000:00010000:1.0:1787384334.205369:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384334.205378:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f902158200/0x7ef423838fba24ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba24c7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384334.205394:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f902158200/0x7ef423838fba24ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba24c7 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384334.205403:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f902158200/0x7ef423838fba24ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba24c7 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384334.205411:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f902158200, rc 0) 00000100:00100000:1.0:1787384334.205438:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d945a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+15:6519:x1874208203223424:12345-0@lo:101: Request processed in 84us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384334.205444:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787384334.205472:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203223424:0@lo:101: 00010000:00010000:1.0:1787384334.205489:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba24c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba24ce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384334.205497:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba24c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba24ce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384334.205557:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203223552:0@lo:256: 00000100:00100000:1.0:1787384334.205586:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384334.205599:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d912ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787384334.205700:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203223552 00000100:00100000:1.0:1787384334.205704:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203223552 00000100:00100000:1.0:1787384334.205723:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787384334.205729:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9458c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+15:6519:x1874208203223552:12345-0@lo:256: 20000000:01000000:1.0:1787384334.205740:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787384334.205755:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787384334.205759:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1787384334.205848:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9458c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+15:6519:x1874208203223552:12345-0@lo:256: Request processed in 118us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384334.205855:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787384334.205882:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203223552:0@lo:256: 10000000:01000000:1.0:1787384334.205917:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787384334.205922:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba24c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba24ce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384334.205929:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba24c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba24ce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384334.205935:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787384334.205941:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1787384334.205943:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787384334.205957:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba24d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384334.205964:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba24d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384334.205971:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba24d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384334.205982:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203223680:0@lo:101: 00000100:00100000:1.0:1787384334.206005:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384334.206018:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d982c480 going to sleep for 11 seconds 00000100:00100000:1.0:1787384334.206028:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203223680 00000100:00100000:1.0:1787384334.206031:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203223680 00000100:00100000:1.0:1787384334.206047:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787384334.206052:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d945bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+15:6519:x1874208203223680:12345-0@lo:101: 00010000:00010000:1.0:1787384334.206058:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384334.206065:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f902159200/0x7ef423838fba24dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba24d5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384334.206078:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f902159200/0x7ef423838fba24dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba24d5 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384334.206086:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f902159200/0x7ef423838fba24dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba24d5 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384334.206092:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f902159200, rc 0) 00000100:00100000:1.0:1787384334.206117:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d945bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+16:6519:x1874208203223680:12345-0@lo:101: Request processed in 65us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384334.206128:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787384334.206154:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203223680:0@lo:101: 00010000:00010000:1.0:1787384334.206164:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba24d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba24dc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384334.206172:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba24d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba24dc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384334.206209:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203223808:0@lo:501: 00000100:00100000:1.0:1787384334.206229:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384334.206240:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d982c480 going to sleep for 11 seconds 00000100:00100000:1.0:1787384334.206249:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203223808 00000100:00100000:1.0:1787384334.206252:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203223808 00000100:00100000:1.0:1787384334.206266:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787384334.206270:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d945ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+16:6519:x1874208203223808:12345-0@lo:501: 00000100:00100000:1.0:1787384334.206379:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d945ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+16:6519:x1874208203223808:12345-0@lo:501: Request processed in 83us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384334.206385:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787384334.206443:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203223808:0@lo:501: 00000100:00100000:1.0:1787384334.206463:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203223936:0@lo:503: 00000100:00100000:1.0:1787384334.206494:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384334.206506:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d982c480 going to sleep for 11 seconds 00000100:00100000:1.0:1787384334.206515:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203223936 00000100:00100000:1.0:1787384334.206518:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203223936 00000100:00100000:1.0:1787384334.206534:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787384334.206539:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+16:6519:x1874208203223936:12345-0@lo:503: 00000100:00100000:1.0:1787384334.206609:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+16:6519:x1874208203223936:12345-0@lo:503: Request processed in 69us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384334.206615:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787384334.206647:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203223936:0@lo:503: 00000100:00100000:2.0:1787384334.208566:0:7926:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:7926:1874208203224064:0@lo:502: 00000100:00100000:2.0:1787384334.208629:0:7926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384334.208664:0:7926:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8ee049180 going to sleep for 11 seconds 00000100:00100000:1.0:1787384334.208802:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203224064 00000100:00100000:1.0:1787384334.208808:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203224064 00000100:00100000:1.0:1787384334.208842:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787384334.208850:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+16:7926:x1874208203224064:12345-0@lo:502: 00000100:00100000:1.0:1787384334.208950:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+16:7926:x1874208203224064:12345-0@lo:502: Request processed in 98us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384334.208957:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787384334.209042:0:7926:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:7926:1874208203224064:0@lo:502: 00000020:01000000:2.0:1787384334.209065:0:7926:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787384334.209074:0:7926:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384334.209076:0:7926:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1787384334.209080:0:7926:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787384334.209085:0:7926:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.145@tcp to nid 0x20000c0a8cb91 (192.168.203.145@tcp) 00000020:00000080:2.0:1787384334.209105:0:7926:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787384334.209117:0:7926:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff98f8f968cd40) 00000020:00000080:2.0:1787384334.209134:0:7926:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:2.0:1787384334.209138:0:7926:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787384334.209326:0:7926:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1787384334.209331:0:7926:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787384334.209338:0:7926:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7ef423838fba24ea 00010000:00080000:2.0:1787384334.209373:0:7926:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f8ee091800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.145@tcp at head 00010000:00010000:2.0:1787384334.214591:0:7926:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1787384334.227464:0:7926:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787384334.227479:0:7926:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787384334.227587:0:7926:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787384334.227610:0:7926:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7ef423838fba24f1 00000100:00080000:1.0:1787384334.227622:0:7926:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787384334.227628:0:7926:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98f8ee091800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:1.0:1787384334.227662:0:7926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8fc1b6300 x1874208203224192/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787384334.227691:0:7926:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:1.0:1787384334.227770:0:7926:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1787384334.227959:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203224192:0@lo:38: 00000100:00100000:2.0:1787384334.228036:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384334.228130:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203224192 00000100:00100000:1.0:1787384334.228137:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203224192 00000100:00100000:1.0:1787384334.228174:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787384334.228181:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3650:x1874208203224192:12345-0@lo:38: 00010000:00080000:1.0:1787384334.228215:0:6527:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:1.0:1787384334.228427:0:6527:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7ef423838fba24f8 00000004:00100000:1.0:1787384334.228441:0:6527:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1787384334.228447:0:6527:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1787384334.228681:0:7931:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff98f8f54fa300 x1874208203224320/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384334.228691:0:7931:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8ee0493c0 going to sleep for 0 seconds 00000020:01000000:1.0:1787384334.231351:0:7926:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384334.231373:0:7926:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384334.231376:0:7926:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1787384334.231381:0:7926:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787384334.231385:0:7926:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384334.231386:0:7926:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787384334.231389:0:7926:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787384334.231390:0:7926:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787384334.231429:0:7926:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:7926:1874208203224448:0@lo:502: 00000100:00100000:1.0:1787384334.231834:0:7926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384334.231882:0:7926:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d912b780 going to sleep for 11 seconds 00000100:00100000:3.0:1787384334.231953:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203224448 00000100:00100000:3.0:1787384334.231960:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203224448 00000100:00100000:3.0:1787384334.232009:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787384334.232018:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+16:7926:x1874208203224448:12345-0@lo:502: 00000100:00100000:3.0:1787384334.232136:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+16:7926:x1874208203224448:12345-0@lo:502: Request processed in 118us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384334.232144:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787384334.232350:0:7926:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:7926:1874208203224448:0@lo:502: 00000020:01000000:1.0:1787384334.232387:0:7926:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384334.232392:0:7926:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384334.232394:0:7926:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787384334.232398:0:7926:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1787384334.233352:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1787384334.233390:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787384334.233400:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba24d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba24dc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384334.233419:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba24d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba24dc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384334.233431:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787384334.233433:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98f8c896e000 from 1 10000000:01000000:3.0:1787384334.233435:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787384334.233464:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8cad38800/0x7ef423838fba24ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384334.233473:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8cad38800/0x7ef423838fba24ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384334.233483:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8cad38800/0x7ef423838fba24ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384334.233510:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203224576:0@lo:101: 00000100:00100000:3.0:1787384334.233556:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384334.233592:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7ce4540 going to sleep for 11 seconds 00000100:00100000:1.0:1787384334.233704:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203224576 00000100:00100000:1.0:1787384334.233710:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203224576 00000100:00100000:1.0:1787384334.233754:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787384334.233764:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+16:6519:x1874208203224576:12345-0@lo:101: 00010000:00010000:1.0:1787384334.233774:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384334.233805:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f902159e00/0x7ef423838fba2506 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba24ff expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384334.233826:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f902159e00/0x7ef423838fba2506 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba24ff expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384334.233847:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f902159e00/0x7ef423838fba2506 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba24ff expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384334.233854:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f902159e00, rc 0) 00000100:00100000:1.0:1787384334.233892:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+17:6519:x1874208203224576:12345-0@lo:101: Request processed in 128us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384334.233898:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787384334.233936:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203224576:0@lo:101: 00010000:00010000:1.0:1787384334.233949:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8cad38800/0x7ef423838fba24ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2506 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384334.233957:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8cad38800/0x7ef423838fba24ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2506 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384334.234009:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203224704:0@lo:501: 00000100:00100000:1.0:1787384334.234032:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384334.234047:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d912ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787384334.234059:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203224704 00000100:00100000:1.0:1787384334.234062:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203224704 00000100:00100000:1.0:1787384334.234083:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787384334.234089:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+17:6519:x1874208203224704:12345-0@lo:501: 00000100:00100000:1.0:1787384334.234404:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+17:6519:x1874208203224704:12345-0@lo:501: Request processed in 99us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384334.234412:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787384334.234448:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203224704:0@lo:501: 00000100:00100000:1.0:1787384334.234476:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203224832:0@lo:503: 00000100:00100000:1.0:1787384334.235590:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384334.235636:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d931d000 going to sleep for 11 seconds 00000100:00100000:1.0:1787384334.235659:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203224832 00000100:00100000:1.0:1787384334.235664:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203224832 00000100:00100000:1.0:1787384334.235706:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787384334.235713:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874208203224960:0@lo:400: 00000100:00100000:1.0:1787384334.235718:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+17:6519:x1874208203224832:12345-0@lo:503: 00000100:00100000:0.0:1787384334.235762:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384334.235819:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9148a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203225088:0@lo:400: 00000100:00100000:1.0:1787384334.235859:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+17:6519:x1874208203224832:12345-0@lo:503: Request processed in 142us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384334.235859:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384334.235870:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787384334.235886:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787384334.235894:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874208203225216:0@lo:400: 00000100:00100000:0.0:1787384334.235928:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384334.235937:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203224832:0@lo:503: 00000100:00100000:0.0:1787384334.235962:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203224960 00000100:00100000:0.0:1787384334.235967:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203224960 00000100:00100000:0.0:1787384334.236002:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203225216 00000100:00100000:0.0:1787384334.236005:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203225216 00000100:00100000:0.0:1787384334.236025:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787384334.236032:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9148380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874208203224960:12345-0@lo:400: 00000100:00100000:0.0:1787384334.236092:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9148380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874208203224960:12345-0@lo:400: Request processed in 60us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384334.236098:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787384334.236114:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787384334.236121:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874208203225216:12345-0@lo:400: 00000100:00100000:1.0:1787384334.236144:0:7932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:7932:1874208203225344:0@lo:502: 00000100:00100000:0.0:1787384334.236162:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874208203225216:12345-0@lo:400: Request processed in 42us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384334.236169:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787384334.236185:0:7932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384334.236189:0:6526:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1787384334.236198:0:6526:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1787384334.236210:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203225344 00000100:00100000:1.0:1787384334.236215:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203225344 00010000:00080000:0.0:1787384334.236235:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f8f9149c00 x1874208203224960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384334.236243:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787384334.236254:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874208203224960:0@lo:400: 00000100:00100000:1.0:1787384334.236256:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+17:7932:x1874208203225344:12345-0@lo:502: 00010000:00080000:0.0:1787384334.236285:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f8f9148e00 x1874208203225216/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384334.236305:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874208203225216:0@lo:400: 00000100:00100000:1.0:1787384334.236334:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+17:7932:x1874208203225344:12345-0@lo:502: Request processed in 80us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384334.236341:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787384334.236454:0:7932:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d931dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787384334.236469:0:7932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:7932:1874208203225344:0@lo:502: 00000020:01000000:1.0:1787384334.236488:0:7932:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787384334.236498:0:7932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384334.236501:0:7932:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787384334.236507:0:7932:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f8c896e000 00000020:00000080:1.0:1787384334.236509:0:7932:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787384334.236529:0:7932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:7932:1874208203225472:0@lo:502: 00000100:00100000:1.0:1787384334.236565:0:7932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384334.236594:0:7932:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c2fd3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787384334.236805:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203225472 00000100:00100000:0.0:1787384334.236811:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203225472 00000100:00100000:0.0:1787384334.236838:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787384334.236844:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+17:7932:x1874208203225472:12345-0@lo:502: 00000100:00100000:0.0:1787384334.236911:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+17:7932:x1874208203225472:12345-0@lo:502: Request processed in 66us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384334.236917:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787384334.238446:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203225088 00000100:00100000:0.0:1787384334.238457:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203225088 00000100:00100000:0.0:1787384334.238573:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787384334.238582:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203225088:12345-0@lo:400: 00000100:00100000:0.0:1787384334.238649:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203225088:12345-0@lo:400: Request processed in 68us (2790us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384334.238656:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787384334.238694:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9148a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203225088:0@lo:400: 00000100:00100000:1.0:1787384334.238850:0:7932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:7932:1874208203225472:0@lo:502: 00000020:01000000:1.0:1787384334.238884:0:7932:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384334.238894:0:7932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384334.238896:0:7932:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787384334.238901:0:7932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1787384334.241357:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787384334.241397:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787384334.241408:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8cad38800/0x7ef423838fba24ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2506 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.241419:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8cad38800/0x7ef423838fba24ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2506 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384334.241429:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787384334.241431:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff98f8f96899c0 from 1 10000000:01000000:0.0:1787384334.241440:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787384334.241474:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8c0031a00/0x7ef423838fba250d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.241482:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8c0031a00/0x7ef423838fba250d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.241505:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8c0031a00/0x7ef423838fba250d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384334.241525:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9148a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203225600:0@lo:101: 00000100:00100000:0.0:1787384334.241588:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384334.241615:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d817d600 going to sleep for 11 seconds 00000100:00080000:1.0:1787384334.242120:0:6527:0:(import.c:65:import_set_state_nolock()) ffff98f8ee0ca800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787384334.242970:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787384334.242979:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787384334.242988:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787384334.242994:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787384334.242998:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8ee091800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1787384334.243020:0:3650:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000025958376): req@ffff98f8f54fa300 x1874208203224320/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384334.243048:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203224192:0@lo:38: 00000100:00100000:2.0:1787384334.243116:0:7931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384334.243140:0:7931:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8ee0493c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384334.243160:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203224320 00000100:00100000:2.0:1787384334.243165:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203224320 00000100:00100000:1.0:1787384334.243332:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3650:x1874208203224192:12345-0@lo:38: Request processed in 14002us (14148us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384334.243341:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787384334.243380:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203225600 00000100:00100000:1.0:1787384334.243384:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203225600 00000100:00100000:1.0:1787384334.243411:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787384334.243418:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+17:6519:x1874208203225600:12345-0@lo:101: 00010000:00010000:1.0:1787384334.243428:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384334.243443:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f902158e00/0x7ef423838fba2514 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba250d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384334.243465:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f902158e00/0x7ef423838fba2514 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba250d expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384334.243476:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f902158e00/0x7ef423838fba2514 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba250d expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384334.244352:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787384334.244373:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7931:x1874208203224320:12345-0@lo:1000: 00000100:00100000:2.0:1787384334.244458:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7931:x1874208203224320:12345-0@lo:1000: Request processed in 98us (1341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384334.244464:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1787384334.244571:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f902158e00, rc 0) 00000100:00100000:2.0:1787384334.244614:0:7931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fa300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7931:1874208203224320:0@lo:1000: 00000040:01000000:2.0:1787384334.244648:0:7931:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1787384334.244684:0:7931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fa300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7931:1874208203225728:0@lo:1000: 00000100:00100000:1.0:1787384334.245792:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+18:6519:x1874208203225600:12345-0@lo:101: Request processed in 2356us (4186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384334.245801:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787384334.246096:0:7931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384334.246132:0:7931:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8293e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787384334.246389:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203225728 00000100:00100000:1.0:1787384334.246395:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203225728 00000100:00100000:1.0:1787384334.246437:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787384334.246445:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7931:x1874208203225728:12345-0@lo:1000: 00000100:00100000:1.0:1787384334.246669:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7931:x1874208203225728:12345-0@lo:1000: Request processed in 223us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384334.246676:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787384334.246736:0:7931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fa300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7931:1874208203225728:0@lo:1000: 00000100:00100000:2.0:1787384334.246815:0:7931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fa300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7931:1874208203225984:0@lo:700: 00000100:00100000:2.0:1787384334.246842:0:7931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384334.246859:0:7931:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8293540 going to sleep for 11 seconds 00000100:00100000:2.0:1787384334.246873:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203225984 00000100:00100000:2.0:1787384334.246877:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203225984 00000100:00100000:2.0:1787384334.246904:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787384334.246910:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7931:x1874208203225984:12345-0@lo:700: 00000100:00100000:2.0:1787384334.246947:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7931:x1874208203225984:12345-0@lo:700: Request processed in 38us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384334.246963:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787384334.246989:0:7931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fa300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7931:1874208203225984:0@lo:700: 00000100:00100000:2.0:1787384334.247073:0:7931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fa300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7931:1874208203226112:0@lo:1000: 00000100:00100000:2.0:1787384334.247097:0:7931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384334.247112:0:7931:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d82930c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384334.247175:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203226112 00000100:00100000:2.0:1787384334.247179:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203226112 00000100:00100000:2.0:1787384334.247218:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787384334.247225:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7931:x1874208203226112:12345-0@lo:1000: 00000100:00100000:2.0:1787384334.247292:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7931:x1874208203226112:12345-0@lo:1000: Request processed in 67us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384334.247298:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787384334.247323:0:7931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fa300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7931:1874208203226112:0@lo:1000: 00000004:00080000:2.0:1787384334.247373:0:7931:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff98f8d8293540 with version 0 00000020:00100000:2.0:1787384334.247387:0:7931:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787384334.247393:0:7931:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff98f8f54fa300 x1874208203226368/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787384334.247405:0:7931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fa300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7931:1874208203226368:0@lo:1000: 00000100:00100000:2.0:1787384334.247426:0:7931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384334.247439:0:7931:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d82936c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384334.247449:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203226368 00000100:00100000:2.0:1787384334.247452:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203226368 00000100:00100000:2.0:1787384334.247476:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787384334.247482:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7931:x1874208203226368:12345-0@lo:1000: 00000100:00100000:1.0:1787384334.249478:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787384334.249512:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203225856:0@lo:41: 00000100:00100000:1.0:1787384334.249575:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384334.249737:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203225856 00000100:00100000:2.0:1787384334.249752:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203225856 00000100:00100000:2.0:1787384334.249829:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787384334.249839:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:3652:x1874208203225856:12345-0@lo:41: 00000004:00000024:2.0:1787384334.249866:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1787384334.249925:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:3652:x1874208203225856:12345-0@lo:41: Request processed in 88us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384334.249932:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787384334.250030:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203225856:0@lo:41: 00000100:00100000:0.0:1787384334.250166:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9148a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203225600:0@lo:101: 00010000:00010000:0.0:1787384334.250309:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8c0031a00/0x7ef423838fba250d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2514 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.250324:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8c0031a00/0x7ef423838fba250d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2514 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384334.250403:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9148a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203226496:0@lo:501: 00000100:00100000:0.0:1787384334.250434:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384334.250511:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d817d600 going to sleep for 11 seconds 00000100:00100000:1.0:1787384334.254451:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203226496 00000100:00100000:1.0:1787384334.254464:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203226496 00000100:00100000:1.0:1787384334.254533:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787384334.254543:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+18:6519:x1874208203226496:12345-0@lo:501: 00000100:00100000:1.0:1787384334.254669:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+18:6519:x1874208203226496:12345-0@lo:501: Request processed in 127us (4232us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787384334.254677:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787384334.254841:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9148a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203226496:0@lo:501: 10000000:01000000:0.0:1787384334.254889:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787384334.254899:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8c0031a00/0x7ef423838fba250d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2514 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.254910:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8c0031a00/0x7ef423838fba250d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2514 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384334.264001:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787384334.270946:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:1.0:1787384334.270959:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787384334.272406:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7931:x1874208203226368:12345-0@lo:1000: Request processed in 24915us (24969us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787384334.272419:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:3.0:1787384334.272908:0:7931:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1787384334.272914:0:7931:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787384334.272930:0:7931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fa300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7931:1874208203226368:0@lo:1000: 00000100:00100000:3.0:1787384334.273032:0:7931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91dbb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7931:1874208203226624:0@lo:1000: 00000100:00100000:3.0:1787384334.273071:0:7931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384334.273107:0:7931:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7ce4780 going to sleep for 11 seconds 00000100:00100000:2.0:1787384334.273152:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203226624 00000100:00100000:2.0:1787384334.273159:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203226624 00000100:00100000:1.0:1787384334.273623:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787384334.273635:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7931:x1874208203226624:12345-0@lo:1000: 00000100:00100000:1.0:1787384334.273720:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7931:x1874208203226624:12345-0@lo:1000: Request processed in 87us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384334.273727:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787384334.273997:0:7931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91dbb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7931:1874208203226624:0@lo:1000: 00000040:00080000:3.0:1787384334.274032:0:7931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1787384334.274075:0:7931:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff98f8c7ce4900 with version 1 00000040:00080000:3.0:1787384334.279164:0:7931:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787384334.279599:0:7931:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787384334.279604:0:7931:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00080000:1.0:1787384334.280418:0:7928:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff98f8ee049180 version 1 rpc_version 1 00000020:00100000:2.0:1787384334.285318:0:7928:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787384334.285334:0:7928:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff98f8f54f8700 x1874208203226880/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787384334.285357:0:7928:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f8700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7928:1874208203226880:0@lo:1000: 00000100:00100000:2.0:1787384334.285435:0:7928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384334.285472:0:7928:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8293000 going to sleep for 11 seconds 00000100:00100000:1.0:1787384334.285649:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203226880 00000100:00100000:1.0:1787384334.285657:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203226880 00000100:00100000:1.0:1787384334.285711:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787384334.285727:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7928:x1874208203226880:12345-0@lo:1000: 00000001:00080000:1.0:1787384334.287513:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:1.0:1787384334.287609:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7928:x1874208203226880:12345-0@lo:1000: Request processed in 1880us (2171us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787384334.287619:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:2.0:1787384334.288377:0:7928:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1787384334.288383:0:7928:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787384334.288399:0:7928:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f8700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7928:1874208203226880:0@lo:1000: 00000100:00100000:3.0:1787384334.777562:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9148a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203227008:0@lo:41: 00000100:00100000:3.0:1787384334.777662:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384334.777890:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203227008 00000100:00100000:0.0:1787384334.777901:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203227008 00000100:00100000:0.0:1787384334.777974:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787384334.777986:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203227008:12345-0@lo:41: 00000004:00000024:0.0:1787384334.778029:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1787384334.778081:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203227008:12345-0@lo:41: Request processed in 97us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384334.778089:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787384334.778170:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9148a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203227008:0@lo:41: 00010000:00010000:2.0:1787384335.290927:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384336.313030:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384337.346718:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384338.360100:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384339.383093:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1787384339.383338:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384339.384123:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203227264:0@lo:400: 00000100:00100000:1.0:1787384339.384199:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384339.384586:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203227264 00000100:00100000:0.0:1787384339.384594:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203227264 00000100:00100000:0.0:1787384339.384636:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787384339.384644:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+18:3654:x1874208203227264:12345-0@lo:400: 00000100:00100000:0.0:1787384339.384690:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+18:3654:x1874208203227264:12345-0@lo:400: Request processed in 47us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384339.384696:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787384339.385427:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203227264:0@lo:400: 00000100:00100000:1.0:1787384339.385441:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203227136:0@lo:41: 00000100:00100000:1.0:1787384339.385490:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384339.385805:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203227136 00000100:00100000:0.0:1787384339.385812:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203227136 00000100:00100000:0.0:1787384339.385847:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787384339.385855:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203227136:12345-0@lo:41: 00000004:00000024:0.0:1787384339.385887:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1787384339.385930:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203227136:12345-0@lo:41: Request processed in 75us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384339.385936:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787384339.386321:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203227392:0@lo:400: 00000100:00100000:0.0:1787384339.386374:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384339.386833:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203227136:0@lo:41: 00000100:00100000:1.0:1787384339.386873:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203227392 00000100:00100000:1.0:1787384339.386878:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203227392 00000100:00100000:1.0:1787384339.386912:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787384339.386919:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203227392:12345-0@lo:400: 00000100:00100000:2.0:1787384339.386991:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203227520:0@lo:400: 00000100:00100000:2.0:1787384339.387034:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384339.389746:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203227520 00000100:00100000:3.0:1787384339.389758:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203227520 00000100:00100000:3.0:1787384339.389821:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787384339.389831:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203227520:12345-0@lo:400: 00000100:00100000:3.0:1787384339.389912:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203227520:12345-0@lo:400: Request processed in 82us (2877us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384339.389919:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787384339.389965:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203227520:0@lo:400: 00000100:00100000:2.0:1787384339.391754:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874208203227648:0@lo:400: 00000100:00100000:2.0:1787384339.391855:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384339.392042:0:6521:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787384339.392052:0:6521:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1787384339.392484:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203227648 00000100:00100000:2.0:1787384339.392504:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203227648 00000100:00100000:2.0:1787384339.392540:0:6521:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787384339.392549:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787384339.392556:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874208203227648:12345-0@lo:400: 00000100:00100000:2.0:1787384339.392610:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874208203227648:12345-0@lo:400: Request processed in 54us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384339.392617:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1787384339.392926:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f8f91d8380 x1874208203227648/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384339.392939:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874208203227648:0@lo:400: 00000100:00100000:1.0:1787384339.393067:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203227392:12345-0@lo:400: Request processed in 6146us (6691us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384339.393074:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787384339.393175:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f8f91d8700 x1874208203227392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384339.393185:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203227392:0@lo:400: 00000100:00100000:2.0:1787384339.895432:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787384339.895455:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203227776:0@lo:41: 00000100:00100000:2.0:1787384339.895521:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384339.898029:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203227776 00000100:00100000:1.0:1787384339.898042:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203227776 00000100:00100000:1.0:1787384339.898093:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787384339.898104:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203227776:12345-0@lo:41: 00000004:00000024:1.0:1787384339.898137:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1787384339.898231:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203227776:12345-0@lo:41: Request processed in 129us (2709us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384339.898245:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787384339.898299:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203227776:0@lo:41: 00010000:00010000:0.0:1787384340.407161:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384341.430924:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384342.456946:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384343.480885:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787384343.773920:0:8430:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787384343.773924:0:8430:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1787384343.773925:0:8430:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787384343.774056:0:8430:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff98f8f5669000 00000020:01000004:1.0:1787384343.774071:0:8430:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787384343.774083:0:8430:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787384343.774095:0:8430:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff98f8f18119c0) 00000020:00000080:1.0:1787384343.774111:0:8430:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787384343.835016:0:8430:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787384343.835057:0:8430:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:1.0:1787384343.853161:0:8430:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787384343.853374:0:8430:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1787384343.853385:0:8430:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787384343.853398:0:8430:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7ef423838fba2522 00000020:01000004:1.0:1787384343.853404:0:8430:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1787384343.853427:0:8430:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.145@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787384343.853430:0:8430:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.145@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787384343.853437:0:8430:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1787384343.853441:0:8430:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1787384343.853452:0:8430:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff98f8f1813380) 00000020:00000080:1.0:1787384343.853463:0:8430:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:1.0:1787384343.855229:0:8430:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787384343.855415:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1787384343.855422:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787384343.857851:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787384343.857864:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787384343.860454:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787384343.860650:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787384343.878977:0:8430:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787384343.879165:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787384343.879172:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787384343.881071:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787384343.881081:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787384343.949424:0:8430:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787384343.950818:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787384343.950828:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787384343.959184:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787384343.959496:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787384343.960862:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787384343.960872:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787384343.969800:0:8430:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787384343.969964:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787384343.969970:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787384343.972342:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787384343.972354:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1787384344.056090:0:8430:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787384344.056461:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787384344.056468:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787384344.059676:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787384344.059695:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787384344.061485:0:8430:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787384344.061514:0:8430:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1787384344.061520:0:8430:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.145@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787384344.083537:0:8430:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.145@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787384344.083582:0:8430:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.145@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1787384344.083586:0:8430:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787384344.083588:0:8430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787384344.083589:0:8430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787384344.083590:0:8430:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787384344.083591:0:8430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787384344.083593:0:8430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787384344.083594:0:8430:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787384344.083595:0:8430:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787384344.083597:0:8430:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787384344.083598:0:8430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787384344.083599:0:8430:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787384344.083607:0:8430:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1787384344.083610:0:8430:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787384344.083611:0:8430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787384344.083612:0:8430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787384344.083612:0:8430:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787384344.083613:0:8430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787384344.083614:0:8430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787384344.083615:0:8430:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787384344.083616:0:8430:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787384344.083617:0:8430:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787384344.083617:0:8430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787384344.083618:0:8430:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787384344.083645:0:8430:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787384344.083662:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:8430:1874208203227904:0@lo:253: 00000100:00100000:2.0:1787384344.083731:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384344.083834:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7240780 going to sleep for 11 seconds 00000100:00100000:0.0:1787384344.084879:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203227904 00000100:00100000:0.0:1787384344.084889:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203227904 00000100:00100000:0.0:1787384344.084952:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787384344.084962:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+18:8430:x1874208203227904:12345-0@lo:253: 20000000:01000000:0.0:1787384344.084993:0:6516:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787384344.084997:0:6516:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1787384344.085002:0:6516:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1787384344.085016:0:6516:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1787384344.085247:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787384344.086513:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1787384344.086548:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1787384344.086655:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1787384344.086664:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1787384344.086680:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1787384344.086696:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1787384344.086819:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1787384344.086850:0:6516:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.145@tcp 20000000:01000000:0.0:1787384344.086852:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.145@tcp (null) (null) (null) 00000040:00080000:0.0:1787384344.086868:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1787384344.086874:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787384344.086907:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1787384344.086914:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.145@tcp (null) (null) 00000040:00080000:0.0:1787384344.086927:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1787384344.086933:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787384344.086946:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1787384344.086961:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1787384344.087029:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:0.0:1787384344.087040:0:6516:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.145@tcp 20000000:01000000:0.0:1787384344.087042:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.145@tcp (null) (null) (null) 00000040:00080000:0.0:1787384344.087056:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:0.0:1787384344.087061:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787384344.087073:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:0.0:1787384344.087078:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.145@tcp (null) (null) 00000040:00080000:0.0:1787384344.087091:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:0.0:1787384344.087096:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787384344.087110:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:0.0:1787384344.087125:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:0.0:1787384344.089937:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:0.0:1787384344.089966:0:6516:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.145@tcp 20000000:01000000:0.0:1787384344.089969:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.145@tcp (null) (null) (null) 00000040:00080000:0.0:1787384344.089987:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:0.0:1787384344.089994:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787384344.090008:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:0.0:1787384344.090012:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.145@tcp (null) (null) 00000040:00080000:0.0:1787384344.090024:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:0.0:1787384344.090031:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787384344.090060:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:0.0:1787384344.090078:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:0.0:1787384344.090093:0:6516:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787384344.090096:0:6516:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787384344.090099:0:6516:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787384344.090142:0:6516:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787384344.090476:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787384344.092264:0:8449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1787384344.092323:0:8449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1787384344.092354:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1787384344.100394:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1787384344.100425:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1787384344.100522:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1787384344.100535:0:6516:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787384344.100538:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787384344.101253:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1787384344.101445:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1787384344.101532:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1787384344.101546:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1787384344.101554:0:6516:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787384344.101556:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787384344.102216:0:8451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:0.0:1787384344.102238:0:8451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:0.0:1787384344.102252:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1787384344.102399:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:1.0:1787384344.102416:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:1.0:1787384344.102428:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:1.0:1787384344.102438:0:6516:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1787384344.102440:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787384344.104101:0:8452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:3.0:1787384344.104147:0:8452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:3.0:1787384344.104165:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:1.0:1787384344.106609:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:1.0:1787384344.106644:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:1.0:1787384344.106660:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 10000000:01000000:1.0:1787384344.106677:0:6516:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787384344.106697:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98f902159400/0x7ef423838fba2530 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384344.106715:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f8cad39200/0x7ef423838fba23fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba23f5 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384344.106722:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f902158400/0x7ef423838fba2473 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba246c expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384344.106729:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f8c0031c00/0x7ef423838fba24c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba24b9 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384344.106735:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f902159200/0x7ef423838fba24dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba24d5 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384344.106742:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f902158e00/0x7ef423838fba2514 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba250d expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384344.106750:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98f902159400/0x7ef423838fba2530 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384344.106819:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f902158e00/0x7ef423838fba2514 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba250d expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384344.106835:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f902158e00/0x7ef423838fba2514 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba250d expref: 18 pid: 6516 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384344.106849:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874208203228032:0@lo:104: 00000100:00100000:1.0:1787384344.106910:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787384344.107026:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f902159200/0x7ef423838fba24dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba24d5 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384344.107035:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f902159200/0x7ef423838fba24dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba24d5 expref: 18 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384344.107043:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874208203228160:0@lo:104: 00000100:00100000:1.0:1787384344.107067:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787384344.108467:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f8c0031c00/0x7ef423838fba24c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba24b9 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384344.108478:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f8c0031c00/0x7ef423838fba24c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba24b9 expref: 18 pid: 6515 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384344.108489:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b7b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874208203228288:0@lo:104: 00000100:00100000:1.0:1787384344.108524:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384344.108891:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203228032 00000100:00100000:2.0:1787384344.108899:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203228032 00000100:00100000:2.0:1787384344.108938:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203228160 00000100:00100000:2.0:1787384344.108942:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203228160 00000100:00100000:2.0:1787384344.108955:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787384344.108963:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+4:6516:x1874208203228032:12345-0@lo:104: 00010000:00010000:2.0:1787384344.108976:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f8c0031a00/0x7ef423838fba250d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2514 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.109037:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787384344.109044:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+4:6516:x1874208203228032:12345-0@lo:104: Request processed in 81us (2134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384344.109050:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787384344.109068:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787384344.109074:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+3:6516:x1874208203228160:12345-0@lo:104: 00010000:00010000:2.0:1787384344.109081:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba24d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba24dc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.109133:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787384344.109138:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+3:6516:x1874208203228160:12345-0@lo:104: Request processed in 65us (2071us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384344.109156:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1787384344.109176:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787384344.109182:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8c0031a00/0x7ef423838fba250d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2514 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.109189:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c0031a00 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384344.109193:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8c0031a00/0x7ef423838fba250d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba2514 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.109201:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8c0031a00/0x7ef423838fba250d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba2514 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384344.109208:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8c0031a00/0x7ef423838fba250d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba2514 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384344.109212:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787384344.109241:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8c0031a00/0x7ef423838fba250d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2514 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.109247:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787384344.109265:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8c0031a00/0x7ef423838fba250d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2514 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.109272:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8c0031a00/0x7ef423838fba250d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2514 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.109304:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384344.109308:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba24d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba24dc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.109314:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f902158600 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384344.109317:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba24d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba24dc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.109323:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba24d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba24dc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384344.109330:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba24d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba24dc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384344.109335:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787384344.109361:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba24d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba24dc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.109366:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787384344.109372:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba24d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba24dc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.109378:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba24d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba24dc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.109387:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384344.109388:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384344.109390:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384344.109511:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384344.109644:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203228416:0@lo:103: 00000100:00100000:2.0:1787384344.109680:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384344.109721:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787384344.109728:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c20d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203228544:0@lo:103: 00000100:00100000:2.0:1787384344.109749:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384344.109818:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203228416 00000100:00100000:2.0:1787384344.109822:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203228416 00010000:00010000:2.0:1787384344.109840:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f902158e00/0x7ef423838fba2514 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba250d expref: 19 pid: 6516 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384344.109861:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203228544 00000100:00100000:2.0:1787384344.109863:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203228544 00010000:00010000:2.0:1787384344.109872:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f902159200/0x7ef423838fba24dc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba24d5 expref: 20 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384344.109885:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787384344.109891:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca80b7f5-0e34-441a-981f-ebff717028c4+20:3651:x1874208203228416:12345-0@lo:103: 00010000:00010000:2.0:1787384344.109901:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384344.109906:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f902158e00/0x7ef423838fba2514 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba250d expref: 20 pid: 6516 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.109916:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f902158e00/0x7ef423838fba2514 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba250d expref: 20 pid: 6516 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.109932:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384344.109959:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca80b7f5-0e34-441a-981f-ebff717028c4+20:3651:x1874208203228416:12345-0@lo:103: Request processed in 68us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384344.109966:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787384344.109978:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787384344.109984:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca80b7f5-0e34-441a-981f-ebff717028c4+19:3651:x1874208203228544:12345-0@lo:103: 00010000:00010000:2.0:1787384344.110478:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384344.110485:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f902159200/0x7ef423838fba24dc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba24d5 expref: 19 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.110494:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f902159200/0x7ef423838fba24dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba24d5 expref: 19 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.110504:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384344.110529:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca80b7f5-0e34-441a-981f-ebff717028c4+19:3651:x1874208203228544:12345-0@lo:103: Request processed in 545us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384344.110534:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787384344.110591:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c20d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203228544:0@lo:103: 00000100:00100000:2.0:1787384344.110599:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203228416:0@lo:103: 00000100:00100000:2.0:1787384344.111155:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203228288 00000100:00100000:2.0:1787384344.111162:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203228288 00010000:00010000:1.0:1787384344.111177:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f902158400/0x7ef423838fba2473 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba246c expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384344.111189:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f902158400/0x7ef423838fba2473 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba246c expref: 18 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384344.111193:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787384344.111203:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+3:6516:x1874208203228288:12345-0@lo:104: 00010000:00010000:2.0:1787384344.111218:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba24b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba24c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384344.111224:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b5880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874208203228672:0@lo:104: 00000100:00100000:1.0:1787384344.111268:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787384344.111281:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787384344.111289:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+3:6516:x1874208203228288:12345-0@lo:104: Request processed in 86us (2764us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384344.111313:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787384344.111325:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203228672 00000100:00100000:2.0:1787384344.111327:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203228672 00000100:00100000:2.0:1787384344.111342:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787384344.111348:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+3:6516:x1874208203228672:12345-0@lo:104: 00010000:00010000:2.0:1787384344.111361:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc200/0x7ef423838fba246c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2473 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384344.111374:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384344.111381:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba24b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba24c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384344.111389:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f902158c00 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:3.0:1787384344.111393:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba24b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba24c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.111396:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787384344.111403:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+3:6516:x1874208203228672:12345-0@lo:104: Request processed in 55us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384344.111408:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1787384344.111427:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384344.114140:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f8cad39200/0x7ef423838fba23fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba23f5 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384344.114326:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f8cad39200/0x7ef423838fba23fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba23f5 expref: 18 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384344.114342:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b5500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874208203228800:0@lo:104: 00000100:00100000:1.0:1787384344.114519:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384344.114612:0:6516:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d0c4c900 going to sleep for 11 seconds 00010000:00010000:1.0:1787384344.114637:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f902158e00/0x7ef423838fba2514 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba250d expref: 18 pid: 6516 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384344.114650:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874208203228032:0@lo:104: 00010000:00010000:1.0:1787384344.114661:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f902159200/0x7ef423838fba24dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba24d5 expref: 17 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384344.114669:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874208203228160:0@lo:104: 00000100:00100000:1.0:1787384344.114679:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b7b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874208203228288:0@lo:104: 00000100:00100000:1.0:1787384344.114686:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b5880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874208203228672:0@lo:104: 00000100:00100000:2.0:1787384344.114727:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203228800 00000100:00100000:2.0:1787384344.114734:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203228800 00000100:00100000:2.0:1787384344.114846:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787384344.114856:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+3:6516:x1874208203228800:12345-0@lo:104: 00010000:00010000:2.0:1787384344.114870:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc400/0x7ef423838fba23f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba23fc expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.114914:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787384344.114920:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+3:6516:x1874208203228800:12345-0@lo:104: Request processed in 67us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384344.114926:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1787384344.114937:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba24b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba24c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787384344.114948:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba24b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba24c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384344.114954:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787384344.114990:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b5500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874208203228800:0@lo:104: 00010000:00010000:3.0:1787384344.115002:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba24b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba24c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384344.115009:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787384344.115025:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98f902159400/0x7ef423838fba2530 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384344.115027:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba24b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba24c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384344.115033:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba24b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba24c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384344.115046:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203228928:0@lo:103: 00010000:00010000:3.0:1787384344.115057:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384344.115061:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc400/0x7ef423838fba23f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba23fc expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384344.115067:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cc400 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:3.0:1787384344.115070:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc400/0x7ef423838fba23f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba23fc expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384344.115075:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787384344.115078:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc400/0x7ef423838fba23f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba23fc expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787384344.115084:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc400/0x7ef423838fba23f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba23fc expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384344.115089:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787384344.115103:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc400/0x7ef423838fba23f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba23fc expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384344.115108:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787384344.115111:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203228928 00000100:00100000:1.0:1787384344.115115:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203228928 00010000:00010000:3.0:1787384344.115116:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc400/0x7ef423838fba23f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba23fc expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384344.115122:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc400/0x7ef423838fba23f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba23fc expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384344.115128:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f8c0031c00/0x7ef423838fba24c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba24b9 expref: 17 pid: 6515 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384344.115130:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384344.115132:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384344.115134:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384344.115144:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203229056:0@lo:103: 00000100:00100000:1.0:1787384344.115159:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787384344.115165:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+17:3653:x1874208203228928:12345-0@lo:103: 00000100:00100000:3.0:1787384344.115176:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787384344.115187:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384344.115192:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f8c0031c00/0x7ef423838fba24c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba24b9 expref: 17 pid: 6515 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384344.115202:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f8c0031c00/0x7ef423838fba24c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba24b9 expref: 17 pid: 6515 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384344.115215:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8c0031c00/0x7ef423838fba24c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba24b9 expref: 17 pid: 6515 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384344.115225:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384344.115248:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+16:3653:x1874208203228928:12345-0@lo:103: Request processed in 83us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384344.115254:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787384344.115266:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203229056 00000100:00100000:1.0:1787384344.115269:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203229056 00010000:00010000:1.0:1787384344.115280:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f8cad39200/0x7ef423838fba23fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba23f5 expref: 16 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384344.115303:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787384344.115309:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+16:3654:x1874208203229056:12345-0@lo:103: 00010000:00010000:1.0:1787384344.115317:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384344.115326:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f8cad39200/0x7ef423838fba23fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba23f5 expref: 16 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384344.115338:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f8cad39200/0x7ef423838fba23fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba23f5 expref: 16 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384344.115350:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8cad39200/0x7ef423838fba23fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba23f5 expref: 16 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384344.115358:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384344.115392:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+15:3654:x1874208203229056:12345-0@lo:103: Request processed in 83us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384344.115398:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787384344.115535:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203228928:0@lo:103: 00010000:00010000:1.0:1787384344.116022:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384344.116025:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384344.116027:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384344.116060:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc200/0x7ef423838fba246c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2473 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.116068:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cc200 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384344.116072:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc200/0x7ef423838fba246c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba2473 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.116079:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc200/0x7ef423838fba246c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba2473 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384344.116096:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc200/0x7ef423838fba246c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba2473 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384344.116101:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787384344.116118:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc200/0x7ef423838fba246c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2473 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.116123:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787384344.116156:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc200/0x7ef423838fba246c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2473 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.116162:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc200/0x7ef423838fba246c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2473 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.116372:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384344.116374:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384344.116376:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384344.116383:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787384344.116394:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c20d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203229184:0@lo:103: 00000100:00100000:2.0:1787384344.116500:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384344.116542:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203229184 00000100:00100000:2.0:1787384344.116547:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203229184 00010000:00010000:2.0:1787384344.116564:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f902158400/0x7ef423838fba2473 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba246c expref: 15 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384344.116584:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787384344.116591:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f18e1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+15:3652:x1874208203229184:12345-0@lo:103: 00010000:00010000:2.0:1787384344.116599:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384344.116603:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f902158400/0x7ef423838fba2473 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba246c expref: 15 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.116619:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f902158400/0x7ef423838fba2473 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba246c expref: 15 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.116631:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f902158400/0x7ef423838fba2473 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba246c expref: 15 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.116642:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98f902159400/0x7ef423838fba2530 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.116649:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f902159400/0x7ef423838fba2530 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.116662:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f902159400/0x7ef423838fba2530 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.116670:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f902159400/0x7ef423838fba2530 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.116676:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98f902159400/0x7ef423838fba2530 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.116682:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98f902159400/0x7ef423838fba2530 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.116687:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f902159400 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:2.0:1787384344.116691:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98f902159400/0x7ef423838fba2530 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.116698:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98f902159400/0x7ef423838fba2530 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.116723:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98f902159400/0x7ef423838fba2530 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.116732:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384344.116762:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f18e1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+14:3652:x1874208203229184:12345-0@lo:103: Request processed in 172us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384344.116769:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787384344.116849:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c20d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203229184:0@lo:103: 00010000:00010000:2.0:1787384344.116869:0:6516:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98f902159400/0x7ef423838fba2530 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.116877:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98f902159400/0x7ef423838fba2530 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.116882:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f902159400/0x7ef423838fba2530 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787384344.116894:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787384344.118180:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203229056:0@lo:103: 00000100:00100000:1.0:1787384344.122094:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+13:8430:x1874208203227904:12345-0@lo:253: Request processed in 37125us (38354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384344.122108:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787384344.122252:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:8430:1874208203227904:0@lo:253: 10000000:01000000:2.0:1787384344.122267:0:8430:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787384344.122270:0:8430:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787384344.122271:0:8430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787384344.122273:0:8430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787384344.122274:0:8430:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1787384344.122275:0:8430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787384344.122276:0:8430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787384344.122277:0:8430:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787384344.122279:0:8430:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787384344.122280:0:8430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787384344.122281:0:8430:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787384344.122324:0:8430:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98f8f5669000 from lustre-OST0000 10000000:01000000:2.0:1787384344.122352:0:8430:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787384344.122355:0:8430:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787384344.122362:0:8430:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98f8f96899c0 local copy 10000000:01000000:2.0:1787384344.122366:0:8430:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787384344.122507:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cd200/0x7ef423838fba2537 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.122520:0:8430:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.145@tcp lock: ffff98f8f58cd200/0x7ef423838fba2537 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.122529:0:8430:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8f58cd200/0x7ef423838fba2537 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384344.122548:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c20d0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:8430:1874208203229312:0@lo:101: 00000100:00100000:2.0:1787384344.122584:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384344.122652:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c72409c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384344.122690:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203229312 00000100:00100000:1.0:1787384344.122696:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203229312 00000100:00100000:1.0:1787384344.122905:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787384344.122916:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+13:8430:x1874208203229312:12345-0@lo:101: 00010000:00010000:1.0:1787384344.122928:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384344.122941:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f902159200/0x7ef423838fba253e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba2537 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384344.122963:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f902159200/0x7ef423838fba253e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba2537 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384344.122982:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f902159200/0x7ef423838fba253e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2537 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384344.122991:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f902159200, rc 0) 00000100:00100000:1.0:1787384344.123033:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+14:8430:x1874208203229312:12345-0@lo:101: Request processed in 120us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384344.123040:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787384344.123099:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c20d0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:8430:1874208203229312:0@lo:101: 00010000:00010000:3.0:1787384344.123113:0:8430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8f58cd200/0x7ef423838fba2537 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x7ef423838fba253e expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384344.123121:0:8430:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8f58cd200/0x7ef423838fba2537 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7ef423838fba253e expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384344.123213:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:8430:1874208203229440:0@lo:501: 00000100:00100000:3.0:1787384344.123241:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384344.123545:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c2fd3540 going to sleep for 11 seconds 00000100:00100000:2.0:1787384344.123571:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203229440 00000100:00100000:2.0:1787384344.123576:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203229440 00000100:00100000:0.0:1787384344.123611:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787384344.123619:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+14:8430:x1874208203229440:12345-0@lo:501: 00000100:00100000:0.0:1787384344.123679:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+14:8430:x1874208203229440:12345-0@lo:501: Request processed in 61us (437us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787384344.123685:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787384344.123739:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:8430:1874208203229440:0@lo:501: 10000000:01000000:3.0:1787384344.123751:0:8430:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.145@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787384344.123765:0:8430:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.145@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787384344.123770:0:8430:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cd200/0x7ef423838fba2537 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7ef423838fba253e expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384344.123801:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cd200/0x7ef423838fba2537 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7ef423838fba253e expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384344.123808:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.145@tcp lock: ffff98f8f58cd200/0x7ef423838fba2537 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7ef423838fba253e expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384344.123827:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787384344.123848:0:8430:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98f8f5669000 10000000:01000000:3.0:1787384344.123853:0:8430:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787384344.123864:0:8430:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787384344.123867:0:8430:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787384344.123871:0:8430:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787384344.123874:0:8430:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787384344.123891:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8cad39400/0x7ef423838fba2545 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384344.123898:0:8430:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8cad39400/0x7ef423838fba2545 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384344.123906:0:8430:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8cad39400/0x7ef423838fba2545 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384344.123918:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:8430:1874208203229568:0@lo:101: 00000100:00100000:3.0:1787384344.123940:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384344.123951:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c2fd3600 going to sleep for 11 seconds 00010000:00010000:0.0:1787384344.124012:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384344.124019:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8f58cd200/0x7ef423838fba2537 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x7ef423838fba253e expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384344.124026:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cd200 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:0.0:1787384344.124029:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8f58cd200/0x7ef423838fba2537 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x7ef423838fba253e expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384344.124048:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8f58cd200/0x7ef423838fba2537 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x7ef423838fba253e expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787384344.124055:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8f58cd200/0x7ef423838fba2537 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x7ef423838fba253e expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384344.124060:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787384344.124078:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8f58cd200/0x7ef423838fba2537 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7ef423838fba253e expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384344.124084:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787384344.124108:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8f58cd200/0x7ef423838fba2537 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7ef423838fba253e expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384344.124115:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8f58cd200/0x7ef423838fba2537 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7ef423838fba253e expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384344.124126:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384344.124128:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384344.124129:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384344.124137:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787384344.124157:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203229696:0@lo:103: 00000100:00100000:0.0:1787384344.124182:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384344.124204:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203229568 00000100:00100000:0.0:1787384344.124207:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203229568 00000100:00100000:0.0:1787384344.124222:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787384344.124227:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+14:8430:x1874208203229568:12345-0@lo:101: 00010000:00010000:0.0:1787384344.124233:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384344.124241:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8f5825800/0x7ef423838fba254c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba2545 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384344.124260:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f5825800/0x7ef423838fba254c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba2545 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384344.124270:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8f5825800/0x7ef423838fba254c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2545 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384344.124277:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f5825800, rc 0) 00000100:00100000:0.0:1787384344.124318:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+15:8430:x1874208203229568:12345-0@lo:101: Request processed in 90us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384344.124323:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787384344.124360:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:8430:1874208203229568:0@lo:101: 00010000:00010000:0.0:1787384344.124369:0:8430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8cad39400/0x7ef423838fba2545 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba254c expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384344.124377:0:8430:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8cad39400/0x7ef423838fba2545 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba254c expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384344.124447:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:8430:1874208203229824:0@lo:501: 00000100:00100000:0.0:1787384344.124468:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384344.124485:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203229824 00000100:00100000:0.0:1787384344.124488:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203229824 00000100:00100000:0.0:1787384344.124501:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787384344.124506:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+15:8430:x1874208203229824:12345-0@lo:501: 00000100:00100000:0.0:1787384344.124571:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+15:8430:x1874208203229824:12345-0@lo:501: Request processed in 64us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384344.124577:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787384344.124600:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c5353e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787384344.124610:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:8430:1874208203229824:0@lo:501: 00000100:00100000:0.0:1787384344.124629:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:8430:1874208203229952:0@lo:503: 00000100:00100000:0.0:1787384344.124666:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384344.124685:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203229952 00000100:00100000:0.0:1787384344.124688:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203229952 00000100:00100000:0.0:1787384344.124703:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787384344.124707:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+15:8430:x1874208203229952:12345-0@lo:503: 00000100:00100000:0.0:1787384344.124800:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+15:8430:x1874208203229952:12345-0@lo:503: Request processed in 69us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384344.124808:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787384344.124842:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c5353e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787384344.124854:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:8430:1874208203229952:0@lo:503: 00000040:00080000:0.0:1787384344.125067:0:8430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787384344.125154:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:8430:1874208203230080:0@lo:502: 00000100:00100000:0.0:1787384344.125190:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384344.125207:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c5353e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787384344.125360:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203230080 00000100:00100000:1.0:1787384344.125367:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203230080 00000100:00100000:1.0:1787384344.125399:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787384344.125407:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+15:8430:x1874208203230080:12345-0@lo:502: 00000100:00100000:1.0:1787384344.125483:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+15:8430:x1874208203230080:12345-0@lo:502: Request processed in 77us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384344.125490:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787384344.125644:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:8430:1874208203230080:0@lo:502: 00000040:00080000:0.0:1787384344.125842:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787384344.125867:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1787384344.125882:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1787384344.125896:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1787384344.125910:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1787384344.125923:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1787384344.125944:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:8430:1874208203230208:0@lo:502: 00000100:00100000:0.0:1787384344.125979:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384344.126010:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c5353e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787384344.126102:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203230208 00000100:00100000:1.0:1787384344.126106:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203230208 00000100:00100000:1.0:1787384344.126136:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787384344.126144:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+15:8430:x1874208203230208:12345-0@lo:502: 00000100:00100000:1.0:1787384344.126220:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+15:8430:x1874208203230208:12345-0@lo:502: Request processed in 76us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384344.126226:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787384344.126324:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:8430:1874208203230208:0@lo:502: 00000040:00080000:0.0:1787384344.126359:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787384344.126367:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000100:00100000:2.0:1787384344.127212:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203229696 00000100:00100000:2.0:1787384344.127219:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203229696 00000100:00100000:2.0:1787384344.127253:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787384344.127260:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9149500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+15:3651:x1874208203229696:12345-0@lo:103: 00010000:00010000:2.0:1787384344.127271:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384344.127287:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f902159200/0x7ef423838fba253e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ef423838fba2537 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.127312:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384344.127357:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9149500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+14:3651:x1874208203229696:12345-0@lo:103: Request processed in 97us (3174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384344.127363:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000000:3.0:1787384344.127514:0:8454:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787384344.127521:0:8454:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1787384344.127527:0:8454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384344.127530:0:8454:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787384344.127535:0:8454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787384344.127548:0:8454:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff98f8f59399c0) 00000020:00000080:3.0:1787384344.127568:0:8454:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787384344.127574:0:8454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1787384344.127607:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203229696:0@lo:103: 00000020:01000004:3.0:1787384344.127650:0:8454:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f8f5669000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787384344.127658:0:8454:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787384344.127664:0:8454:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7ef423838fba255a 00010000:00010000:3.0:1787384344.136106:0:8454:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:3.0:1787384344.139107:0:8454:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1787384344.146965:0:8454:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787384344.147315:0:8454:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1787384344.151603:0:8454:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1787384344.153768:0:8454:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1787384344.163324:0:8454:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1787384344.170715:0:8454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787384344.170727:0:8454:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384344.170733:0:8454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384344.170735:0:8454:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787384344.170738:0:8454:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787384344.170742:0:8454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384344.170744:0:8454:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787384344.170746:0:8454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787384344.170748:0:8454:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787384344.170774:0:8454:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384344.171038:0:8454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384344.171040:0:8454:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787384344.171044:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787384344.172606:0:8430:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1787384344.172639:0:8430:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787384344.172659:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8cad39400/0x7ef423838fba2545 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba254c expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384344.172671:0:8430:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8cad39400/0x7ef423838fba2545 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba254c expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384344.172679:0:8430:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98f8f5669000 from 1 10000000:01000000:0.0:1787384344.172682:0:8430:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787384344.172717:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f5824200/0x7ef423838fba2561 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384344.172726:0:8430:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8f5824200/0x7ef423838fba2561 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384344.172736:0:8430:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8f5824200/0x7ef423838fba2561 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384344.172756:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:8430:1874208203230336:0@lo:101: 00000100:00100000:0.0:1787384344.172841:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384344.172959:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203230336 00000100:00100000:1.0:1787384344.172966:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203230336 00000100:00100000:1.0:1787384344.173004:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787384344.173012:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+14:8430:x1874208203230336:12345-0@lo:101: 00010000:00010000:1.0:1787384344.173024:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384344.173041:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f902158e00/0x7ef423838fba2568 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba2561 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384344.173061:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f902158e00/0x7ef423838fba2568 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba2561 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384344.173071:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f902158e00/0x7ef423838fba2568 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2561 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384344.173080:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f902158e00, rc 0) 00000100:00100000:1.0:1787384344.173112:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+15:8430:x1874208203230336:12345-0@lo:101: Request processed in 100us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384344.173118:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787384344.173499:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c5353e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787384344.173522:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:8430:1874208203230336:0@lo:101: 00010000:00010000:0.0:1787384344.173536:0:8430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8f5824200/0x7ef423838fba2561 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2568 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384344.173552:0:8430:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8f5824200/0x7ef423838fba2561 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2568 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384344.173631:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:8430:1874208203230464:0@lo:501: 00000100:00100000:0.0:1787384344.173661:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384344.173690:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203230464 00000100:00100000:0.0:1787384344.173693:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203230464 00000100:00100000:0.0:1787384344.173716:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787384344.173723:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+15:8430:x1874208203230464:12345-0@lo:501: 00000100:00100000:0.0:1787384344.174162:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+15:8430:x1874208203230464:12345-0@lo:501: Request processed in 438us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384344.174170:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787384344.174205:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c5353e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787384344.174218:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:8430:1874208203230464:0@lo:501: 00000100:00100000:0.0:1787384344.174244:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:8430:1874208203230592:0@lo:503: 00000100:00100000:0.0:1787384344.174282:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384344.174311:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c5353e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787384344.174386:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203230592 00000100:00100000:2.0:1787384344.174392:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203230592 00000100:00100000:2.0:1787384344.174437:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787384344.174444:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+15:8430:x1874208203230592:12345-0@lo:503: 00000100:00100000:2.0:1787384344.174522:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+15:8430:x1874208203230592:12345-0@lo:503: Request processed in 78us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384344.174528:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787384344.175546:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:8430:1874208203230592:0@lo:503: 00000040:00080000:0.0:1787384344.175758:0:8430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787384344.177127:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:8430:1874208203230720:0@lo:502: 00000100:00100000:1.0:1787384344.177192:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384344.177231:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f1b9fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787384344.177279:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203230720 00000100:00100000:0.0:1787384344.177286:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203230720 00000100:00100000:0.0:1787384344.177336:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787384344.177343:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+15:8430:x1874208203230720:12345-0@lo:502: 00000100:00100000:0.0:1787384344.178588:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+15:8430:x1874208203230720:12345-0@lo:502: Request processed in 1242us (1392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384344.178609:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787384344.180037:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:8430:1874208203230720:0@lo:502: 00000040:00080000:3.0:1787384344.180233:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787384344.180259:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787384344.180287:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:8430:1874208203230848:0@lo:502: 00000100:00100000:3.0:1787384344.180358:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384344.180396:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c2fd3480 going to sleep for 11 seconds 00000100:00100000:2.0:1787384344.180674:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203230848 00000100:00100000:2.0:1787384344.180681:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203230848 00000100:00100000:2.0:1787384344.180731:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787384344.180740:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+15:8430:x1874208203230848:12345-0@lo:502: 00000100:00100000:2.0:1787384344.180969:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+15:8430:x1874208203230848:12345-0@lo:502: Request processed in 229us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384344.180977:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787384344.181027:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:8430:1874208203230848:0@lo:502: 00000040:00080000:2.0:1787384344.181077:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787384344.181090:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787384344.184358:0:8458:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787384344.184372:0:8458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384344.184374:0:8458:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787384344.184383:0:8458:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f8f5669000 00000020:00000080:0.0:1787384344.184386:0:8458:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787384344.184398:0:8458:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384344.184401:0:8458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384344.184402:0:8458:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787384344.184405:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787384344.184542:0:8430:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787384344.184571:0:8430:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787384344.184596:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f5824200/0x7ef423838fba2561 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2568 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384344.184609:0:8430:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8f5824200/0x7ef423838fba2561 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2568 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384344.184656:0:8430:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787384344.184660:0:8430:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98f8f5669000 10000000:01000000:3.0:1787384344.184662:0:8430:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98f8f5669000 10000000:01000000:3.0:1787384344.184666:0:8430:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787384344.184672:0:8430:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98f8f5669000 from 1 10000000:01000000:3.0:1787384344.184675:0:8430:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787384344.184707:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8cad38600/0x7ef423838fba256f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384344.184716:0:8430:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8cad38600/0x7ef423838fba256f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384344.184731:0:8430:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8cad38600/0x7ef423838fba256f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384344.184768:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:8430:1874208203230976:0@lo:101: 00000100:00100000:3.0:1787384344.184849:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384344.184897:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d829a900 going to sleep for 11 seconds 00000100:00100000:1.0:1787384344.187856:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203230976 00000100:00100000:1.0:1787384344.187869:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203230976 00000100:00100000:1.0:1787384344.187941:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787384344.187951:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+15:8430:x1874208203230976:12345-0@lo:101: 00010000:00010000:1.0:1787384344.187971:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384344.187989:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f902159200/0x7ef423838fba2576 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba256f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384344.188014:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f902159200/0x7ef423838fba2576 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba256f expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384344.188025:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f902159200/0x7ef423838fba2576 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba256f expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384344.188049:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f902159200, rc 0) 00000100:00100000:1.0:1787384344.188126:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+16:8430:x1874208203230976:12345-0@lo:101: Request processed in 176us (3276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384344.188135:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787384344.188396:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:8430:1874208203230976:0@lo:101: 00010000:00010000:3.0:1787384344.188430:0:8430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8cad38600/0x7ef423838fba256f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2576 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384344.188439:0:8430:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8cad38600/0x7ef423838fba256f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2576 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384344.188556:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:8430:1874208203231104:0@lo:501: 00000100:00100000:3.0:1787384344.188589:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384344.188625:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d829a900 going to sleep for 11 seconds 00000100:00100000:1.0:1787384344.188730:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203231104 00000100:00100000:1.0:1787384344.188735:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203231104 00000100:00100000:1.0:1787384344.188769:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787384344.188811:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+16:8430:x1874208203231104:12345-0@lo:501: 00000100:00100000:1.0:1787384344.188916:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+16:8430:x1874208203231104:12345-0@lo:501: Request processed in 140us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384344.188923:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787384344.189346:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:8430:1874208203231104:0@lo:501: 00000100:00100000:3.0:1787384344.189378:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:8430:1874208203231232:0@lo:503: 00000100:00100000:3.0:1787384344.189529:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384344.189558:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d829a900 going to sleep for 11 seconds 00000100:00100000:1.0:1787384344.189608:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203231232 00000100:00100000:1.0:1787384344.189612:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203231232 00000100:00100000:1.0:1787384344.189645:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787384344.189652:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+16:8430:x1874208203231232:12345-0@lo:503: 00000100:00100000:1.0:1787384344.189813:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+16:8430:x1874208203231232:12345-0@lo:503: Request processed in 126us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384344.189820:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787384344.192172:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:8430:1874208203231232:0@lo:503: 00000040:00080000:3.0:1787384344.192583:0:8430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787384344.192667:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:8430:1874208203231360:0@lo:502: 00000100:00100000:3.0:1787384344.192730:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384344.192838:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7027c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787384344.195224:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203231360 00000100:00100000:0.0:1787384344.195238:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203231360 00000100:00100000:1.0:1787384344.195380:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787384344.195389:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+16:8430:x1874208203231360:12345-0@lo:502: 00000100:00100000:1.0:1787384344.195576:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+16:8430:x1874208203231360:12345-0@lo:502: Request processed in 187us (2845us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384344.195584:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787384344.195741:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:8430:1874208203231360:0@lo:502: 00000040:00080000:2.0:1787384344.196048:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787384344.196079:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787384344.196093:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787384344.196104:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787384344.196115:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787384344.196126:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787384344.196138:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787384344.196150:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787384344.196162:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787384344.196174:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787384344.196188:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787384344.196201:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787384344.196213:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787384344.196226:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787384344.196239:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787384344.196251:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787384344.196264:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787384344.196277:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787384344.196289:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787384344.196312:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787384344.196325:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787384344.196338:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787384344.196358:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787384344.196379:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787384344.196414:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1787384344.197197:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1787384344.197209:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1787384344.197219:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1787384344.197230:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1787384344.197241:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1787384344.197262:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1787384344.197273:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1787384344.197284:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1787384344.201276:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1787384344.201342:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1787384344.201359:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1787384344.201392:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:3.0:1787384344.201457:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:8430:1874208203231488:0@lo:502: 00000100:00100000:3.0:1787384344.201532:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384344.201577:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d829a900 going to sleep for 11 seconds 00000100:00100000:2.0:1787384344.202013:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203231488 00000100:00100000:2.0:1787384344.202022:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203231488 00000100:00100000:2.0:1787384344.202063:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787384344.202072:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+16:8430:x1874208203231488:12345-0@lo:502: 00000100:00100000:2.0:1787384344.202494:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+16:8430:x1874208203231488:12345-0@lo:502: Request processed in 422us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384344.202503:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787384344.202558:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:8430:1874208203231488:0@lo:502: 00000040:00080000:3.0:1787384344.202612:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1787384344.202626:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1787384344.208044:0:8459:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787384344.208063:0:8459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff98f8f593b380) 00000020:00000080:3.0:1787384344.208085:0:8459:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1787384344.208285:0:8459:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f8f5669000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787384344.208289:0:8459:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f8f5669000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787384344.208301:0:8459:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f8f5669000 3 00010000:00080000:3.0:1787384344.208330:0:8459:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f8c8923800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.145@tcp at head 00010000:00010000:3.0:1787384344.210610:0:8459:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:3.0:1787384344.210713:0:8459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1787384344.210755:0:8459:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787384344.210799:0:8459:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x7ef423838fba2584 00000100:00080000:3.0:1787384344.210810:0:8459:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787384344.210816:0:8459:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98f8c8923800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:3.0:1787384344.210854:0:8459:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f91da680 x1874208203231616/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787384344.210878:0:8459:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787384344.211059:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1874208203231616:0@lo:38: 00000100:00100000:2.0:1787384344.211123:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384344.211408:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203231872:0@lo:400: 00000100:00100000:1.0:1787384344.211453:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384344.211485:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787384344.211492:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874208203231744:0@lo:400: 00000100:00100000:1.0:1787384344.211513:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384344.211537:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203232128:0@lo:400: 00000100:00100000:1.0:1787384344.211558:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384344.211574:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787384344.211579:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874208203232000:0@lo:400: 00000100:00100000:1.0:1787384344.211600:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384344.211628:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203231872 00000100:00100000:1.0:1787384344.211634:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203231872 00000100:00100000:1.0:1787384344.211669:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203232128 00000100:00100000:1.0:1787384344.211672:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203232128 00000100:00100000:1.0:1787384344.211688:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787384344.211694:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203231872:12345-0@lo:400: 00000100:00100000:1.0:1787384344.211748:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203231872:12345-0@lo:400: Request processed in 52us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384344.211754:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787384344.211768:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787384344.211774:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203232128:12345-0@lo:400: 00000100:00100000:1.0:1787384344.211830:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203232128:12345-0@lo:400: Request processed in 55us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384344.211836:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787384344.211858:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203231616 00000100:00100000:1.0:1787384344.211861:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203231616 00000100:00100000:1.0:1787384344.211877:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203231744 00000100:00100000:1.0:1787384344.211880:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203231744 00000100:00100000:1.0:1787384344.211893:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203232000 00000100:00100000:1.0:1787384344.211895:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203232000 00000100:00100000:1.0:1787384344.211907:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787384344.211920:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874208203231744:12345-0@lo:400: 00000100:00100000:1.0:1787384344.211949:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874208203231744:12345-0@lo:400: Request processed in 31us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384344.211955:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787384344.211967:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787384344.211973:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874208203232000:12345-0@lo:400: 00000100:00100000:1.0:1787384344.211998:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874208203232000:12345-0@lo:400: Request processed in 26us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384344.212003:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787384344.212014:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787384344.212018:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1874208203231616:12345-0@lo:38: 00010000:00080000:1.0:1787384344.212036:0:6522:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 239 last 0 00000020:00000080:1.0:1787384344.212066:0:6522:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x7ef423838fba258b 00000004:00100000:1.0:1787384344.212079:0:6522:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787384344.212107:0:6522:0:(import.c:65:import_set_state_nolock()) ffff98f7c2051800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787384344.212143:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874208203231616:12345-0@lo:38: Request processed in 123us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384344.212150:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787384344.212187:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f8fc1b7100 x1874208203232000/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384344.212198:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874208203232000:0@lo:400: 00000100:00100000:1.0:1787384344.212209:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203232128:0@lo:400: 00010000:00080000:1.0:1787384344.212236:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f8fc1b7b80 x1874208203231744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384344.212244:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874208203231744:0@lo:400: 00000100:00100000:1.0:1787384344.212264:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203231872:0@lo:400: 00010000:00080000:2.0:1787384344.213049:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f8f91da680 x1874208203231616/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787384354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384344.213059:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787384344.213065:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1787384344.213072:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787384344.213077:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787384344.213080:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8c8923800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787384344.213085:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1874208203231616:0@lo:38: 00000020:01000004:3.0:1787384344.218733:0:8459:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787384344.218766:0:8459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff98f7c289b380) 00000020:00000080:3.0:1787384344.218821:0:8459:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:3.0:1787384344.220689:0:8459:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f8f5669000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787384344.220696:0:8459:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f8f5669000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787384344.220704:0:8459:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f8f5669000 3 00010000:00080000:3.0:1787384344.220738:0:8459:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f7c2894800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.145@tcp at head 00010000:00010000:2.0:1787384344.231551:0:8459:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:2.0:1787384344.231657:0:8459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1787384344.231703:0:8459:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787384344.231715:0:8459:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x7ef423838fba2599 00000100:00080000:2.0:1787384344.231724:0:8459:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787384344.231731:0:8459:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff98f7c2894800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:2.0:1787384344.231762:0:8459:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f7c20d0700 x1874208203232256/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787384344.231829:0:8459:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000040:00080000:2.0:1787384344.232007:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:3.0:1787384344.232078:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c20d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3650:1874208203232256:0@lo:38: 00000100:00100000:3.0:1787384344.232156:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384344.232210:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203232256 00000100:00100000:3.0:1787384344.232216:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203232256 00000100:00100000:3.0:1787384344.232246:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787384344.232253:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1874208203232256:12345-0@lo:38: 00010000:00080000:3.0:1787384344.232289:0:6522:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 239 last 0 00000020:00000080:3.0:1787384344.232338:0:6522:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x7ef423838fba25a0 00000004:00100000:3.0:1787384344.232352:0:6522:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787384344.232379:0:6522:0:(import.c:65:import_set_state_nolock()) ffff98f7c2897800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787384344.233745:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874208203232256:12345-0@lo:38: Request processed in 1485us (1595us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384344.233756:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000000:1.0:1787384344.234075:0:8430:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1787384344.234108:0:8430:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787384344.234129:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8cad38600/0x7ef423838fba256f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2576 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384344.234140:0:8430:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8cad38600/0x7ef423838fba256f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2576 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787384344.234201:0:8430:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787384344.234203:0:8430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787384344.234205:0:8430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787384344.234206:0:8430:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787384344.234207:0:8430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787384344.234209:0:8430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787384344.234210:0:8430:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787384344.234212:0:8430:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787384344.234213:0:8430:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787384344.234214:0:8430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787384344.234215:0:8430:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787384344.234218:0:8430:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1787384344.234220:0:8430:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787384344.234221:0:8430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787384344.234223:0:8430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787384344.234224:0:8430:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787384344.234225:0:8430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787384344.234226:0:8430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787384344.234227:0:8430:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787384344.234228:0:8430:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787384344.234229:0:8430:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787384344.234229:0:8430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787384344.234231:0:8430:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787384344.234253:0:8430:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787384344.234269:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:8430:1874208203232384:0@lo:253: 00000100:00100000:1.0:1787384344.234330:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384344.234367:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fc1d86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384344.234557:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203232384 00000100:00100000:3.0:1787384344.234564:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203232384 00000100:00100000:3.0:1787384344.234611:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787384344.234620:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+16:8430:x1874208203232384:12345-0@lo:253: 20000000:01000000:3.0:1787384344.234655:0:6516:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787384344.234669:0:6516:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1787384344.239718:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f7c20d0700 x1874208203232256/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787384354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384344.239733:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787384344.239743:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1787384344.239752:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787384344.239759:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787384344.239762:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f7c2894800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787384344.239768:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c20d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3650:1874208203232256:0@lo:38: 20000000:01000000:2.0:1787384344.246356:0:6516:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787384344.246378:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787384344.246797:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+16:8430:x1874208203232384:12345-0@lo:253: Request processed in 12155us (12442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384344.246810:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787384344.246927:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:8430:1874208203232384:0@lo:253: 10000000:01000000:3.0:1787384344.246941:0:8430:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787384344.246944:0:8430:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787384344.246945:0:8430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787384344.246947:0:8430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384344.246948:0:8430:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384344.246949:0:8430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384344.246950:0:8430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384344.246964:0:8430:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787384344.246966:0:8430:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787384344.246967:0:8430:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787384344.246968:0:8430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384344.246970:0:8430:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787384344.246984:0:8430:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1787384344.247718:0:6537:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787384344.247724:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787384344.247745:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98f8f5824800/0x7ef423838fba25a7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384344.247762:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f8c0031e00/0x7ef423838fba24a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba249d expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384344.247771:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f902158200/0x7ef423838fba24ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba24c7 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384344.247806:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98f8f5824800/0x7ef423838fba25a7 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384344.247841:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f902158200/0x7ef423838fba24ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba24c7 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384344.247856:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f902158200/0x7ef423838fba24ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba24c7 expref: 15 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384344.247883:0:6537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874208203232512:0@lo:104: 00000100:00100000:0.0:1787384344.247927:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787384344.247971:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f8c0031e00/0x7ef423838fba24a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba249d expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384344.247980:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f8c0031e00/0x7ef423838fba24a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba249d expref: 15 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384344.248005:0:6537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874208203232640:0@lo:104: 00000100:00100000:0.0:1787384344.248023:0:6537:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f9755300 going to sleep for 11 seconds 00000100:00100000:2.0:1787384344.248377:0:6506:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787384344.248396:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384344.248423:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203232512 00000100:00100000:2.0:1787384344.248430:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203232512 00000100:00100000:2.0:1787384344.248461:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203232640 00000100:00100000:2.0:1787384344.248464:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203232640 00000100:00100000:2.0:1787384344.248479:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787384344.248486:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee13b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+4:6537:x1874208203232512:12345-0@lo:104: 00010000:00010000:2.0:1787384344.248498:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba24c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba24ce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.248545:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787384344.248558:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee13b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+4:6537:x1874208203232512:12345-0@lo:104: Request processed in 72us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384344.248564:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787384344.248595:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787384344.248602:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+3:6537:x1874208203232640:12345-0@lo:104: 00010000:00010000:2.0:1787384344.248609:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f8c0030800/0x7ef423838fba249d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba24a4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.248641:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787384344.248647:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+3:6537:x1874208203232640:12345-0@lo:104: Request processed in 46us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384344.248652:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1787384344.248668:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787384344.248673:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba24c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba24ce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.248680:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f902158000 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384344.248683:0:8453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba24c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba24ce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.248691:0:8453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba24c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba24ce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384344.248699:0:8453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba24c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba24ce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384344.248705:0:8453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787384344.248731:0:8453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba24c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba24ce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.248747:0:8453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787384344.248765:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba24c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba24ce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.248772:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba24c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba24ce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.248804:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384344.248807:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8c0030800/0x7ef423838fba249d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba24a4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.248813:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c0030800 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384344.248816:0:8453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8c0030800/0x7ef423838fba249d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba24a4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.248823:0:8453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8c0030800/0x7ef423838fba249d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba24a4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384344.248830:0:8453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8c0030800/0x7ef423838fba249d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba24a4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384344.248835:0:8453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787384344.248848:0:8453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8c0030800/0x7ef423838fba249d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba24a4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.248854:0:8453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787384344.248859:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8c0030800/0x7ef423838fba249d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba24a4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.248866:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8c0030800/0x7ef423838fba249d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba24a4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.248885:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384344.248887:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384344.248889:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384344.248896:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384344.248915:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c20d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203232768:0@lo:103: 00000100:00100000:2.0:1787384344.248942:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384344.248963:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787384344.248968:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c20d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203232896:0@lo:103: 00000100:00100000:2.0:1787384344.249935:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384344.250070:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203232768 00000100:00100000:1.0:1787384344.250077:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203232768 00010000:00010000:1.0:1787384344.250112:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f902158200/0x7ef423838fba24ce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba24c7 expref: 16 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384344.250149:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203232896 00000100:00100000:1.0:1787384344.250152:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203232896 00010000:00010000:1.0:1787384344.250164:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f8c0031e00/0x7ef423838fba24a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba249d expref: 17 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384344.250178:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787384344.250185:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+17:3653:x1874208203232768:12345-0@lo:103: 00010000:00010000:1.0:1787384344.250197:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384344.250203:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f902158200/0x7ef423838fba24ce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba24c7 expref: 17 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384344.250214:0:6508:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1787384344.250216:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f902158200/0x7ef423838fba24ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba24c7 expref: 17 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384344.250225:0:6508:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1787384344.250257:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384344.250327:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+17:3653:x1874208203232768:12345-0@lo:103: Request processed in 141us (1383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384344.250335:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787384344.250354:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787384344.250369:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+16:3653:x1874208203232896:12345-0@lo:103: 00010000:00010000:0.0:1787384344.250377:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384344.250382:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f8c0031e00/0x7ef423838fba24a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba249d expref: 16 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384344.250393:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f8c0031e00/0x7ef423838fba24a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba249d expref: 16 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384344.250406:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98f8f5824800/0x7ef423838fba25a7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384344.250414:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f5824800/0x7ef423838fba25a7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787384344.250427:0:6508:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004758733s 00010000:00010000:0.0:1787384344.250440:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f8f5824800/0x7ef423838fba25a7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384344.250448:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f8f5824800/0x7ef423838fba25a7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384344.250455:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98f8f5824800/0x7ef423838fba25a7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384344.250460:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98f8f5824800/0x7ef423838fba25a7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384344.250465:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5824800 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384344.250469:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98f8f5824800/0x7ef423838fba25a7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384344.250476:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98f8f5824800/0x7ef423838fba25a7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384344.250485:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98f8f5824800/0x7ef423838fba25a7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384344.250494:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384344.250525:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+16:3653:x1874208203232896:12345-0@lo:103: Request processed in 161us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384344.250533:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787384344.250714:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c20d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203232896:0@lo:103: 00000100:00100000:2.0:1787384344.250723:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c20d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203232768:0@lo:103: 00010000:00010000:2.0:1787384344.250755:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f902158200/0x7ef423838fba24ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba24c7 expref: 15 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384344.250766:0:6537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874208203232512:0@lo:104: 00010000:00010000:2.0:1787384344.250802:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8c0031e00/0x7ef423838fba24a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba249d expref: 14 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384344.250813:0:6537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874208203232640:0@lo:104: 00010000:00010000:2.0:1787384344.250828:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98f8f5824800/0x7ef423838fba25a7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.250837:0:6537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98f8f5824800/0x7ef423838fba25a7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.250844:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98f8f5824800/0x7ef423838fba25a7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384344.250858:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f5824800/0x7ef423838fba25a7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1787384344.260190:0:8430:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1787384344.260443:0:8430:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1787384344.260639:0:8430:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1787384344.260821:0:8430:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1787384344.261177:0:8430:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1787384344.261429:0:8430:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1787384344.265691:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787384344.279896:0:8430:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787384344.279906:0:8430:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787384344.279951:0:8430:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787384344.280000:0:8430:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.145@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787384344.280033:0:8430:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787384344.280052:0:8430:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1787384344.281838:0:8430:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787384344.282011:0:8430:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1787384344.503098:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384344.505479:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787384344.505504:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203233024:0@lo:41: 00000100:00100000:3.0:1787384344.505573:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384344.505639:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203233024 00000100:00100000:3.0:1787384344.505647:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203233024 00000100:00100000:3.0:1787384344.505696:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787384344.505706:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203233024:12345-0@lo:41: 00000004:00000024:3.0:1787384344.505748:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1787384344.505833:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203233024:12345-0@lo:41: Request processed in 128us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384344.505840:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787384344.505899:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203233024:0@lo:41: 00000100:00100000:3.0:1787384345.020094:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c20d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203233152:0@lo:41: 00000100:00100000:3.0:1787384345.020165:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384345.020863:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203233152 00000100:00100000:2.0:1787384345.020874:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203233152 00000100:00100000:2.0:1787384345.020926:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787384345.020935:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203233152:12345-0@lo:41: 00000004:00000024:2.0:1787384345.020968:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:2.0:1787384345.021021:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203233152:12345-0@lo:41: Request processed in 86us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384345.021028:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787384345.021117:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c20d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203233152:0@lo:41: 00000020:00000004:1.0:1787384345.211424:0:8515:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787384345.212045:0:8515:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787384345.528771:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384346.554452:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384347.581252:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384348.605189:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384349.623953:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c20d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874208203233408:0@lo:400: 00000100:00100000:2.0:1787384349.624013:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384349.624057:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c20d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874208203233920:0@lo:400: 00000100:00100000:2.0:1787384349.624077:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384349.624099:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787384349.624105:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c20d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203233280:0@lo:400: 00000100:00100000:2.0:1787384349.624147:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384349.624167:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c20d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203233792:0@lo:400: 00000100:00100000:2.0:1787384349.624191:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384349.624218:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c20d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874208203233664:0@lo:400: 00000100:00100000:2.0:1787384349.624238:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384349.624264:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787384349.624270:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c20d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203233536:0@lo:400: 00000100:00100000:2.0:1787384349.624317:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384349.624333:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c20d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874208203234048:0@lo:400: 00000100:00100000:2.0:1787384349.624352:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384349.624378:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203233408 00000100:00100000:2.0:1787384349.624385:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203233408 00000100:00100000:2.0:1787384349.624415:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203233920 00000100:00100000:2.0:1787384349.624418:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203233920 00000100:00100000:2.0:1787384349.624449:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203233664 00000100:00100000:2.0:1787384349.624452:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203233664 00000100:00100000:2.0:1787384349.624466:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203234048 00000100:00100000:2.0:1787384349.624468:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203234048 00000100:00100000:2.0:1787384349.624483:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787384349.624490:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874208203233408:12345-0@lo:400: 00000100:00100000:2.0:1787384349.624536:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874208203233408:12345-0@lo:400: Request processed in 45us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384349.624542:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787384349.624559:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787384349.624565:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874208203233920:12345-0@lo:400: 00000100:00100000:2.0:1787384349.624589:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874208203233920:12345-0@lo:400: Request processed in 25us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384349.624594:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787384349.624604:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787384349.624609:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874208203233664:12345-0@lo:400: 00000100:00100000:2.0:1787384349.624637:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874208203233664:12345-0@lo:400: Request processed in 27us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384349.624642:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787384349.624653:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787384349.624660:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874208203234048:12345-0@lo:400: 00000100:00100000:2.0:1787384349.624695:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874208203234048:12345-0@lo:400: Request processed in 36us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384349.624701:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787384349.624724:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203233792 00000100:00100000:2.0:1787384349.624727:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203233792 00000100:00100000:2.0:1787384349.624748:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203233536 00000100:00100000:2.0:1787384349.624751:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203233536 00000100:00100000:2.0:1787384349.624763:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787384349.624768:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203233792:12345-0@lo:400: 00000100:00100000:2.0:1787384349.624822:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203233792:12345-0@lo:400: Request processed in 53us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384349.624828:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787384349.624840:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787384349.624847:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203233536:12345-0@lo:400: 00000100:00100000:2.0:1787384349.624873:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203233536:12345-0@lo:400: Request processed in 27us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384349.624879:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787384349.624921:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c20d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203233792:0@lo:400: 00010000:00080000:2.0:1787384349.624935:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f7c20d0000 x1874208203233408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384349.624944:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c20d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874208203233408:0@lo:400: 00010000:00080000:2.0:1787384349.624955:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f7c20d1f80 x1874208203233920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384349.624963:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c20d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874208203233920:0@lo:400: 00000100:00100000:2.0:1787384349.624995:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c20d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203233536:0@lo:400: 00010000:00080000:2.0:1787384349.625014:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f7c20d1180 x1874208203234048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384349.625023:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c20d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874208203234048:0@lo:400: 00010000:00080000:2.0:1787384349.625032:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f7c20d3100 x1874208203233664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384349.625040:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c20d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874208203233664:0@lo:400: 00000100:00100000:1.0:1787384349.625354:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203233280 00000100:00100000:1.0:1787384349.625359:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203233280 00000100:00100000:1.0:1787384349.625394:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787384349.625401:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+14:3654:x1874208203233280:12345-0@lo:400: 00000100:00100000:1.0:1787384349.625444:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+14:3654:x1874208203233280:12345-0@lo:400: Request processed in 43us (1297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384349.625450:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787384349.625483:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c20d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203233280:0@lo:400: 00000100:00080000:1.0:1787384349.625915:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787384349.625921:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787384349.628587:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384349.630571:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787384349.630596:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c20d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203234176:0@lo:41: 00000100:00100000:0.0:1787384349.630665:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384349.631230:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203234176 00000100:00100000:2.0:1787384349.631238:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203234176 00000100:00100000:2.0:1787384349.631292:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787384349.631311:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203234176:12345-0@lo:41: 00000004:00000024:2.0:1787384349.631344:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1787384349.631399:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203234176:12345-0@lo:41: Request processed in 99us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384349.631406:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787384349.631542:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c20d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203234176:0@lo:41: 00000100:00100000:1.0:1787384350.140856:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203234304:0@lo:41: 00000100:00100000:1.0:1787384350.140929:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384350.141293:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203234304 00000100:00100000:3.0:1787384350.141301:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203234304 00000100:00100000:3.0:1787384350.145577:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787384350.145593:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203234304:12345-0@lo:41: 00000004:00000024:3.0:1787384350.145632:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:3.0:1787384350.145718:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203234304:12345-0@lo:41: Request processed in 130us (4788us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384350.145725:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787384350.147657:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203234304:0@lo:41: 00000001:02000400:3.0:1787384350.307681:0:8805:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg345-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787384350.648879:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787384351.187186:0:8857:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787384351.187389:0:8857:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1787384351.671162:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787384351.671169:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98f8f5698000 from 30 10000000:01000000:3.0:1787384351.671174:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787384351.671216:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8cad38a00/0x7ef423838fba25ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.671227:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8cad38a00/0x7ef423838fba25ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.671238:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8cad38a00/0x7ef423838fba25ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384351.671271:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203234432:0@lo:101: 00000100:00100000:3.0:1787384351.671339:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384351.671401:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d82933c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787384351.671510:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384351.672826:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203234432 00000100:00100000:2.0:1787384351.672837:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203234432 00000100:00100000:2.0:1787384351.672897:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787384351.672906:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+14:6519:x1874208203234432:12345-0@lo:101: 00010000:00010000:2.0:1787384351.672920:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384351.672934:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8f58cde00/0x7ef423838fba25b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba25ae expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384351.672956:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f58cde00/0x7ef423838fba25b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba25ae expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384351.672967:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8f58cde00/0x7ef423838fba25b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba25ae expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384351.672992:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cde00, rc 0) 00000100:00100000:2.0:1787384351.673053:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+15:6519:x1874208203234432:12345-0@lo:101: Request processed in 148us (1714us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384351.673060:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787384351.673267:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203234432:0@lo:101: 00010000:00010000:3.0:1787384351.673282:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8cad38a00/0x7ef423838fba25ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba25b5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.673291:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8cad38a00/0x7ef423838fba25ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba25b5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384351.673360:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203234560:0@lo:501: 00000100:00100000:3.0:1787384351.673402:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384351.673438:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d82933c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384351.673804:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203234560 00000100:00100000:2.0:1787384351.673810:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203234560 00000100:00100000:2.0:1787384351.673847:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787384351.673855:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+15:6519:x1874208203234560:12345-0@lo:501: 00000100:00100000:2.0:1787384351.673978:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+15:6519:x1874208203234560:12345-0@lo:501: Request processed in 123us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384351.673984:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787384351.674085:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203234560:0@lo:501: 00000100:00100000:0.0:1787384351.674117:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203234688:0@lo:503: 00000100:00100000:0.0:1787384351.674162:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384351.674179:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fd4b7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787384351.674229:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203234688 00000100:00100000:1.0:1787384351.674234:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203234688 00000100:00100000:1.0:1787384351.674272:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787384351.674279:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+15:6519:x1874208203234688:12345-0@lo:503: 00000100:00100000:1.0:1787384351.674362:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+15:6519:x1874208203234688:12345-0@lo:503: Request processed in 83us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384351.674376:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787384351.674505:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203234688:0@lo:503: 00000100:00100000:1.0:1787384351.687883:0:8878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:8878:1874208203234816:0@lo:502: 00000100:00100000:1.0:1787384351.687964:0:8878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384351.688007:0:8878:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c6361180 going to sleep for 11 seconds 00000100:00100000:2.0:1787384351.688050:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203234816 00000100:00100000:2.0:1787384351.688058:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203234816 00000100:00100000:2.0:1787384351.688113:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787384351.688124:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+15:8878:x1874208203234816:12345-0@lo:502: 00000100:00100000:2.0:1787384351.688289:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+15:8878:x1874208203234816:12345-0@lo:502: Request processed in 166us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384351.688297:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787384351.688398:0:8878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:8878:1874208203234816:0@lo:502: 00000100:00100000:3.0:1787384351.688452:0:8878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:8878:1874208203234944:0@lo:502: 00000100:00100000:3.0:1787384351.688488:0:8878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384351.688518:0:8878:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8293780 going to sleep for 11 seconds 00000100:00100000:2.0:1787384351.688731:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203234944 00000100:00100000:2.0:1787384351.688736:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203234944 00000100:00100000:2.0:1787384351.688769:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787384351.688796:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+15:8878:x1874208203234944:12345-0@lo:502: 00000100:00100000:3.0:1787384351.689162:0:8878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:8878:1874208203234944:0@lo:502: 00000040:00080000:3.0:1787384351.689186:0:8878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787384351.689424:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787384351.689445:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787384351.689455:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8cad38a00/0x7ef423838fba25ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba25b5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.689467:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8cad38a00/0x7ef423838fba25ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba25b5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384351.689476:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787384351.689479:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98f8f5698000 from 5 10000000:01000000:3.0:1787384351.689482:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787384351.689511:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8cad39800/0x7ef423838fba25bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.689520:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8cad39800/0x7ef423838fba25bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.689528:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8cad39800/0x7ef423838fba25bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384351.689544:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203235072:0@lo:101: 00000100:00100000:3.0:1787384351.689621:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384351.689647:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8293780 going to sleep for 11 seconds 00000100:00100000:3.0:1787384351.689661:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203235072 00000100:00100000:3.0:1787384351.689671:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203235072 00000100:00100000:3.0:1787384351.689709:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787384351.689716:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cacee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+16:6519:x1874208203235072:12345-0@lo:101: 00010000:00010000:3.0:1787384351.689723:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384351.689734:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8cad39a00/0x7ef423838fba25c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba25bc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.689754:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8cad39a00/0x7ef423838fba25c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba25bc expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.689764:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8cad39a00/0x7ef423838fba25c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba25bc expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.689772:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8cad39a00, rc 0) 00000100:00100000:3.0:1787384351.689831:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cacee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+17:6519:x1874208203235072:12345-0@lo:101: Request processed in 114us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384351.689838:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787384351.689873:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203235072:0@lo:101: 00010000:00010000:3.0:1787384351.689884:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8cad39800/0x7ef423838fba25bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba25c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.689892:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8cad39800/0x7ef423838fba25bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba25c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384351.689935:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203235200:0@lo:256: 00000100:00100000:3.0:1787384351.689965:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384351.689984:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8293780 going to sleep for 11 seconds 00000100:00100000:3.0:1787384351.689994:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203235200 00000100:00100000:3.0:1787384351.689997:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203235200 00000100:00100000:3.0:1787384351.690023:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787384351.690030:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cacecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+17:6519:x1874208203235200:12345-0@lo:256: 20000000:01000000:3.0:1787384351.690043:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787384351.690059:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787384351.690062:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1787384351.690141:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cacecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+17:6519:x1874208203235200:12345-0@lo:256: Request processed in 111us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384351.690148:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787384351.690180:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203235200:0@lo:256: 10000000:01000000:3.0:1787384351.690230:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787384351.690235:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8cad39800/0x7ef423838fba25bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba25c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.690252:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8cad39800/0x7ef423838fba25bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba25c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384351.690259:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1787384351.690260:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:3.0:1787384351.690262:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787384351.690287:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8cad38200/0x7ef423838fba25ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.690294:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8cad38200/0x7ef423838fba25ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.690300:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8cad38200/0x7ef423838fba25ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384351.690312:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203235328:0@lo:101: 00000100:00100000:3.0:1787384351.690347:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384351.690360:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8293780 going to sleep for 11 seconds 00000100:00100000:3.0:1787384351.690371:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203235328 00000100:00100000:3.0:1787384351.690374:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203235328 00000100:00100000:3.0:1787384351.690391:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787384351.690397:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cacec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+17:6519:x1874208203235328:12345-0@lo:101: 00010000:00010000:3.0:1787384351.690403:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384351.690410:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8cad38400/0x7ef423838fba25d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba25ca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.690424:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8cad38400/0x7ef423838fba25d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba25ca expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.690431:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8cad38400/0x7ef423838fba25d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba25ca expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.690437:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8cad38400, rc 0) 00000100:00100000:3.0:1787384351.690466:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cacec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+18:6519:x1874208203235328:12345-0@lo:101: Request processed in 68us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384351.690472:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787384351.690502:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203235328:0@lo:101: 00010000:00010000:3.0:1787384351.690512:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8cad38200/0x7ef423838fba25ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba25d1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.690520:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8cad38200/0x7ef423838fba25ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba25d1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384351.690562:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203235456:0@lo:501: 00000100:00100000:3.0:1787384351.690593:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384351.690606:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8293780 going to sleep for 11 seconds 00000100:00100000:3.0:1787384351.690617:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203235456 00000100:00100000:3.0:1787384351.690620:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203235456 00000100:00100000:3.0:1787384351.690637:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787384351.690643:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+18:6519:x1874208203235456:12345-0@lo:501: 00000100:00100000:3.0:1787384351.690743:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+18:6519:x1874208203235456:12345-0@lo:501: Request processed in 100us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384351.690749:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787384351.690800:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203235456:0@lo:501: 00000100:00100000:3.0:1787384351.690824:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203235584:0@lo:503: 00000100:00100000:3.0:1787384351.690856:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384351.690868:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8293780 going to sleep for 11 seconds 00000100:00100000:3.0:1787384351.690877:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203235584 00000100:00100000:3.0:1787384351.690880:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203235584 00000100:00100000:3.0:1787384351.690895:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787384351.690900:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+18:6519:x1874208203235584:12345-0@lo:503: 00000100:00100000:3.0:1787384351.690971:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+18:6519:x1874208203235584:12345-0@lo:503: Request processed in 70us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384351.690977:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787384351.691010:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203235584:0@lo:503: 00000100:00100000:2.0:1787384351.691697:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+17:8878:x1874208203234944:12345-0@lo:502: Request processed in 2919us (3207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384351.691705:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787384351.692003:0:8880:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:8880:1874208203235712:0@lo:502: 00000100:00100000:1.0:1787384351.692061:0:8880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384351.692124:0:8880:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d931d000 going to sleep for 11 seconds 00000100:00100000:3.0:1787384351.692164:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203235712 00000100:00100000:3.0:1787384351.692170:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203235712 00000100:00100000:3.0:1787384351.692364:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787384351.692374:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+17:8880:x1874208203235712:12345-0@lo:502: 00000100:00100000:3.0:1787384351.692515:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+17:8880:x1874208203235712:12345-0@lo:502: Request processed in 143us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384351.692528:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787384351.692609:0:8880:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:8880:1874208203235712:0@lo:502: 00000020:01000000:2.0:1787384351.692635:0:8880:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787384351.692642:0:8880:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787384351.692648:0:8880:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384351.692650:0:8880:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787384351.692657:0:8880:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787384351.692661:0:8880:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.145@tcp to nid 0x20000c0a8cb91 (192.168.203.145@tcp) 00000020:01000000:2.0:1787384351.692682:0:8880:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787384351.692685:0:8880:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787384351.692698:0:8880:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff98f8f9688000) 00000020:00000080:2.0:1787384351.692717:0:8880:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1787384351.692723:0:8880:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787384351.692892:0:8880:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1787384351.692900:0:8880:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787384351.692907:0:8880:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7ef423838fba25df 00010000:00080000:2.0:1787384351.692935:0:8880:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f8d969a800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.145@tcp at head 00010000:00010000:2.0:1787384351.693134:0:8880:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1787384351.705229:0:8880:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787384351.705274:0:8880:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1787384351.705469:0:8880:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787384351.705753:0:8880:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787384351.706715:0:8880:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1787384351.706911:0:8880:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1787384351.708300:0:8881:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787384351.708306:0:8881:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787384351.710668:0:8880:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787384351.710756:0:8880:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787384351.710907:0:8880:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787384351.710932:0:8880:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7ef423838fba25e6 00000100:00080000:0.0:1787384351.710942:0:8880:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787384351.710948:0:8880:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff98f8d969a800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:0.0:1787384351.710981:0:8880:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f9149880 x1874208203235840/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787384351.711001:0:8880:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787384351.711056:0:8880:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384351.711060:0:8880:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384351.711062:0:8880:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787384351.711065:0:8880:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787384351.711074:0:8880:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384351.711076:0:8880:0:(obd_config.c:1561:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787384351.711079:0:8880:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787384351.711081:0:8880:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787384351.711107:0:8880:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:8880:1874208203235968:0@lo:502: 00000100:00100000:0.0:1787384351.711177:0:8880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384351.711210:0:8880:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fd4b7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787384351.711343:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203236480:0@lo:400: 00000100:00100000:1.0:1787384351.711374:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384351.711400:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787384351.711406:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203236096:0@lo:400: 00000100:00100000:1.0:1787384351.711429:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384351.711444:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203236608:0@lo:400: 00000100:00100000:1.0:1787384351.711470:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384351.711491:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203236224:0@lo:400: 00000100:00100000:1.0:1787384351.711511:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384351.711525:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874208203236736:0@lo:400: 00000100:00100000:1.0:1787384351.711564:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384351.711582:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787384351.711587:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203236352:0@lo:400: 00000100:00100000:1.0:1787384351.711605:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384351.711631:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203236480 00000100:00100000:1.0:1787384351.711636:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203236480 00000100:00100000:1.0:1787384351.711666:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203236224 00000100:00100000:1.0:1787384351.711668:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203236224 00000100:00100000:1.0:1787384351.711751:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787384351.711759:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203236480:12345-0@lo:400: 00000100:00100000:1.0:1787384351.712079:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203236480:12345-0@lo:400: Request processed in 319us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384351.712091:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787384351.712107:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787384351.712113:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203236224:12345-0@lo:400: 00000100:00100000:1.0:1787384351.712140:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203236224:12345-0@lo:400: Request processed in 28us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384351.712145:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787384351.712159:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203236096 00000100:00100000:1.0:1787384351.712163:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203236096 00000100:00100000:1.0:1787384351.712177:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203236608 00000100:00100000:1.0:1787384351.712179:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203236608 00000100:00100000:1.0:1787384351.712194:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203236736 00000100:00100000:1.0:1787384351.712196:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203236736 00000100:00100000:1.0:1787384351.712204:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203236352 00000100:00100000:1.0:1787384351.712206:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203236352 00000100:00100000:1.0:1787384351.712217:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787384351.712221:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203236096:12345-0@lo:400: 00000100:00100000:1.0:1787384351.712258:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203236096:12345-0@lo:400: Request processed in 36us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384351.712263:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787384351.712273:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787384351.712279:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203236608:12345-0@lo:400: 00000100:00100000:1.0:1787384351.712300:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203236608:12345-0@lo:400: Request processed in 22us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384351.712305:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787384351.712313:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787384351.712318:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee289f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874208203236736:12345-0@lo:400: 00000100:00100000:1.0:1787384351.712336:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee289f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874208203236736:12345-0@lo:400: Request processed in 19us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384351.712346:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787384351.712356:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787384351.712360:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee289180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203236352:12345-0@lo:400: 00000100:00100000:1.0:1787384351.712384:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee289180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203236352:12345-0@lo:400: Request processed in 23us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384351.712389:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1787384351.712430:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787384351.712433:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787384351.712454:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8fc1b6a00 x1874208203236352/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384351.712467:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203236352:0@lo:400: 00000100:00100000:1.0:1787384351.712475:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203236224:0@lo:400: 00010000:00080000:1.0:1787384351.712483:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8fc1b4700 x1874208203236736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384351.712490:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874208203236736:0@lo:400: 00010000:00080000:1.0:1787384351.712515:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8fc1b7100 x1874208203236096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384351.712523:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203236096:0@lo:400: 00010000:00080000:1.0:1787384351.712531:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8fc1b7800 x1874208203236608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384351.712539:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203236608:0@lo:400: 00000100:00100000:1.0:1787384351.712548:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203236480:0@lo:400: 00000100:00100000:2.0:1787384351.712958:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203235840:0@lo:8: 00000100:00100000:2.0:1787384351.712995:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384351.713029:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203235968 00000100:00100000:2.0:1787384351.713033:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203235968 00000100:00100000:2.0:1787384351.713058:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787384351.713064:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+17:8880:x1874208203235968:12345-0@lo:502: 00000100:00100000:2.0:1787384351.713163:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+17:8880:x1874208203235968:12345-0@lo:502: Request processed in 98us (1986us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384351.713170:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787384351.713407:0:8880:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:8880:1874208203235968:0@lo:502: 00000020:01000000:0.0:1787384351.713432:0:8880:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384351.713439:0:8880:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384351.713441:0:8880:0:(obd_config.c:1561:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787384351.713444:0:8880:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:2.0:1787384351.713760:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:2.0:1787384351.713806:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787384351.713816:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8cad38200/0x7ef423838fba25ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba25d1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384351.713832:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8cad38200/0x7ef423838fba25ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba25d1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384351.713841:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787384351.713844:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98f8c896e000 from 30 10000000:01000000:2.0:1787384351.713846:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787384351.713872:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cda00/0x7ef423838fba25ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384351.713881:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8f58cda00/0x7ef423838fba25ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384351.713889:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8f58cda00/0x7ef423838fba25ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384351.713903:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c20d2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203236864:0@lo:101: 00000100:00100000:2.0:1787384351.713932:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384351.713955:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f57699c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384351.714886:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203236864 00000100:00100000:0.0:1787384351.714895:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203236864 00000100:00100000:0.0:1787384351.714935:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787384351.714944:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+17:6519:x1874208203236864:12345-0@lo:101: 00010000:00010000:0.0:1787384351.714955:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384351.714969:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8f5824000/0x7ef423838fba25f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba25ed expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384351.714991:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f5824000/0x7ef423838fba25f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba25ed expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384351.715002:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8f5824000/0x7ef423838fba25f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba25ed expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384351.715010:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f5824000, rc 0) 00000100:00100000:0.0:1787384351.715059:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+18:6519:x1874208203236864:12345-0@lo:101: Request processed in 116us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384351.715066:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787384351.715118:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c20d2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203236864:0@lo:101: 00010000:00010000:0.0:1787384351.715132:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8f58cda00/0x7ef423838fba25ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba25f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384351.715141:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8f58cda00/0x7ef423838fba25ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba25f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384351.715196:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203236992:0@lo:501: 00000100:00100000:0.0:1787384351.715224:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384351.715256:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fd4b7780 going to sleep for 11 seconds 00000100:00100000:0.0:1787384351.715268:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203236992 00000100:00100000:0.0:1787384351.715271:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203236992 00000100:00100000:0.0:1787384351.715288:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787384351.715293:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+18:6519:x1874208203236992:12345-0@lo:501: 00000100:00100000:0.0:1787384351.715397:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+18:6519:x1874208203236992:12345-0@lo:501: Request processed in 102us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384351.715403:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787384351.715431:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203236992:0@lo:501: 00000100:00100000:0.0:1787384351.715455:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203237120:0@lo:503: 00000100:00100000:0.0:1787384351.715490:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384351.715503:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fd4b7780 going to sleep for 11 seconds 00000100:00100000:0.0:1787384351.715515:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203237120 00000100:00100000:0.0:1787384351.715519:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203237120 00000100:00100000:0.0:1787384351.715537:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787384351.715543:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+18:6519:x1874208203237120:12345-0@lo:503: 00000100:00100000:0.0:1787384351.715618:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+18:6519:x1874208203237120:12345-0@lo:503: Request processed in 74us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384351.715633:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787384351.715669:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203237120:0@lo:503: 00000100:00100000:1.0:1787384351.715889:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203235840 00000100:00100000:1.0:1787384351.715900:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203235840 00000100:00100000:1.0:1787384351.715921:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787384351.715926:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3650:x1874208203235840:12345-0@lo:8: 00010000:00080000:1.0:1787384351.715946:0:8435:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:1.0:1787384351.715970:0:8435:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7ef423838fba25fb 00002000:00100000:1.0:1787384351.716007:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff98f8ee314000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113671 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1787384351.716011:0:8435:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:1.0:1787384351.716014:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1787384351.716062:0:8435:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787384351.716257:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1787384351.716280:0:8435:0:(import.c:65:import_set_state_nolock()) ffff98f8ee311000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787384351.716331:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1874208203235840:12345-0@lo:8: Request processed in 403us (3334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384351.716337:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787384351.716388:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f9149880 x1874208203235840/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787384361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384351.716399:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787384351.716404:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1787384351.716411:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787384351.716417:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787384351.716419:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8d969a800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787384351.716431:0:3650:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787384351.716435:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203235840:0@lo:8: 00000100:00100000:2.0:1787384351.718211:0:8883:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c20d1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8883:1874208203237248:0@lo:700: 00000100:00100000:2.0:1787384351.718273:0:8883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384351.718299:0:8883:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f5769240 going to sleep for 11 seconds 00000100:00100000:1.0:1787384351.718937:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203237248 00000100:00100000:1.0:1787384351.718945:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203237248 00000100:00100000:1.0:1787384351.719010:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787384351.719020:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8883:x1874208203237248:12345-0@lo:700: 00000100:00100000:1.0:1787384351.719067:0:8445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee288a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8445:1874208203237376:0@lo:700: 00000100:00100000:1.0:1787384351.719101:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384351.719122:0:8445:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7d08000 going to sleep for 11 seconds 00000100:00100000:1.0:1787384351.719138:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203237376 00000100:00100000:1.0:1787384351.719140:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203237376 00000100:00100000:1.0:1787384351.719163:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787384351.719169:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8445:x1874208203237376:12345-0@lo:700: 00000004:00080000:0.0:1787384351.719457:0:8881:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787384351.719515:0:8881:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 246799736224ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787384351.719523:0:8881:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00080000:2.0:1787384351.719757:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787384351.721259:0:8884:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee289c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:8884:1874208203237504:0@lo:502: 00000100:00100000:1.0:1787384351.721332:0:8884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384351.721376:0:8884:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7d08a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787384351.721897:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203237504 00000100:00100000:0.0:1787384351.721904:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203237504 00000100:00100000:0.0:1787384351.721947:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787384351.721955:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+18:8884:x1874208203237504:12345-0@lo:502: 00000100:00100000:0.0:1787384351.722094:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+18:8884:x1874208203237504:12345-0@lo:502: Request processed in 140us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384351.722102:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787384351.722837:0:8884:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee289c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:8884:1874208203237504:0@lo:502: 00000100:00100000:2.0:1787384351.722905:0:8884:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c20d2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:8884:1874208203237632:0@lo:502: 00000100:00100000:2.0:1787384351.722950:0:8884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384351.722980:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203237632 00000100:00100000:2.0:1787384351.722983:0:8884:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f57699c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384351.722988:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203237632 00000100:00100000:3.0:1787384351.723037:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787384351.723045:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+18:8884:x1874208203237632:12345-0@lo:502: 00000100:00100000:3.0:1787384351.723131:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+18:8884:x1874208203237632:12345-0@lo:502: Request processed in 86us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384351.723138:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787384351.723236:0:8884:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c20d2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:8884:1874208203237632:0@lo:502: 00000040:00080000:2.0:1787384351.723270:0:8884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787384351.723678:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787384351.723703:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787384351.723711:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cda00/0x7ef423838fba25ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba25f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.723722:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8f58cda00/0x7ef423838fba25ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba25f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384351.723731:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787384351.723734:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98f8c896e000 from 5 10000000:01000000:3.0:1787384351.723737:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787384351.723762:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8cad38c00/0x7ef423838fba2602 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.723771:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8cad38c00/0x7ef423838fba2602 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.723806:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8cad38c00/0x7ef423838fba2602 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384351.724336:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203237760:0@lo:101: 00000100:00100000:3.0:1787384351.724386:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384351.724470:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c6361180 going to sleep for 11 seconds 00000100:00100000:2.0:1787384351.730011:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203237760 00000100:00100000:2.0:1787384351.730023:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203237760 00000100:00100000:2.0:1787384351.730076:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787384351.730088:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+18:6519:x1874208203237760:12345-0@lo:101: 00010000:00010000:2.0:1787384351.730105:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384351.730123:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8f58cdc00/0x7ef423838fba2609 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba2602 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384351.730151:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f58cdc00/0x7ef423838fba2609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba2602 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384351.730164:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8f58cdc00/0x7ef423838fba2609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2602 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384351.730173:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cdc00, rc 0) 00000100:00100000:2.0:1787384351.730256:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+19:6519:x1874208203237760:12345-0@lo:101: Request processed in 157us (5854us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384351.730263:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787384351.730361:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203237760:0@lo:101: 00010000:00010000:3.0:1787384351.730380:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8cad38c00/0x7ef423838fba2602 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2609 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.730390:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8cad38c00/0x7ef423838fba2602 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2609 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384351.730457:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203237888:0@lo:256: 00000100:00100000:3.0:1787384351.730498:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384351.730538:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c6361180 going to sleep for 11 seconds 00000004:00080000:0.0:1787384351.731010:0:7452:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 40000000:02000000:0.0:1787384351.731196:0:6528:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:2.0:1787384351.734809:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203237888 00000100:00100000:2.0:1787384351.734833:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203237888 00000100:00100000:2.0:1787384351.734890:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787384351.734900:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+19:6519:x1874208203237888:12345-0@lo:256: 20000000:01000000:2.0:1787384351.734924:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787384351.734948:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787384351.734951:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1787384351.735073:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+19:6519:x1874208203237888:12345-0@lo:256: Request processed in 174us (4573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384351.735080:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787384351.735138:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203237888:0@lo:256: 10000000:01000000:2.0:1787384351.735188:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787384351.735197:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8cad38c00/0x7ef423838fba2602 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2609 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384351.735206:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8cad38c00/0x7ef423838fba2602 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2609 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384351.735215:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787384351.735217:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1787384351.735220:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787384351.735260:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58ccc00/0x7ef423838fba2610 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384351.735268:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8f58ccc00/0x7ef423838fba2610 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384351.735277:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8f58ccc00/0x7ef423838fba2610 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384351.735295:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c20d2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203238016:0@lo:101: 00000100:00100000:2.0:1787384351.735327:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384351.735358:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c6361180 going to sleep for 11 seconds 00000100:00100000:2.0:1787384351.735376:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203238016 00000100:00100000:2.0:1787384351.735379:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203238016 00000100:00100000:2.0:1787384351.735405:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787384351.735412:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+19:6519:x1874208203238016:12345-0@lo:101: 00010000:00010000:2.0:1787384351.735421:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384351.735432:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8f58cd400/0x7ef423838fba2617 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba2610 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384351.735461:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f58cd400/0x7ef423838fba2617 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba2610 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384351.735471:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8f58cd400/0x7ef423838fba2617 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2610 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384351.735480:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cd400, rc 0) 00000100:00100000:2.0:1787384351.735513:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+20:6519:x1874208203238016:12345-0@lo:101: Request processed in 101us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384351.735519:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787384351.735553:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c20d2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203238016:0@lo:101: 00010000:00010000:2.0:1787384351.735564:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8f58ccc00/0x7ef423838fba2610 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2617 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384351.735572:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8f58ccc00/0x7ef423838fba2610 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2617 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384351.735627:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c20d2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203238144:0@lo:501: 00000100:00100000:2.0:1787384351.735654:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384351.735667:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c6361180 going to sleep for 11 seconds 00000100:00100000:2.0:1787384351.735678:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203238144 00000100:00100000:2.0:1787384351.735681:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203238144 00000100:00100000:2.0:1787384351.735704:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787384351.735711:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+20:6519:x1874208203238144:12345-0@lo:501: 00000100:00100000:2.0:1787384351.735843:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+20:6519:x1874208203238144:12345-0@lo:501: Request processed in 132us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384351.735850:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787384351.735892:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c20d2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203238144:0@lo:501: 00000100:00100000:2.0:1787384351.735917:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c20d2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203238272:0@lo:503: 00000100:00100000:2.0:1787384351.735960:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384351.735975:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c6361180 going to sleep for 11 seconds 00000100:00100000:2.0:1787384351.735986:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203238272 00000100:00100000:2.0:1787384351.735989:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203238272 00000100:00100000:2.0:1787384351.736009:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787384351.736016:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+20:6519:x1874208203238272:12345-0@lo:503: 00000100:00100000:2.0:1787384351.736094:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+20:6519:x1874208203238272:12345-0@lo:503: Request processed in 78us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384351.736100:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787384351.736138:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c20d2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203238272:0@lo:503: 00000100:00100000:2.0:1787384351.736320:0:8886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c20d2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:8886:1874208203238400:0@lo:502: 00000100:00100000:2.0:1787384351.736352:0:8886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384351.736368:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203238400 00000100:00100000:2.0:1787384351.736372:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203238400 00000100:00100000:2.0:1787384351.736393:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787384351.736399:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+20:8886:x1874208203238400:12345-0@lo:502: 00000100:00100000:2.0:1787384351.736467:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+20:8886:x1874208203238400:12345-0@lo:502: Request processed in 68us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384351.736473:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787384351.736502:0:8886:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d817d780 going to sleep for 11 seconds 00000100:00100000:2.0:1787384351.736513:0:8886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c20d2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:8886:1874208203238400:0@lo:502: 00000020:01000000:2.0:1787384351.736532:0:8886:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787384351.736539:0:8886:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787384351.736544:0:8886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384351.736553:0:8886:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787384351.736559:0:8886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787384351.736564:0:8886:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.145@tcp to nid 0x20000c0a8cb91 (192.168.203.145@tcp) 00000020:01000000:2.0:1787384351.736583:0:8886:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787384351.736586:0:8886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787384351.736606:0:8886:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff98f8f7d319c0) 00000020:00000080:2.0:1787384351.736629:0:8886:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1787384351.736635:0:8886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787384351.736722:0:8886:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787384351.736728:0:8886:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787384351.736735:0:8886:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7ef423838fba2625 00010000:00080000:2.0:1787384351.736762:0:8886:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f8f7d42000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.145@tcp at head 00010000:00010000:2.0:1787384351.737037:0:8886:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000040:01000000:2.0:1787384351.750315:0:8886:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787384351.750341:0:8886:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787384351.750547:0:8886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787384351.750967:0:8886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787384351.751073:0:8886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1787384351.751189:0:8886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000100:00100000:0.0:1787384351.751600:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8445:x1874208203237376:12345-0@lo:700: Request processed in 32425us (32493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384351.751616:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000040:00080000:0.0:1787384351.752434:0:8887:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787384351.752439:0:8887:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787384351.758221:0:8886:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787384351.758235:0:8886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787384351.758288:0:8886:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787384351.758311:0:8886:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7ef423838fba262c 00000100:00080000:1.0:1787384351.758320:0:8886:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787384351.758327:0:8886:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98f8f7d42000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:1.0:1787384351.758371:0:8886:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8ee28ad80 x1874208203238528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787384351.758396:0:8886:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787384351.758451:0:8886:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384351.758456:0:8886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384351.758458:0:8886:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787384351.758461:0:8886:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787384351.758465:0:8886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384351.758466:0:8886:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787384351.758469:0:8886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787384351.758471:0:8886:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787384351.758495:0:8886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee289880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:8886:1874208203238656:0@lo:502: 00000100:00100000:1.0:1787384351.758570:0:8886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384351.758622:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203238528:0@lo:8: 00000100:00100000:0.0:1787384351.758663:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384351.758761:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203238528 00000100:00100000:0.0:1787384351.758768:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203238528 00010000:00080000:3.0:1787384351.760857:0:8445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8ee288a80 x1874208203237376/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787384367 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384351.760874:0:8445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee288a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8445:1874208203237376:0@lo:700: 40000000:02000000:3.0:1787384351.760886:0:8445:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:0.0:1787384351.762844:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787384351.762856:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3650:x1874208203238528:12345-0@lo:8: 00010000:00080000:0.0:1787384351.762896:0:8438:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:0.0:1787384351.762944:0:8438:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7ef423838fba2633 00002000:00100000:0.0:1787384351.762961:0:8438:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff98f8ee258000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113671 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787384351.762965:0:8438:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787384351.762968:0:8438:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787384351.763038:0:8438:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787384351.763064:0:8438:0:(import.c:65:import_set_state_nolock()) ffff98f8ee258800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787384351.763146:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1874208203238528:12345-0@lo:8: Request processed in 290us (4483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384351.763154:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787384351.763212:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8ee28ad80 x1874208203238528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787384361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384351.763223:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787384351.763230:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787384351.763237:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787384351.763255:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787384351.763258:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f7d42000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787384351.763268:0:3650:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787384351.763274:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203238528:0@lo:8: 00000004:00080000:0.0:1787384351.763303:0:8887:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787384351.763350:0:8887:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 246843570891ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787384351.763356:0:8887:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1787384351.773880:0:8886:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8c06840 going to sleep for 11 seconds 00000100:00100000:2.0:1787384351.774065:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203238656 00000100:00100000:2.0:1787384351.774074:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203238656 00000100:00100000:2.0:1787384351.774133:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787384351.774142:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+20:8886:x1874208203238656:12345-0@lo:502: 00000100:00100000:2.0:1787384351.774558:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+20:8886:x1874208203238656:12345-0@lo:502: Request processed in 417us (15986us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384351.774565:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787384351.774800:0:8886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee289880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:8886:1874208203238656:0@lo:502: 00000020:01000000:1.0:1787384351.774833:0:8886:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384351.774840:0:8886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384351.774842:0:8886:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787384351.774846:0:8886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1787384351.774923:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1787384351.774946:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787384351.774958:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58ccc00/0x7ef423838fba2610 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2617 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384351.774969:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8f58ccc00/0x7ef423838fba2610 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2617 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384351.774985:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787384351.774988:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff98f8f96899c0 from 1 10000000:01000000:0.0:1787384351.774990:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787384351.775017:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f5824600/0x7ef423838fba263a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384351.775026:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8f5824600/0x7ef423838fba263a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384351.775034:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8f5824600/0x7ef423838fba263a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384351.775051:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203238784:0@lo:101: 00000100:00100000:0.0:1787384351.775087:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384351.775120:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fd4b7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787384351.775762:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203238784 00000100:00100000:1.0:1787384351.775769:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203238784 00000100:00100000:1.0:1787384351.775820:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787384351.775827:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+20:6519:x1874208203238784:12345-0@lo:101: 00010000:00010000:1.0:1787384351.775838:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384351.775851:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f902159400/0x7ef423838fba2641 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba263a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384351.775874:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f902159400/0x7ef423838fba2641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba263a expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384351.775884:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f902159400/0x7ef423838fba2641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba263a expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384351.775892:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f902159400, rc 0) 00000100:00100000:1.0:1787384351.775936:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+21:6519:x1874208203238784:12345-0@lo:101: Request processed in 109us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384351.775942:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787384351.775979:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203238784:0@lo:101: 00010000:00010000:1.0:1787384351.775992:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8f5824600/0x7ef423838fba263a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2641 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384351.776011:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8f5824600/0x7ef423838fba263a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2641 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384351.776062:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee289880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203238912:0@lo:501: 00000100:00100000:1.0:1787384351.776086:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384351.776100:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9462240 going to sleep for 11 seconds 00000100:00100000:1.0:1787384351.776112:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203238912 00000100:00100000:1.0:1787384351.776115:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203238912 00000100:00100000:1.0:1787384351.776136:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787384351.776142:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+21:6519:x1874208203238912:12345-0@lo:501: 00000100:00100000:1.0:1787384351.776207:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+21:6519:x1874208203238912:12345-0@lo:501: Request processed in 65us (120us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787384351.776214:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787384351.776250:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee289880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203238912:0@lo:501: 10000000:01000000:1.0:1787384351.776270:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787384351.776276:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f5824600/0x7ef423838fba263a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2641 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384351.776283:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8f5824600/0x7ef423838fba263a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2641 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1787384351.783718:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787384351.783730:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1787384351.785589:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8883:x1874208203237248:12345-0@lo:700: Request processed in 66563us (67308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384351.785602:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787384351.786621:0:8883:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f7c20d1f80 x1874208203237248/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787384367 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384351.786638:0:8883:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c20d1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8883:1874208203237248:0@lo:700: 00000004:00080000:0.0:1787384351.792975:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1787384351.793050:0:8888:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787384351.793074:0:8888:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8888:1874208203239168:0@lo:7: 00000100:00100000:0.0:1787384351.793134:0:8888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384351.793190:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203239168 00000100:00100000:0.0:1787384351.793454:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203239168 00000100:00100000:0.0:1787384351.793515:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787384351.793525:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9149180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8888:x1874208203239168:12345-0@lo:7: 00000100:00100000:1.0:1787384351.801848:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203239040:0@lo:13: 00000100:00100000:1.0:1787384351.801915:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1787384351.802663:0:8436:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1787384351.802670:0:8436:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787384351.802723:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9149180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8888:x1874208203239168:12345-0@lo:7: Request processed in 9197us (9587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384351.802732:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787384351.802766:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787384351.802851:0:8888:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fd4b76c0 going to sleep for 11 seconds 00010000:00080000:1.0:1787384351.802878:0:8888:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f9149c00 x1874208203239168/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787384367 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384351.802891:0:8888:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8888:1874208203239168:0@lo:7: 00000004:00080000:1.0:1787384351.802904:0:8888:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787384351.802939:0:8888:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee288380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8888:1874208203239296:0@lo:5: 00000100:00100000:1.0:1787384351.802966:0:8888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384351.802984:0:8888:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9462240 going to sleep for 11 seconds 00000100:00100000:0.0:1787384351.803008:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203239296 00000100:00100000:0.0:1787384351.803016:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203239296 00000100:00100000:0.0:1787384351.803062:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787384351.803070:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee28b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8888:x1874208203239296:12345-0@lo:5: 00002000:00080000:0.0:1787384351.803092:0:8435:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787384351.803096:0:8435:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787384351.803108:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203239040 00000100:00100000:3.0:1787384351.803113:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203239040 00000100:00100000:3.0:1787384351.803149:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787384351.803156:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1874208203239040:12345-0@lo:13: 00002000:00000024:3.0:1787384351.803172:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923808256 avail 3692285952 00000100:00100000:3.0:1787384351.803217:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1874208203239040:12345-0@lo:13: Request processed in 61us (1301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384351.803224:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787384351.803270:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f914a680 x1874208203239040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384367 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384351.803287:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203239040:0@lo:13: 00000100:00100000:0.0:1787384351.803650:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee28b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8888:x1874208203239296:12345-0@lo:5: Request processed in 580us (682us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787384351.803657:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787384351.803985:0:8888:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8ee288380 x1874208203239296/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787384367 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384351.803998:0:8888:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee288380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8888:1874208203239296:0@lo:5: 00000004:00080000:1.0:1787384351.804007:0:8888:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787384351.804032:0:8888:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee288700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8888:1874208203239424:0@lo:700: 00000100:00100000:1.0:1787384351.804058:0:8888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384351.804086:0:8888:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9462240 going to sleep for 11 seconds 00000100:00100000:3.0:1787384351.804804:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203239424 00000100:00100000:3.0:1787384351.804811:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203239424 00000100:00100000:3.0:1787384351.804847:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787384351.804855:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee28a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:8888:x1874208203239424:12345-0@lo:700: 00000001:00080000:3.0:1787384351.818457:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:3.0:1787384351.818579:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee28a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8888:x1874208203239424:12345-0@lo:700: Request processed in 13721us (14516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384351.818591:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000004:00080000:2.0:1787384351.819893:0:8883:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787384351.819900:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787384351.819922:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c20d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203239552:0@lo:13: 00000100:00100000:2.0:1787384351.819929:0:8883:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c20d2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8883:1874208203239680:0@lo:7: 00000100:00100000:0.0:1787384351.824318:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384351.824529:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203239552 00000100:00100000:0.0:1787384351.824538:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203239552 00000100:00100000:0.0:1787384351.824586:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787384351.824595:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203239552:12345-0@lo:13: 00002000:00000024:0.0:1787384351.824618:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923808256 avail 3692285952 00000100:00100000:0.0:1787384351.824672:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203239552:12345-0@lo:13: Request processed in 78us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384351.824679:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787384351.824723:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f7c20d1f80 x1874208203239552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384367 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384351.824741:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c20d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203239552:0@lo:13: 00010000:00080000:1.0:1787384351.824766:0:8888:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8ee288700 x1874208203239424/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787384367 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384351.824798:0:8888:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787384351.824811:0:8888:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee288700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8888:1874208203239424:0@lo:700: 00000004:02000040:3.0:1787384351.829103:0:8888:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:2.0:1787384351.833196:0:8883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384351.833253:0:8883:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d817df00 going to sleep for 11 seconds 00000100:00100000:1.0:1787384351.833905:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203239680 00000100:00100000:1.0:1787384351.833914:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203239680 00000100:00100000:1.0:1787384351.833956:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787384351.833965:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8883:x1874208203239680:12345-0@lo:7: 00000100:00100000:0.0:1787384351.835639:0:8888:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9148000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8888:1874208203239808:0@lo:5: 00000100:00100000:0.0:1787384351.835715:0:8888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384351.835806:0:8888:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fd4b7900 going to sleep for 11 seconds 00000100:00100000:3.0:1787384351.840665:0:8438:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787384351.840678:0:8438:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787384351.840916:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203239808 00000100:00100000:3.0:1787384351.840924:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203239808 00000100:00100000:3.0:1787384351.841025:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787384351.841035:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8888:x1874208203239808:12345-0@lo:5: 00002000:00080000:0.0:1787384351.846723:0:8436:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1787384351.846731:0:8436:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787384351.846843:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8883:x1874208203239680:12345-0@lo:7: Request processed in 12874us (13646us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384351.846853:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787384351.848854:0:8883:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f7c20d2a00 x1874208203239680/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787384367 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384351.848871:0:8883:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c20d2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8883:1874208203239680:0@lo:7: 00000004:00080000:2.0:1787384351.848885:0:8883:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:2.0:1787384351.848924:0:8883:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c20d2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8883:1874208203239936:0@lo:5: 00000100:00100000:2.0:1787384351.848979:0:8883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384351.849024:0:8883:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d817df00 going to sleep for 11 seconds 00000100:00100000:0.0:1787384351.849393:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203239936 00000100:00100000:0.0:1787384351.849400:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203239936 00000100:00100000:0.0:1787384351.849454:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787384351.849463:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8883:x1874208203239936:12345-0@lo:5: 00002000:00080000:0.0:1787384351.849544:0:8438:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1787384351.849595:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8883:x1874208203239936:12345-0@lo:5: Request processed in 133us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384351.849603:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787384351.849639:0:8883:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f7c20d2a00 x1874208203239936/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787384367 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384351.849650:0:8883:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c20d2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8883:1874208203239936:0@lo:5: 00000004:00080000:0.0:1787384351.849661:0:8883:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787384351.849691:0:8883:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8883:1874208203240064:0@lo:5: 00000100:00100000:0.0:1787384351.849720:0:8883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384351.849738:0:8883:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fd4b7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787384351.849753:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203240064 00000100:00100000:0.0:1787384351.849756:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203240064 00000100:00100000:0.0:1787384351.849812:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787384351.849822:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9149c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8883:x1874208203240064:12345-0@lo:5: 00002000:00080000:0.0:1787384351.849848:0:8438:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1787384351.853724:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9149c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8883:x1874208203240064:12345-0@lo:5: Request processed in 3898us (3997us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787384351.853739:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787384351.853865:0:8883:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f914a680 x1874208203240064/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787384367 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384351.853892:0:8883:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8883:1874208203240064:0@lo:5: 00000004:00080000:1.0:1787384351.853906:0:8883:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:1.0:1787384351.853944:0:8883:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee288700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8883:1874208203240192:0@lo:900: 00000100:00100000:1.0:1787384351.853978:0:8883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384351.854005:0:8883:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9462780 going to sleep for 11 seconds 00000100:00100000:1.0:1787384351.854025:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203240192 00000100:00100000:1.0:1787384351.854032:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203240192 00000100:00100000:1.0:1787384351.854070:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787384351.854077:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8883:x1874208203240192:12345-0@lo:900: 00000100:00100000:1.0:1787384351.854130:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8883:x1874208203240192:12345-0@lo:900: Request processed in 54us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384351.854137:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787384351.854195:0:8883:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8ee288700 x1874208203240192/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787384367 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384351.854206:0:8883:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee288700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8883:1874208203240192:0@lo:900: 00002000:00080000:3.0:1787384351.859816:0:8890:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1787384351.859837:0:8890:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:3.0:1787384351.863161:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8888:x1874208203239808:12345-0@lo:5: Request processed in 22122us (27441us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787384351.865265:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787384351.865422:0:8888:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f9148000 x1874208203239808/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787384367 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384351.865440:0:8888:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9148000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8888:1874208203239808:0@lo:5: 00000004:00080000:1.0:1787384351.865506:0:8888:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000001:00080000:2.0:1787384352.227937:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:2.0:1787384352.227956:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1787384352.697990:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384353.720534:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787384354.001633:0:8967:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787384354.001818:0:8967:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787384354.747998:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384354.750121:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c20d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203240320:0@lo:41: 00000100:00100000:1.0:1787384354.750249:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384354.750995:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203240320 00000100:00100000:2.0:1787384354.751006:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203240320 00000100:00100000:2.0:1787384354.751076:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787384354.751098:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203240320:12345-0@lo:41: 00000004:00000024:2.0:1787384354.751159:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1787384354.751389:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203240320:12345-0@lo:41: Request processed in 292us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384354.751398:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787384354.751914:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c20d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203240320:0@lo:41: 00000020:00000004:3.0:1787384355.040746:0:9016:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787384355.040760:0:9016:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:2.0:1787384355.256086:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787384355.256112:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203240448:0@lo:41: 00000100:00100000:2.0:1787384355.256178:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384355.256387:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203240448 00000100:00100000:3.0:1787384355.256397:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203240448 00000100:00100000:3.0:1787384355.256454:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787384355.256464:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203240448:12345-0@lo:41: 00000004:00000024:3.0:1787384355.256498:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1787384355.256553:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203240448:12345-0@lo:41: Request processed in 90us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384355.256560:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787384355.256734:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203240448:0@lo:41: 00010000:00010000:1.0:1787384355.768094:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384356.791025:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384356.791287:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203240960:0@lo:400: 00000100:00100000:1.0:1787384356.791403:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384356.791480:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203241472:0@lo:400: 00000100:00100000:1.0:1787384356.791513:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384356.791550:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787384356.791556:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203240576:0@lo:400: 00000100:00100000:1.0:1787384356.791587:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384356.791609:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203241088:0@lo:400: 00000100:00100000:1.0:1787384356.791634:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384356.791654:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203241600:0@lo:400: 00000100:00100000:1.0:1787384356.791676:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384356.791704:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203240704:0@lo:400: 00000100:00100000:1.0:1787384356.791728:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384356.791760:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee28aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203241216:0@lo:400: 00000100:00100000:1.0:1787384356.791837:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384356.791860:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787384356.791866:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203240832:0@lo:400: 00000100:00100000:1.0:1787384356.791889:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384356.791907:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee288700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203241344:0@lo:400: 00000100:00100000:1.0:1787384356.791939:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384356.791978:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203240960 00000100:00100000:1.0:1787384356.791989:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203240960 00000100:00100000:1.0:1787384356.792035:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203240704 00000100:00100000:1.0:1787384356.792039:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203240704 00000100:00100000:1.0:1787384356.792052:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203241216 00000100:00100000:1.0:1787384356.792055:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203241216 00000100:00100000:1.0:1787384356.792076:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203241344 00000100:00100000:1.0:1787384356.792079:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203241344 00000100:00100000:1.0:1787384356.792104:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787384356.792113:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203240960:12345-0@lo:400: 00000100:00100000:1.0:1787384356.792185:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203240960:12345-0@lo:400: Request processed in 71us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384356.792192:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787384356.792223:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787384356.792229:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203240704:12345-0@lo:400: 00000100:00100000:1.0:1787384356.792262:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203240704:12345-0@lo:400: Request processed in 34us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384356.792269:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787384356.792280:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787384356.792286:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203241216:12345-0@lo:400: 00000100:00100000:1.0:1787384356.792313:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203241216:12345-0@lo:400: Request processed in 27us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384356.792319:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787384356.792330:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787384356.792337:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee146a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203241344:12345-0@lo:400: 00000100:00100000:1.0:1787384356.792361:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee146a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203241344:12345-0@lo:400: Request processed in 25us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384356.792366:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787384356.792384:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203240576 00000100:00100000:1.0:1787384356.792387:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203240576 00000100:00100000:1.0:1787384356.792412:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787384356.792417:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+21:3651:x1874208203240576:12345-0@lo:400: 00000100:00100000:1.0:1787384356.792444:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+21:3651:x1874208203240576:12345-0@lo:400: Request processed in 27us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384356.792459:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787384356.792491:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203241088 00000100:00100000:1.0:1787384356.792495:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203241088 00000100:00100000:1.0:1787384356.792519:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203240832 00000100:00100000:1.0:1787384356.792522:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203240832 00000100:00100000:1.0:1787384356.792533:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787384356.792538:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203241088:12345-0@lo:400: 00000100:00100000:1.0:1787384356.792573:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203241088:12345-0@lo:400: Request processed in 34us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384356.792579:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787384356.792590:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787384356.792596:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203240832:12345-0@lo:400: 00000100:00100000:1.0:1787384356.792624:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203240832:12345-0@lo:400: Request processed in 28us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384356.792630:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787384356.792648:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203241472 00000100:00100000:1.0:1787384356.792652:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203241472 00000100:00100000:1.0:1787384356.792678:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203241600 00000100:00100000:1.0:1787384356.792682:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203241600 00000100:00100000:1.0:1787384356.792712:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787384356.792720:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203241472:12345-0@lo:400: 00000100:00100000:1.0:1787384356.792755:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203241472:12345-0@lo:400: Request processed in 37us (1242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384356.792761:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787384356.792773:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787384356.792810:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203241600:12345-0@lo:400: 00000100:00100000:1.0:1787384356.792840:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203241600:12345-0@lo:400: Request processed in 62us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384356.792854:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787384356.792925:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203240832:0@lo:400: 00010000:00080000:1.0:1787384356.792942:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8ee288700 x1874208203241344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384356.792954:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee288700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203241344:0@lo:400: 00010000:00080000:1.0:1787384356.792967:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8ee28bb80 x1874208203240704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384356.792976:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203240704:0@lo:400: 00010000:00080000:1.0:1787384356.792986:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8ee28aa00 x1874208203241216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384356.792995:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee28aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203241216:0@lo:400: 00000100:00100000:1.0:1787384356.793036:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203240576:0@lo:400: 00000100:00100000:1.0:1787384356.793048:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203241088:0@lo:400: 00010000:00080000:1.0:1787384356.793059:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8ee28ad80 x1874208203241600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384356.793068:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1787384356.793081:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203241600:0@lo:400: 00010000:00080000:1.0:1787384356.793094:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8ee28a300 x1874208203240960/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384356.793103:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203240960:0@lo:400: 00010000:00080000:1.0:1787384356.793113:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8ee288a80 x1874208203241472/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384356.793127:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787384356.793139:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203241472:0@lo:400: 00000100:00080000:0.0:1787384356.793538:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787384356.793545:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787384356.793548:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787384357.303230:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787384357.303271:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203241728:0@lo:13: 00000100:00100000:0.0:1787384357.303463:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384357.303547:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203241728 00000100:00100000:0.0:1787384357.303556:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203241728 00000100:00100000:0.0:1787384357.303610:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787384357.303619:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203241728:12345-0@lo:13: 00002000:00000024:0.0:1787384357.303652:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787384357.303698:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203241728:12345-0@lo:13: Request processed in 80us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384357.303706:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787384357.303752:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f9149880 x1874208203241728/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384357.303771:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203241728:0@lo:13: 00000100:00100000:2.0:1787384357.305528:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203241856:0@lo:13: 00000100:00100000:2.0:1787384357.305624:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384357.305770:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203241856 00000100:00100000:3.0:1787384357.305830:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203241856 00000100:00100000:3.0:1787384357.305904:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787384357.305916:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203241856:12345-0@lo:13: 00002000:00000024:3.0:1787384357.305951:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:2.0:1787384357.309565:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f9149880 x1874208203241856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384357.309603:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203241856:0@lo:13: 00000100:00100000:3.0:1787384357.311560:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203241856:12345-0@lo:13: Request processed in 5636us (5926us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384357.311574:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1787384357.815088:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384358.844306:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384359.863330:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384359.864130:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787384359.864150:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c20d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203241984:0@lo:41: 00000100:00100000:2.0:1787384359.864253:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384359.864311:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203241984 00000100:00100000:2.0:1787384359.864317:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203241984 00000100:00100000:2.0:1787384359.864357:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787384359.864364:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203241984:12345-0@lo:41: 00000004:00000024:2.0:1787384359.864394:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1787384359.864429:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203241984:12345-0@lo:41: Request processed in 65us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384359.864436:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787384359.864476:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c20d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203241984:0@lo:41: 00000100:00100000:3.0:1787384360.377502:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787384360.377546:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203242112:0@lo:41: 00000100:00100000:3.0:1787384360.377625:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384360.377698:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203242112 00000100:00100000:3.0:1787384360.377706:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203242112 00000100:00100000:3.0:1787384360.377752:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787384360.377760:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203242112:12345-0@lo:41: 00000004:00000024:3.0:1787384360.377818:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1787384360.377870:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203242112:12345-0@lo:41: Request processed in 110us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384360.377878:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787384360.377928:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203242112:0@lo:41: 00010000:00010000:3.0:1787384360.895709:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384361.912238:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384361.913145:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203242240:0@lo:400: 00000100:00100000:2.0:1787384361.913257:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384361.913328:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd75ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203242752:0@lo:400: 00000100:00100000:2.0:1787384361.913358:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384361.913380:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203243264:0@lo:400: 00000100:00100000:2.0:1787384361.913405:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384361.913447:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787384361.913455:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203242368:0@lo:400: 00000100:00100000:2.0:1787384361.913481:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384361.913501:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd759880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203242880:0@lo:400: 00000100:00100000:2.0:1787384361.913548:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384361.913584:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874208203242624:0@lo:400: 00000100:00100000:2.0:1787384361.913611:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384361.913631:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd75b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203243136:0@lo:400: 00000100:00100000:2.0:1787384361.913652:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384361.913670:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787384361.913676:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203242496:0@lo:400: 00000100:00100000:2.0:1787384361.913697:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384361.913715:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd758380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874208203243008:0@lo:400: 00000100:00100000:2.0:1787384361.913736:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384361.913765:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203242752 00000100:00100000:2.0:1787384361.913774:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203242752 00000100:00100000:2.0:1787384361.913854:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203242496 00000100:00100000:2.0:1787384361.913858:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203242496 00000100:00100000:0.0:1787384361.913975:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203242240 00000100:00100000:0.0:1787384361.913985:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203242240 00000100:00100000:0.0:1787384361.914019:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787384361.914028:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+21:3653:x1874208203242240:12345-0@lo:400: 00000100:00100000:0.0:1787384361.914094:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+21:3653:x1874208203242240:12345-0@lo:400: Request processed in 66us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384361.914102:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787384361.914166:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203242240:0@lo:400: 00000100:00100000:2.0:1787384361.914231:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787384361.914241:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203242752:12345-0@lo:400: 00000100:00100000:3.0:1787384361.914474:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787384361.914485:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee117b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203242496:12345-0@lo:400: 00000100:00100000:3.0:1787384361.914530:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee117b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203242496:12345-0@lo:400: Request processed in 48us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384361.914537:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787384361.914645:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203242496:0@lo:400: 00000100:00100000:3.0:1787384361.914694:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203242368 00000100:00100000:3.0:1787384361.914699:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203242368 00000100:00100000:3.0:1787384361.914723:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203242880 00000100:00100000:3.0:1787384361.914726:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203242880 00000100:00100000:2.0:1787384361.914817:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203242752:12345-0@lo:400: Request processed in 577us (1456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384361.914824:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787384361.914843:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203242624 00000100:00100000:2.0:1787384361.914846:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203242624 00000100:00100000:2.0:1787384361.914861:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203243008 00000100:00100000:2.0:1787384361.914864:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203243008 00000100:00100000:2.0:1787384361.914895:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787384361.914902:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203242368:12345-0@lo:400: 00000100:00100000:2.0:1787384361.914934:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203242368:12345-0@lo:400: Request processed in 33us (1453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384361.914952:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787384361.914967:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787384361.914973:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee115500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874208203242624:12345-0@lo:400: 00000100:00100000:2.0:1787384361.915007:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee115500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874208203242624:12345-0@lo:400: Request processed in 34us (1395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384361.915012:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787384361.915023:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787384361.915029:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874208203243008:12345-0@lo:400: 00000100:00100000:2.0:1787384361.915055:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874208203243008:12345-0@lo:400: Request processed in 27us (1318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384361.915060:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787384361.915085:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203243264 00000100:00100000:2.0:1787384361.915089:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203243264 00000100:00100000:2.0:1787384361.915115:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203243136 00000100:00100000:2.0:1787384361.915118:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203243136 00000100:00100000:2.0:1787384361.915135:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787384361.915141:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203243264:12345-0@lo:400: 00000100:00100000:2.0:1787384361.915182:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203243264:12345-0@lo:400: Request processed in 41us (1775us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384361.915189:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787384361.915200:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787384361.915206:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee117800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203243136:12345-0@lo:400: 00000100:00100000:2.0:1787384361.915232:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee117800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203243136:12345-0@lo:400: Request processed in 26us (1579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384361.915236:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787384361.915275:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8fd758380 x1874208203243008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384361.915295:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd758380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874208203243008:0@lo:400: 00010000:00080000:2.0:1787384361.915309:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f91d8000 x1874208203242624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384361.915317:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874208203242624:0@lo:400: 00010000:00080000:2.0:1787384361.915327:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8fd75b480 x1874208203243136/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384361.915335:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd75b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203243136:0@lo:400: 00000100:00100000:3.0:1787384361.917211:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787384361.917236:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203242880:12345-0@lo:400: 00000100:00100000:3.0:1787384361.921757:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203242880:12345-0@lo:400: Request processed in 4517us (8192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384361.921791:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1787384361.924037:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787384361.924051:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787384361.924055:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787384361.924660:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd75ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203242752:0@lo:400: 00010000:00080000:0.0:1787384361.924701:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8fd758700 x1874208203243264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384361.924714:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203243264:0@lo:400: 00010000:00080000:0.0:1787384361.924757:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f91d8700 x1874208203242368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384361.924766:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203242368:0@lo:400: 00010000:00080000:0.0:1787384361.924815:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8fd759880 x1874208203242880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384361.924824:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd759880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203242880:0@lo:400: 00000100:00100000:2.0:1787384362.424301:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203243392:0@lo:13: 00000100:00100000:2.0:1787384362.424371:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384362.424479:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203243392 00000100:00100000:2.0:1787384362.424489:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203243392 00000100:00100000:2.0:1787384362.424547:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787384362.424559:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee117100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203243392:12345-0@lo:13: 00002000:00000024:2.0:1787384362.424597:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384362.424649:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee117100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203243392:12345-0@lo:13: Request processed in 92us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384362.424656:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787384362.424679:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787384362.424689:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203243520:0@lo:13: 00000100:00100000:2.0:1787384362.424715:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384362.424744:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203243520 00000100:00100000:2.0:1787384362.424747:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203243520 00000100:00100000:2.0:1787384362.424773:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787384362.424800:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee116a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203243520:12345-0@lo:13: 00002000:00000024:2.0:1787384362.424812:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384362.425967:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee116a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203243520:12345-0@lo:13: Request processed in 1183us (1246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384362.425979:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787384362.426045:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f9148000 x1874208203243520/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384378 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384362.426067:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203243520:0@lo:13: 00010000:00080000:2.0:1787384362.426279:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8ee116300 x1874208203243392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384378 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384362.426294:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203243392:0@lo:13: 00010000:00010000:0.0:1787384362.936283:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384363.968695:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384364.982990:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384364.987009:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787384364.987036:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd75a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203243648:0@lo:41: 00000100:00100000:3.0:1787384364.987177:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384364.988393:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203243648 00000100:00100000:3.0:1787384364.988404:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203243648 00000100:00100000:3.0:1787384364.988459:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787384364.988469:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd759500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203243648:12345-0@lo:41: 00000004:00000024:3.0:1787384364.988508:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1787384364.988611:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd759500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203243648:12345-0@lo:41: Request processed in 143us (1434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384364.988627:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787384364.988681:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd75a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203243648:0@lo:41: 00000100:00100000:2.0:1787384365.508987:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787384365.509020:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203243776:0@lo:41: 00000100:00100000:2.0:1787384365.509085:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384365.509153:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203243776 00000100:00100000:2.0:1787384365.509161:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203243776 00000100:00100000:2.0:1787384365.509219:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787384365.509228:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203243776:12345-0@lo:41: 00000004:00000024:2.0:1787384365.509264:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1787384365.509309:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203243776:12345-0@lo:41: Request processed in 82us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384365.509316:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787384365.509369:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203243776:0@lo:41: 00010000:00010000:3.0:1787384366.009933:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787384366.620975:0:9515:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787384366.620980:0:9515:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787384366.620987:0:9515:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787384366.621267:0:9515:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff98f8f7d47800 00000020:01000004:2.0:1787384366.621284:0:9515:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787384366.621298:0:9515:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787384366.621311:0:9515:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff98f8f7d33380) 00000020:00000080:2.0:1787384366.621327:0:9515:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787384366.713979:0:9515:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787384366.714031:0:9515:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1787384366.791076:0:9515:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787384366.791294:0:9515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787384366.791306:0:9515:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787384366.791317:0:9515:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7ef423838fba264f 00000020:01000004:3.0:1787384366.791322:0:9515:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1787384366.791341:0:9515:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.145@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787384366.791344:0:9515:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.145@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787384366.791350:0:9515:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787384366.791383:0:9515:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1787384366.791388:0:9515:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.145@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787384366.842409:0:9515:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.145@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787384366.842446:0:9515:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.145@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1787384366.842451:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787384366.842452:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787384366.842454:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384366.842455:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384366.842457:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384366.842458:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384366.842460:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787384366.842461:0:9515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787384366.842462:0:9515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787384366.842464:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384366.842465:0:9515:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787384366.842469:0:9515:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1787384366.842471:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787384366.842472:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787384366.842474:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384366.842475:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384366.842480:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384366.842481:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384366.842482:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787384366.842483:0:9515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787384366.842483:0:9515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787384366.842484:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384366.842485:0:9515:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787384366.842509:0:9515:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787384366.842526:0:9515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd75a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:9515:1874208203243904:0@lo:253: 00000100:00100000:3.0:1787384366.842602:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384366.842699:0:9515:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d956c780 going to sleep for 11 seconds 00000100:00100000:1.0:1787384366.846955:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203243904 00000100:00100000:1.0:1787384366.846973:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203243904 00000100:00100000:0.0:1787384366.853377:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787384366.853392:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d25f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+21:9515:x1874208203243904:12345-0@lo:253: 20000000:01000000:0.0:1787384366.853431:0:6516:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787384366.853436:0:6516:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1787384366.853441:0:6516:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1787384366.853444:0:6516:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1787384366.853738:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787384366.853888:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:0.0:1787384366.853902:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1787384366.853918:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:0.0:1787384366.853924:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1787384366.853935:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:0.0:1787384366.853949:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:0.0:1787384366.854029:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:0.0:1787384366.854044:0:6516:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.145@tcp 20000000:01000000:0.0:1787384366.854045:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.145@tcp (null) (null) (null) 00000040:00080000:0.0:1787384366.854058:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:0.0:1787384366.854064:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787384366.854079:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:0.0:1787384366.854085:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.145@tcp (null) (null) 00000040:00080000:0.0:1787384366.854097:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:0.0:1787384366.854104:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787384366.854116:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:0.0:1787384366.854131:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:0.0:1787384366.854212:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:0.0:1787384366.854222:0:6516:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.145@tcp 20000000:01000000:0.0:1787384366.854223:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.145@tcp (null) (null) (null) 00000040:00080000:0.0:1787384366.854237:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:0.0:1787384366.854241:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787384366.854251:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:0.0:1787384366.854256:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.145@tcp (null) (null) 00000040:00080000:0.0:1787384366.854267:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:0.0:1787384366.854272:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787384366.854283:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:0.0:1787384366.854295:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:0.0:1787384366.854644:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1787384366.854654:0:6516:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.145@tcp 20000000:01000000:0.0:1787384366.854664:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.145@tcp (null) (null) (null) 00000040:00080000:0.0:1787384366.854679:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1787384366.854685:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787384366.854696:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1787384366.854700:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.145@tcp (null) (null) 00000040:00080000:0.0:1787384366.854711:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1787384366.854715:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787384366.854724:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1787384366.854737:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1787384366.854749:0:6516:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787384366.854751:0:6516:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787384366.854755:0:6516:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787384366.854830:0:6516:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787384366.854832:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787384366.855066:0:9521:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:0.0:1787384366.855082:0:9521:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:0.0:1787384366.855094:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:0.0:1787384366.855181:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:0.0:1787384366.855196:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:0.0:1787384366.855207:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:0.0:1787384366.855216:0:6516:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787384366.855218:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787384366.865126:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 26 1->4: lustre sys.timeout 20000000:01000000:2.0:1787384366.865198:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 26 2->4: lustre sys.timeout 00000040:00080000:2.0:1787384366.865210:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1787384366.867474:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1787384366.867510:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:0.0:1787384366.867527:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:0.0:1787384366.867538:0:6516:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787384366.867540:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787384366.867928:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 27 1->4: lustre sys.timeout 20000000:01000000:0.0:1787384366.867950:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 27 2->4: lustre sys.timeout 00000040:00080000:0.0:1787384366.867965:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:1.0:1787384366.868127:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:1.0:1787384366.868157:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:1.0:1787384366.868172:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:1.0:1787384366.868182:0:6516:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787384366.868184:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787384366.869146:0:9524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:0.0:1787384366.869382:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:0.0:1787384366.869404:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:0.0:1787384366.869428:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:0.0:1787384366.869439:0:6516:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1787384366.869441:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787384366.872673:0:9525:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:2.0:1787384366.872727:0:9525:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:2.0:1787384366.872743:0:9525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:0.0:1787384366.873506:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:0.0:1787384366.873534:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:0.0:1787384366.873551:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 10000000:01000000:0.0:1787384366.873566:0:6516:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787384366.873585:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98f8f5825c00/0x7ef423838fba2656 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384366.873604:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f8f5825800/0x7ef423838fba254c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2545 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384366.873611:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f902159200/0x7ef423838fba2576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba256f expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384366.873617:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f8f58cde00/0x7ef423838fba25b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba25ae expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384366.873624:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f8cad38400/0x7ef423838fba25d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba25ca expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384366.873631:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f8f5824000/0x7ef423838fba25f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba25ed expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384366.873637:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f8f58cd400/0x7ef423838fba2617 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2610 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384366.873643:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f902159400/0x7ef423838fba2641 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba263a expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384366.873649:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98f8f5825c00/0x7ef423838fba2656 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384366.873699:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f902159400/0x7ef423838fba2641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba263a expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384366.873713:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f902159400/0x7ef423838fba2641 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba263a expref: 21 pid: 6516 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384366.873727:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9148000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874208203244032:0@lo:104: 00000100:00100000:0.0:1787384366.875933:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787384366.876015:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f8f58cd400/0x7ef423838fba2617 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba2610 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384366.876030:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f8f58cd400/0x7ef423838fba2617 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba2610 expref: 21 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384366.876045:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874208203244160:0@lo:104: 00000100:00100000:0.0:1787384366.876086:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787384366.876179:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f8f5824000/0x7ef423838fba25f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba25ed expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384366.876188:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f8f5824000/0x7ef423838fba25f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba25ed expref: 21 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384366.876197:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874208203244288:0@lo:104: 00000100:00100000:0.0:1787384366.876219:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787384366.879345:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f8cad38400/0x7ef423838fba25d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba25ca expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384366.879364:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f8cad38400/0x7ef423838fba25d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba25ca expref: 21 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384366.879392:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3558e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874208203244416:0@lo:104: 00000100:00100000:0.0:1787384366.879445:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384366.883245:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203244032 00000100:00100000:1.0:1787384366.883323:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203244032 00000100:00100000:1.0:1787384366.883381:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203244160 00000100:00100000:1.0:1787384366.883385:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203244160 00000100:00100000:1.0:1787384366.883396:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203244288 00000100:00100000:1.0:1787384366.883399:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203244288 00000100:00100000:1.0:1787384366.883413:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787384366.883422:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9149880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+5:6516:x1874208203244032:12345-0@lo:104: 00010000:00010000:1.0:1787384366.883440:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f8f5824600/0x7ef423838fba263a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2641 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384366.883594:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787384366.883601:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9149880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+5:6516:x1874208203244032:12345-0@lo:104: Request processed in 180us (7677us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384366.883607:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787384366.883624:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787384366.883646:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+4:6516:x1874208203244160:12345-0@lo:104: 00010000:00010000:1.0:1787384366.883654:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f8f58ccc00/0x7ef423838fba2610 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2617 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384366.883767:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f8f58cde00/0x7ef423838fba25b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba25ae expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384366.883793:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f8f58cde00/0x7ef423838fba25b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba25ae expref: 21 pid: 6516 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384366.883807:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c355ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874208203244544:0@lo:104: 00000100:00100000:0.0:1787384366.883838:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787384366.883860:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f902159200/0x7ef423838fba2576 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba256f expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384366.883867:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f902159200/0x7ef423838fba2576 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba256f expref: 21 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384366.883875:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3558380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874208203244672:0@lo:104: 00000100:00100000:0.0:1787384366.883896:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787384366.883911:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f8f5825800/0x7ef423838fba254c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba2545 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384366.883918:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f8f5825800/0x7ef423838fba254c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba2545 expref: 21 pid: 6516 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384366.883924:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c355b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874208203244800:0@lo:104: 00000100:00100000:0.0:1787384366.883941:0:6516:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d817d900 going to sleep for 11 seconds 00000100:00100000:0.0:1787384366.883961:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9148000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874208203244032:0@lo:104: 00000100:00100000:0.0:1787384366.883968:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874208203244160:0@lo:104: 00000100:00100000:2.0:1787384366.885164:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203244416 00000100:00100000:2.0:1787384366.885174:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203244416 00010000:00010000:3.0:1787384366.886891:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787384366.886904:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8f5824600/0x7ef423838fba263a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2641 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.886916:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5824600 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:3.0:1787384366.886920:0:8453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8f5824600/0x7ef423838fba263a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba2641 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.886929:0:8453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8f5824600/0x7ef423838fba263a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba2641 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787384366.886937:0:8453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8f5824600/0x7ef423838fba263a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba2641 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384366.886943:0:8453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787384366.886996:0:8453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8f5824600/0x7ef423838fba263a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2641 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.887003:0:8453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787384366.887054:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd75b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203244928:0@lo:103: 00000100:00100000:0.0:1787384366.887125:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787384366.887337:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8f5824600/0x7ef423838fba263a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2641 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.887364:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8f5824600/0x7ef423838fba263a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2641 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.887376:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384366.887379:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8f58ccc00/0x7ef423838fba2610 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2617 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.887385:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58ccc00 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:3.0:1787384366.887388:0:8453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8f58ccc00/0x7ef423838fba2610 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba2617 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.887395:0:8453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8f58ccc00/0x7ef423838fba2610 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba2617 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787384366.887401:0:8453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8f58ccc00/0x7ef423838fba2610 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba2617 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384366.887406:0:8453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787384366.887424:0:8453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8f58ccc00/0x7ef423838fba2610 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2617 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.887430:0:8453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787384366.887448:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8f58ccc00/0x7ef423838fba2610 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2617 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.887455:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8f58ccc00/0x7ef423838fba2610 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2617 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.887463:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384366.887471:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384366.887473:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384366.887484:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd75bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203245056:0@lo:103: 00000100:00100000:3.0:1787384366.887511:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384366.887589:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787384366.887606:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384366.887617:0:6505:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1787384366.887622:0:6505:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:1.0:1787384366.887748:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1787384366.887758:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+5:6516:x1874208203244160:12345-0@lo:104: Request processed in 4112us (11670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384366.887766:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787384366.887885:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203244544 00000100:00100000:1.0:1787384366.887891:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203244544 00000100:00100000:1.0:1787384366.887908:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203244672 00000100:00100000:1.0:1787384366.887911:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203244672 00000100:00100000:1.0:1787384366.887920:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203244800 00000100:00100000:1.0:1787384366.887923:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203244800 00000100:00100000:1.0:1787384366.887934:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787384366.887941:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+7:6516:x1874208203244288:12345-0@lo:104: 00010000:00010000:1.0:1787384366.887950:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f8f58cda00/0x7ef423838fba25ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba25f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384366.888005:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787384366.888010:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+7:6516:x1874208203244288:12345-0@lo:104: Request processed in 70us (11790us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384366.888016:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:1.0:1787384366.888032:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384366.888036:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8f58cda00/0x7ef423838fba25ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba25f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384366.888042:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cda00 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:1.0:1787384366.888044:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8f58cda00/0x7ef423838fba25ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba25f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384366.888057:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8f58cda00/0x7ef423838fba25ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba25f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787384366.888063:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8f58cda00/0x7ef423838fba25ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba25f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384366.888165:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384366.888267:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787384366.888277:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3559c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+6:6516:x1874208203244416:12345-0@lo:104: 00010000:00010000:2.0:1787384366.888285:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f8cad38200/0x7ef423838fba25ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba25d1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384366.888320:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787384366.888325:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3559c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+6:6516:x1874208203244416:12345-0@lo:104: Request processed in 52us (8881us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384366.888330:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787384366.888345:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787384366.888350:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3559880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+5:6516:x1874208203244544:12345-0@lo:104: 00010000:00010000:2.0:1787384366.888357:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f8cad38a00/0x7ef423838fba25ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba25b5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384366.888387:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787384366.888398:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3559880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+5:6516:x1874208203244544:12345-0@lo:104: Request processed in 49us (4560us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384366.888404:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787384366.888416:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787384366.888422:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+4:6516:x1874208203244672:12345-0@lo:104: 00010000:00010000:2.0:1787384366.888429:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f8cad38600/0x7ef423838fba256f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2576 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384366.888455:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787384366.888459:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+4:6516:x1874208203244672:12345-0@lo:104: Request processed in 39us (4564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384366.888464:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787384366.888494:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787384366.888501:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd75a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+3:6516:x1874208203244800:12345-0@lo:104: 00010000:00010000:2.0:1787384366.888508:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f8cad39400/0x7ef423838fba2545 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba254c expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384366.888532:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787384366.888536:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd75a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+3:6516:x1874208203244800:12345-0@lo:104: Request processed in 37us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384366.888542:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1787384366.888555:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787384366.888559:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8cad38200/0x7ef423838fba25ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba25d1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384366.888565:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8cad38200 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384366.888568:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8cad38200/0x7ef423838fba25ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba25d1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384366.888584:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8cad38200/0x7ef423838fba25ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba25d1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384366.888590:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8cad38200/0x7ef423838fba25ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba25d1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384366.888595:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787384366.888620:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8cad38200/0x7ef423838fba25ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba25d1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384366.888626:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787384366.888639:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8cad38200/0x7ef423838fba25ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba25d1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384366.888646:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8cad38200/0x7ef423838fba25ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba25d1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384366.888657:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787384366.888660:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8cad38a00/0x7ef423838fba25ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba25b5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384366.888665:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8cad38a00 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384366.888667:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8cad38a00/0x7ef423838fba25ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba25b5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384366.888673:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8cad38a00/0x7ef423838fba25ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba25b5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384366.888678:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8cad38a00/0x7ef423838fba25ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba25b5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384366.888690:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787384366.888703:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8cad38a00/0x7ef423838fba25ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba25b5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384366.888709:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787384366.888833:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787384366.888846:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203245184:0@lo:103: 00000100:00100000:3.0:1787384366.888876:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384366.888906:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203244928 00000100:00100000:3.0:1787384366.888911:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203244928 00010000:00010000:3.0:1787384366.888933:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f902159400/0x7ef423838fba2641 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba263a expref: 22 pid: 6516 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384366.888954:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203245056 00000100:00100000:3.0:1787384366.888957:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203245056 00010000:00010000:3.0:1787384366.888967:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f8f58cd400/0x7ef423838fba2617 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba2610 expref: 23 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384366.888977:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203245184 00000100:00100000:3.0:1787384366.888979:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203245184 00010000:00010000:3.0:1787384366.888988:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f8cad38400/0x7ef423838fba25d1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba25ca expref: 24 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384366.888998:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787384366.889003:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3558700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3654:x1874208203244928:12345-0@lo:103: 00010000:00010000:3.0:1787384366.889012:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384366.889017:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f902159400/0x7ef423838fba2641 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba263a expref: 24 pid: 6516 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.889034:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f902159400/0x7ef423838fba2641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba263a expref: 24 pid: 6516 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.889048:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f902159400/0x7ef423838fba2641 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba263a expref: 24 pid: 6516 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.889060:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:01000000:1.0:1787384366.889144:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787384366.889161:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8f58cda00/0x7ef423838fba25ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba25f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384366.889167:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787384366.889691:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee145f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203245440:0@lo:103: 00000100:00100000:0.0:1787384366.889729:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787384366.889853:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8cad38a00/0x7ef423838fba25ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba25b5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384366.889862:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8cad38a00/0x7ef423838fba25ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba25b5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384366.889873:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787384366.889876:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8cad38600/0x7ef423838fba256f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2576 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384366.889881:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8cad38600 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384366.889884:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8cad38600/0x7ef423838fba256f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba2576 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384366.889891:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8cad38600/0x7ef423838fba256f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba2576 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384366.889896:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8cad38600/0x7ef423838fba256f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba2576 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384366.889901:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787384366.889918:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8cad38600/0x7ef423838fba256f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2576 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384366.889923:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787384366.889943:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8cad38600/0x7ef423838fba256f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2576 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384366.889949:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8cad38600/0x7ef423838fba256f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2576 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384366.890014:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384366.890018:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8cad39400/0x7ef423838fba2545 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba254c expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384366.890023:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8cad39400 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384366.890026:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8cad39400/0x7ef423838fba2545 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba254c expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384366.890033:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8cad39400/0x7ef423838fba2545 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba254c expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384366.890040:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8cad39400/0x7ef423838fba2545 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba254c expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384366.890045:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787384366.890059:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8cad39400/0x7ef423838fba2545 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba254c expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384366.890073:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787384366.890080:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8cad39400/0x7ef423838fba2545 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba254c expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384366.890087:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8cad39400/0x7ef423838fba2545 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba254c expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384366.890096:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384366.890103:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384366.890105:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384366.890120:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203245312:0@lo:103: 00000100:00100000:2.0:1787384366.890157:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384366.891388:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3558700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca80b7f5-0e34-441a-981f-ebff717028c4+23:3654:x1874208203244928:12345-0@lo:103: Request processed in 2379us (4257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384366.891399:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787384366.891429:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203245440 00000100:00100000:3.0:1787384366.891435:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203245440 00010000:00010000:3.0:1787384366.891460:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f8f5824000/0x7ef423838fba25f4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba25ed expref: 23 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384366.891476:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203245312 00000100:00100000:3.0:1787384366.891479:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203245312 00010000:00010000:3.0:1787384366.891489:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f8f58cde00/0x7ef423838fba25b5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba25ae expref: 24 pid: 6516 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384366.891501:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787384366.891509:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd758000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3651:x1874208203245056:12345-0@lo:103: 00010000:00010000:3.0:1787384366.891520:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384366.891526:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f8f58cd400/0x7ef423838fba2617 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba2610 expref: 24 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.891537:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f8f58cd400/0x7ef423838fba2617 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba2610 expref: 24 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.891569:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f58cd400/0x7ef423838fba2617 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba2610 expref: 24 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.891582:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384366.891622:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd758000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca80b7f5-0e34-441a-981f-ebff717028c4+23:3651:x1874208203245056:12345-0@lo:103: Request processed in 113us (4109us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384366.891628:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787384366.891640:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787384366.891647:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd75b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca80b7f5-0e34-441a-981f-ebff717028c4+22:3651:x1874208203245184:12345-0@lo:103: 00010000:00010000:3.0:1787384366.891656:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384366.891660:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f8cad38400/0x7ef423838fba25d1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba25ca expref: 22 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.891667:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f8cad38400/0x7ef423838fba25d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba25ca expref: 22 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.891676:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384366.891697:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd75b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca80b7f5-0e34-441a-981f-ebff717028c4+22:3651:x1874208203245184:12345-0@lo:103: Request processed in 51us (2821us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384366.891702:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787384366.891715:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787384366.891720:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f18e0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca80b7f5-0e34-441a-981f-ebff717028c4+21:3654:x1874208203245440:12345-0@lo:103: 00010000:00010000:3.0:1787384366.891726:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384366.891730:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f8f5824000/0x7ef423838fba25f4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba25ed expref: 21 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.891737:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f8f5824000/0x7ef423838fba25f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba25ed expref: 21 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.891752:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384366.891775:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f18e0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca80b7f5-0e34-441a-981f-ebff717028c4+21:3654:x1874208203245440:12345-0@lo:103: Request processed in 55us (2046us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384366.891796:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787384366.891832:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787384366.891838:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee115c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca80b7f5-0e34-441a-981f-ebff717028c4+20:3653:x1874208203245312:12345-0@lo:103: 00010000:00010000:3.0:1787384366.891844:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384366.891847:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f8f58cde00/0x7ef423838fba25b5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba25ae expref: 20 pid: 6516 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.891855:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f8f58cde00/0x7ef423838fba25b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba25ae expref: 20 pid: 6516 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.891864:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384366.891895:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee115c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca80b7f5-0e34-441a-981f-ebff717028c4+20:3653:x1874208203245312:12345-0@lo:103: Request processed in 58us (1738us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384366.891901:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787384366.891931:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee114a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203245568:0@lo:103: 00000100:00100000:3.0:1787384366.891957:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384366.891994:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203245184:0@lo:103: 00000100:00100000:3.0:1787384366.892003:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd75bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203245056:0@lo:103: 00000100:00100000:3.0:1787384366.892022:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787384366.892027:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee114e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203245696:0@lo:103: 00000100:00100000:3.0:1787384366.892046:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384366.892064:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203245568 00000100:00100000:3.0:1787384366.893170:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203245568 00010000:00010000:3.0:1787384366.893202:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f902159200/0x7ef423838fba2576 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba256f expref: 20 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384366.893222:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203245696 00000100:00100000:3.0:1787384366.893224:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203245696 00010000:00010000:3.0:1787384366.893232:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f8f5825800/0x7ef423838fba254c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba2545 expref: 21 pid: 6516 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384366.893243:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787384366.893248:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd758000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca80b7f5-0e34-441a-981f-ebff717028c4+21:3651:x1874208203245568:12345-0@lo:103: 00010000:00010000:3.0:1787384366.893256:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384366.893353:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8f58cda00/0x7ef423838fba25ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba25f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384366.893363:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8f58cda00/0x7ef423838fba25ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba25f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384366.893383:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384366.893386:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384366.893388:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384366.893442:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f902159200/0x7ef423838fba2576 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba256f expref: 21 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.893453:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f902159200/0x7ef423838fba2576 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba256f expref: 21 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.893468:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384366.893591:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203245312:0@lo:103: 00000100:00100000:3.0:1787384366.894170:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd758000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca80b7f5-0e34-441a-981f-ebff717028c4+21:3651:x1874208203245568:12345-0@lo:103: Request processed in 919us (2210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384366.894178:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787384366.894199:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787384366.894208:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd75bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca80b7f5-0e34-441a-981f-ebff717028c4+20:3651:x1874208203245696:12345-0@lo:103: 00010000:00010000:3.0:1787384366.894216:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384366.894221:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f8f5825800/0x7ef423838fba254c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba2545 expref: 20 pid: 6516 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.894231:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f8f5825800/0x7ef423838fba254c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba2545 expref: 20 pid: 6516 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.894255:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98f8f5825c00/0x7ef423838fba2656 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.894323:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f5825c00/0x7ef423838fba2656 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.894339:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f8f5825c00/0x7ef423838fba2656 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.894346:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f8f5825c00/0x7ef423838fba2656 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.894353:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98f8f5825c00/0x7ef423838fba2656 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.894359:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98f8f5825c00/0x7ef423838fba2656 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.894365:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5825c00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:3.0:1787384366.894369:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98f8f5825c00/0x7ef423838fba2656 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.894376:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98f8f5825c00/0x7ef423838fba2656 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.894385:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98f8f5825c00/0x7ef423838fba2656 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.894393:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384366.894419:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd75bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca80b7f5-0e34-441a-981f-ebff717028c4+20:3651:x1874208203245696:12345-0@lo:103: Request processed in 214us (2373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384366.894433:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1787384366.894451:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384366.894606:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f5824000/0x7ef423838fba25f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba25ed expref: 19 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384366.894618:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874208203244288:0@lo:104: 00010000:00010000:2.0:1787384366.894627:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8cad38400/0x7ef423838fba25d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba25ca expref: 18 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384366.894636:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3558e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874208203244416:0@lo:104: 00010000:00010000:2.0:1787384366.894645:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f58cde00/0x7ef423838fba25b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba25ae expref: 17 pid: 6516 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384366.894652:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c355ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874208203244544:0@lo:104: 00010000:00010000:2.0:1787384366.894660:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f902159200/0x7ef423838fba2576 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba256f expref: 16 pid: 6514 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384366.894667:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3558380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874208203244672:0@lo:104: 00010000:00010000:2.0:1787384366.894675:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f5825800/0x7ef423838fba254c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba2545 expref: 15 pid: 6516 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384366.894681:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c355b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874208203244800:0@lo:104: 00010000:00010000:2.0:1787384366.894708:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98f8f5825c00/0x7ef423838fba2656 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384366.894725:0:6516:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98f8f5825c00/0x7ef423838fba2656 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384366.894732:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98f8f5825c00/0x7ef423838fba2656 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384366.894738:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f5825c00/0x7ef423838fba2656 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787384366.894748:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787384366.895176:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd75b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203244928:0@lo:103: 00000100:00100000:0.0:1787384366.895195:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee145f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203245440:0@lo:103: 00000100:00100000:0.0:1787384366.897883:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d25f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+14:9515:x1874208203243904:12345-0@lo:253: Request processed in 44487us (55274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384366.897896:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787384366.898000:0:9515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd75a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:9515:1874208203243904:0@lo:253: 10000000:01000000:3.0:1787384366.898015:0:9515:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787384366.898019:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787384366.898020:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787384366.898022:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384366.898023:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1787384366.898024:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384366.898026:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384366.898027:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787384366.898029:0:9515:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787384366.898030:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384366.898032:0:9515:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787384366.898056:0:9515:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98f8f7d47800 from lustre-OST0001 10000000:01000000:3.0:1787384366.898158:0:9515:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787384366.898161:0:9515:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787384366.898171:0:9515:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98f8f96899c0 local copy 10000000:01000000:3.0:1787384366.898175:0:9515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787384366.898211:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c2091000/0x7ef423838fba265d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.898222:0:9515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.145@tcp lock: ffff98f7c2091000/0x7ef423838fba265d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.898232:0:9515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f7c2091000/0x7ef423838fba265d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384366.898249:0:9515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd75a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:9515:1874208203245824:0@lo:101: 00000100:00100000:3.0:1787384366.898347:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384366.898387:0:9515:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d956cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787384366.898436:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203245824 00000100:00100000:0.0:1787384366.898442:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203245824 00000100:00100000:0.0:1787384366.898480:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787384366.898489:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d945a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+14:9515:x1874208203245824:12345-0@lo:101: 00010000:00010000:0.0:1787384366.898501:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384366.898515:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8f5824c00/0x7ef423838fba2664 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba265d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384366.898539:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f5824c00/0x7ef423838fba2664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba265d expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384366.898549:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8f5824c00/0x7ef423838fba2664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba265d expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384366.898558:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f5824c00, rc 0) 00000100:00100000:0.0:1787384366.898589:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d945a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+15:9515:x1874208203245824:12345-0@lo:101: Request processed in 101us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384366.898595:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787384366.899401:0:9515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd75a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:9515:1874208203245824:0@lo:101: 00010000:00010000:3.0:1787384366.899426:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f7c2091000/0x7ef423838fba265d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x7ef423838fba2664 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.899436:0:9515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f7c2091000/0x7ef423838fba265d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7ef423838fba2664 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384366.899561:0:9515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd75a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:9515:1874208203245952:0@lo:501: 00000100:00100000:3.0:1787384366.899602:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384366.899624:0:9515:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d956cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787384366.900197:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203245952 00000100:00100000:0.0:1787384366.900204:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203245952 00000100:00100000:0.0:1787384366.900239:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787384366.900247:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9458c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+15:9515:x1874208203245952:12345-0@lo:501: 00000100:00100000:0.0:1787384366.900392:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9458c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+15:9515:x1874208203245952:12345-0@lo:501: Request processed in 145us (789us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787384366.900399:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787384366.900460:0:9515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd75a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:9515:1874208203245952:0@lo:501: 10000000:01000000:0.0:1787384366.900478:0:9515:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.145@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787384366.900500:0:9515:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.145@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787384366.900507:0:9515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c2091000/0x7ef423838fba265d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7ef423838fba2664 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384366.900517:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c2091000/0x7ef423838fba265d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7ef423838fba2664 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384366.900523:0:9515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.145@tcp lock: ffff98f7c2091000/0x7ef423838fba265d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7ef423838fba2664 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384366.900548:0:9515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787384366.900587:0:9515:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98f8f7d47800 10000000:01000000:0.0:1787384366.900592:0:9515:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787384366.900598:0:9515:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787384366.900600:0:9515:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787384366.900605:0:9515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787384366.900608:0:9515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787384366.900629:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f5825a00/0x7ef423838fba266b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384366.900648:0:9515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8f5825a00/0x7ef423838fba266b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384366.900656:0:9515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8f5825a00/0x7ef423838fba266b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384366.900670:0:9515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c355a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:9515:1874208203246080:0@lo:101: 00000100:00100000:0.0:1787384366.900697:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384366.900719:0:9515:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9354240 going to sleep for 11 seconds 00000100:00100000:1.0:1787384366.900823:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee114a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203245568:0@lo:103: 00000100:00100000:1.0:1787384366.900841:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee114e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203245696:0@lo:103: 00010000:00010000:0.0:1787384366.900911:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384366.900917:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f7c2091000/0x7ef423838fba265d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x7ef423838fba2664 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384366.900924:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2091000 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:0.0:1787384366.900928:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f7c2091000/0x7ef423838fba265d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x7ef423838fba2664 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384366.900936:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f7c2091000/0x7ef423838fba265d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x7ef423838fba2664 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787384366.900943:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f7c2091000/0x7ef423838fba265d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x7ef423838fba2664 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384366.900948:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787384366.900967:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f7c2091000/0x7ef423838fba265d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7ef423838fba2664 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384366.900973:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787384366.900996:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f7c2091000/0x7ef423838fba265d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7ef423838fba2664 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384366.901010:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f7c2091000/0x7ef423838fba265d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7ef423838fba2664 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384366.901022:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384366.901024:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384366.901026:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384366.901034:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787384366.901044:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3559500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203246208:0@lo:103: 00000100:00100000:3.0:1787384366.901176:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203246080 00000100:00100000:3.0:1787384366.901181:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203246080 00000100:00100000:3.0:1787384366.901208:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787384366.901215:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d945bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+15:9515:x1874208203246080:12345-0@lo:101: 00010000:00010000:3.0:1787384366.901224:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384366.901235:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c2090800/0x7ef423838fba2672 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba266b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.901254:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c2090800/0x7ef423838fba2672 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba266b expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.901334:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c2090800/0x7ef423838fba2672 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba266b expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.901343:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2090800, rc 0) 00000100:00100000:0.0:1787384366.901374:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384366.904476:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d945bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+16:9515:x1874208203246080:12345-0@lo:101: Request processed in 3252us (3769us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384366.904490:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787384366.904600:0:9515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c355a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:9515:1874208203246080:0@lo:101: 00010000:00010000:1.0:1787384366.904624:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8f5825a00/0x7ef423838fba266b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2672 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384366.904636:0:9515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8f5825a00/0x7ef423838fba266b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2672 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384366.904768:0:9515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee145180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:9515:1874208203246336:0@lo:501: 00000100:00100000:1.0:1787384366.904835:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384366.904871:0:9515:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9462540 going to sleep for 11 seconds 00000100:00100000:2.0:1787384366.904947:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203246336 00000100:00100000:2.0:1787384366.904953:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203246336 00000100:00100000:2.0:1787384366.904996:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787384366.905005:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d945ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+16:9515:x1874208203246336:12345-0@lo:501: 00000100:00100000:2.0:1787384366.905128:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d945ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+16:9515:x1874208203246336:12345-0@lo:501: Request processed in 124us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384366.905143:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787384366.906404:0:9515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee145180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:9515:1874208203246336:0@lo:501: 00000100:00100000:3.0:1787384366.906466:0:9515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd75b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:9515:1874208203246464:0@lo:503: 00000100:00100000:3.0:1787384366.906533:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384366.906557:0:9515:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d956cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787384366.907208:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203246464 00000100:00100000:2.0:1787384366.907215:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203246464 00000100:00100000:2.0:1787384366.907276:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787384366.907284:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+16:9515:x1874208203246464:12345-0@lo:503: 00000100:00100000:2.0:1787384366.907404:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+16:9515:x1874208203246464:12345-0@lo:503: Request processed in 119us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384366.907412:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787384366.907685:0:9515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd75b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:9515:1874208203246464:0@lo:503: 00000040:00080000:1.0:1787384366.907973:0:9515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787384366.908046:0:9515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee144a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:9515:1874208203246592:0@lo:502: 00000100:00100000:1.0:1787384366.908351:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384366.908391:0:9515:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9462540 going to sleep for 11 seconds 00000100:00100000:3.0:1787384366.908440:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203246592 00000100:00100000:3.0:1787384366.908446:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203246592 00000100:00100000:3.0:1787384366.909203:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787384366.909213:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+16:9515:x1874208203246592:12345-0@lo:502: 00000100:00100000:3.0:1787384366.909353:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+16:9515:x1874208203246592:12345-0@lo:502: Request processed in 140us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384366.909360:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787384366.909641:0:9515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee144a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:9515:1874208203246592:0@lo:502: 00000040:00080000:1.0:1787384366.909895:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787384366.909925:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787384366.909940:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787384366.909954:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787384366.909967:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787384366.909979:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787384366.910008:0:9515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee144a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:9515:1874208203246720:0@lo:502: 00000100:00100000:1.0:1787384366.910049:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384366.910166:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203246720 00000100:00100000:2.0:1787384366.910172:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203246720 00000100:00100000:2.0:1787384366.910200:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787384366.910206:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+16:9515:x1874208203246720:12345-0@lo:502: 00000100:00100000:2.0:1787384366.911220:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+16:9515:x1874208203246720:12345-0@lo:502: Request processed in 1009us (1166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384366.911229:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787384366.911394:0:9515:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9462540 going to sleep for 11 seconds 00000100:00100000:1.0:1787384366.911415:0:9515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee144a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:9515:1874208203246720:0@lo:502: 00000040:00080000:1.0:1787384366.911476:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787384366.911488:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000100:00100000:1.0:1787384366.911923:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203246208 00000100:00100000:1.0:1787384366.911929:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203246208 00000100:00100000:1.0:1787384366.911975:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787384366.911984:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c355b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca80b7f5-0e34-441a-981f-ebff717028c4+16:3654:x1874208203246208:12345-0@lo:103: 00010000:00010000:1.0:1787384366.912009:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384366.912028:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f5824c00/0x7ef423838fba2664 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ef423838fba265d expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384366.912044:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384366.912094:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c355b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca80b7f5-0e34-441a-981f-ebff717028c4+15:3654:x1874208203246208:12345-0@lo:103: Request processed in 112us (10720us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384366.912102:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787384366.913437:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3559500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203246208:0@lo:103: 00000020:01000000:3.0:1787384366.918997:0:9527:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787384366.919010:0:9527:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1787384366.919017:0:9527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384366.919019:0:9527:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787384366.919029:0:9527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787384366.919047:0:9527:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff98f7c289cd40) 00000020:00000080:3.0:1787384366.919414:0:9527:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787384366.919423:0:9527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787384366.919502:0:9527:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f8f7d47800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787384366.919511:0:9527:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787384366.919518:0:9527:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7ef423838fba2680 00010000:00010000:2.0:1787384366.929772:0:9527:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:2.0:1787384366.930409:0:9527:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1787384366.933484:0:9527:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787384366.933845:0:9527:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1787384366.939016:0:9527:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1787384366.939231:0:9527:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1787384366.947607:0:9527:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1787384366.949962:0:9527:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787384366.949975:0:9527:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787384366.949981:0:9527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384366.949983:0:9527:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787384366.949987:0:9527:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787384366.949990:0:9527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384366.949991:0:9527:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787384366.949995:0:9527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787384366.950002:0:9527:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787384366.950025:0:9527:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787384366.950028:0:9527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384366.950030:0:9527:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787384366.950032:0:9527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787384366.950257:0:9515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1787384366.950301:0:9515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787384366.950324:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f5825a00/0x7ef423838fba266b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2672 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384366.950337:0:9515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8f5825a00/0x7ef423838fba266b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2672 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384366.950345:0:9515:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98f8f7d47800 from 1 10000000:01000000:0.0:1787384366.950348:0:9515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787384366.950384:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f5825e00/0x7ef423838fba2687 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384366.950392:0:9515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8f5825e00/0x7ef423838fba2687 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384366.950403:0:9515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8f5825e00/0x7ef423838fba2687 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384366.950425:0:9515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c355bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:9515:1874208203246848:0@lo:101: 00000100:00100000:0.0:1787384366.950501:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384366.950545:0:9515:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7186300 going to sleep for 11 seconds 00000100:00100000:3.0:1787384366.950659:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203246848 00000100:00100000:3.0:1787384366.950666:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203246848 00000100:00100000:3.0:1787384366.950715:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787384366.950724:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+15:9515:x1874208203246848:12345-0@lo:101: 00010000:00010000:3.0:1787384366.950736:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384366.950747:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c2091e00/0x7ef423838fba268e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba2687 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.950768:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c2091e00/0x7ef423838fba268e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba2687 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.950795:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c2091e00/0x7ef423838fba268e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2687 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384366.950804:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2091e00, rc 0) 00000100:00100000:3.0:1787384366.950841:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+16:9515:x1874208203246848:12345-0@lo:101: Request processed in 118us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384366.950847:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787384366.950992:0:9515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c355bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:9515:1874208203246848:0@lo:101: 00010000:00010000:0.0:1787384366.951006:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8f5825e00/0x7ef423838fba2687 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba268e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384366.951014:0:9515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8f5825e00/0x7ef423838fba2687 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba268e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384366.951104:0:9515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c355bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:9515:1874208203246976:0@lo:501: 00000100:00100000:0.0:1787384366.951130:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384366.951165:0:9515:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7186300 going to sleep for 11 seconds 00000100:00100000:1.0:1787384366.951269:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203246976 00000100:00100000:1.0:1787384366.951274:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203246976 00000100:00100000:1.0:1787384366.951300:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787384366.951307:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+16:9515:x1874208203246976:12345-0@lo:501: 00000100:00100000:1.0:1787384366.951401:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+16:9515:x1874208203246976:12345-0@lo:501: Request processed in 94us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384366.951408:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787384366.951558:0:9515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c355bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:9515:1874208203246976:0@lo:501: 00000100:00100000:0.0:1787384366.951583:0:9515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c355bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:9515:1874208203247104:0@lo:503: 00000100:00100000:0.0:1787384366.951622:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384366.951642:0:9515:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7186300 going to sleep for 11 seconds 00000100:00100000:1.0:1787384366.951686:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203247104 00000100:00100000:1.0:1787384366.951691:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203247104 00000100:00100000:1.0:1787384366.951717:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787384366.951723:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+16:9515:x1874208203247104:12345-0@lo:503: 00000100:00100000:1.0:1787384366.951845:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+16:9515:x1874208203247104:12345-0@lo:503: Request processed in 121us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384366.951851:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787384366.951937:0:9515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c355bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:9515:1874208203247104:0@lo:503: 00000040:00080000:0.0:1787384366.952164:0:9515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787384366.952225:0:9515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c355bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:9515:1874208203247232:0@lo:502: 00000100:00100000:0.0:1787384366.952257:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384366.952390:0:9515:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7186300 going to sleep for 11 seconds 00000100:00100000:3.0:1787384366.952456:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203247232 00000100:00100000:3.0:1787384366.952462:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203247232 00000100:00100000:3.0:1787384366.952494:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787384366.952501:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+16:9515:x1874208203247232:12345-0@lo:502: 00000100:00100000:3.0:1787384366.952573:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+16:9515:x1874208203247232:12345-0@lo:502: Request processed in 72us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384366.952579:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787384366.952626:0:9515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c355bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:9515:1874208203247232:0@lo:502: 00000040:00080000:3.0:1787384366.952808:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787384366.952832:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787384366.952854:0:9515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd75aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:9515:1874208203247360:0@lo:502: 00000100:00100000:3.0:1787384366.952886:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384366.952905:0:9515:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c356b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384366.952917:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203247360 00000100:00100000:3.0:1787384366.952920:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203247360 00000100:00100000:3.0:1787384366.952936:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787384366.952941:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+16:9515:x1874208203247360:12345-0@lo:502: 00000100:00100000:3.0:1787384366.953001:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+16:9515:x1874208203247360:12345-0@lo:502: Request processed in 59us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384366.953007:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787384366.953042:0:9515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd75aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:9515:1874208203247360:0@lo:502: 00000040:00080000:3.0:1787384366.953148:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787384366.953156:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787384366.955708:0:9530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787384366.955722:0:9530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384366.955724:0:9530:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787384366.955734:0:9530:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f8f7d47800 00000020:00000080:1.0:1787384366.955737:0:9530:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787384366.955749:0:9530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384366.955757:0:9530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384366.955759:0:9530:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787384366.955762:0:9530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787384366.955836:0:9515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787384366.955863:0:9515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787384366.955932:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f5825e00/0x7ef423838fba2687 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba268e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384366.955945:0:9515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8f5825e00/0x7ef423838fba2687 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba268e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384366.955989:0:9515:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787384366.955992:0:9515:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98f8f7d47800 10000000:01000000:1.0:1787384366.955995:0:9515:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98f8f7d47800 10000000:01000000:1.0:1787384366.955999:0:9515:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787384366.956003:0:9515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98f8f7d47800 from 1 10000000:01000000:1.0:1787384366.956006:0:9515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787384366.956037:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba2695 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384366.956044:0:9515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba2695 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384366.956053:0:9515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba2695 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384366.956083:0:9515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee144a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:9515:1874208203247488:0@lo:101: 00000100:00100000:1.0:1787384366.956150:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384366.956184:0:9515:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d956c780 going to sleep for 11 seconds 00000100:00100000:1.0:1787384366.956206:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203247488 00000100:00100000:1.0:1787384366.956212:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203247488 00000100:00100000:1.0:1787384366.956314:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787384366.956325:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+16:9515:x1874208203247488:12345-0@lo:101: 00010000:00010000:1.0:1787384366.956336:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384366.956347:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f902159a00/0x7ef423838fba269c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba2695 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384366.956368:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f902159a00/0x7ef423838fba269c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba2695 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384366.956377:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f902159a00/0x7ef423838fba269c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2695 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384366.956385:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f902159a00, rc 0) 00000100:00100000:1.0:1787384366.956419:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+17:9515:x1874208203247488:12345-0@lo:101: Request processed in 96us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384366.956425:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787384366.956468:0:9515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee144a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:9515:1874208203247488:0@lo:101: 00010000:00010000:1.0:1787384366.956481:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba2695 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba269c expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384366.956489:0:9515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba2695 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba269c expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384366.956558:0:9515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee144a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:9515:1874208203247616:0@lo:501: 00000100:00100000:1.0:1787384366.956581:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384366.956594:0:9515:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d956c780 going to sleep for 11 seconds 00000100:00100000:1.0:1787384366.956607:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203247616 00000100:00100000:1.0:1787384366.956611:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203247616 00000100:00100000:1.0:1787384366.956632:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787384366.956645:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+17:9515:x1874208203247616:12345-0@lo:501: 00000100:00100000:1.0:1787384366.956736:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+17:9515:x1874208203247616:12345-0@lo:501: Request processed in 91us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384366.956742:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787384366.956772:0:9515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee144a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:9515:1874208203247616:0@lo:501: 00000100:00100000:1.0:1787384366.956819:0:9515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee144a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:9515:1874208203247744:0@lo:503: 00000100:00100000:1.0:1787384366.956856:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384366.956869:0:9515:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d956c780 going to sleep for 11 seconds 00000100:00100000:1.0:1787384366.956881:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203247744 00000100:00100000:1.0:1787384366.956885:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203247744 00000100:00100000:1.0:1787384366.956904:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787384366.956909:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+17:9515:x1874208203247744:12345-0@lo:503: 00000100:00100000:1.0:1787384366.956981:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+17:9515:x1874208203247744:12345-0@lo:503: Request processed in 71us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384366.956987:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787384366.957026:0:9515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee144a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:9515:1874208203247744:0@lo:503: 00000040:00080000:1.0:1787384366.957248:0:9515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787384366.958403:0:9515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee144a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:9515:1874208203247872:0@lo:502: 00000100:00100000:1.0:1787384366.958457:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384366.958531:0:9515:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d912b780 going to sleep for 11 seconds 00000100:00100000:2.0:1787384366.964985:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203247872 00000100:00100000:2.0:1787384366.965000:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203247872 00000100:00100000:2.0:1787384366.965085:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787384366.965095:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+17:9515:x1874208203247872:12345-0@lo:502: 00000100:00100000:2.0:1787384366.965254:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+17:9515:x1874208203247872:12345-0@lo:502: Request processed in 160us (6796us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384366.965416:0:9515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee144a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:9515:1874208203247872:0@lo:502: 00000100:00100000:2.0:1787384366.965421:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000040:00080000:1.0:1787384366.965897:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787384366.965927:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787384366.967605:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787384366.967717:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787384366.967734:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787384366.967765:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787384366.967793:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787384366.967810:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787384366.967824:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787384366.967838:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787384366.967851:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787384366.967863:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787384366.967876:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787384366.967886:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787384366.967897:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787384366.967909:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787384366.967920:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787384366.967932:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787384366.967970:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787384366.967986:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787384366.968001:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787384366.968016:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787384366.968029:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787384366.968044:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787384366.968057:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1787384366.968070:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1787384366.968083:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1787384366.969233:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1787384366.969276:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1787384366.969290:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1787384366.969303:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1787384366.969316:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1787384366.969330:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1787384366.969343:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1787384366.969375:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1787384366.969388:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1787384366.969398:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:1.0:1787384366.969408:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1787384366.969430:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:1.0:1787384366.969441:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:1.0:1787384366.969452:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:1.0:1787384366.969473:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:1.0:1787384366.969489:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:1.0:1787384366.969504:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:1.0:1787384366.969516:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:1.0:1787384366.969529:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:1.0:1787384366.969578:0:9515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee144a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:9515:1874208203248000:0@lo:502: 00000100:00100000:1.0:1787384366.972011:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384366.972074:0:9515:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d912b780 going to sleep for 11 seconds 00000100:00100000:2.0:1787384366.974625:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203248000 00000100:00100000:2.0:1787384366.974644:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203248000 00000100:00100000:2.0:1787384366.974716:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787384366.974726:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+17:9515:x1874208203248000:12345-0@lo:502: 00000100:00100000:3.0:1787384366.975233:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+17:9515:x1874208203248000:12345-0@lo:502: Request processed in 507us (3229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384366.975242:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787384366.975598:0:9515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee144a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:9515:1874208203248000:0@lo:502: 00000040:00080000:1.0:1787384366.975679:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:1.0:1787384366.975692:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:2.0:1787384366.976773:0:9532:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787384366.976818:0:9532:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff98f8f7d34d40) 00000020:00000080:2.0:1787384366.976844:0:9532:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:2.0:1787384366.976997:0:9532:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f8f7d47800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787384366.977001:0:9532:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f8f7d47800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787384366.977004:0:9532:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f8f7d47800 3 00010000:00080000:2.0:1787384366.977036:0:9532:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f7c385f800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.145@tcp at head 00010000:00010000:2.0:1787384366.983387:0:9532:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:2.0:1787384366.983489:0:9532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787384366.983532:0:9532:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787384366.983543:0:9532:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x7ef423838fba26aa 00000100:00080000:2.0:1787384366.983553:0:9532:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787384366.983559:0:9532:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98f7c385f800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:2.0:1787384366.983594:0:9532:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8ee115180 x1874208203248128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787384366.983685:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874208203248128:0@lo:38: 00000100:00100000:0.0:1787384366.983750:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787384366.983911:0:9532:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787384366.984230:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203248128 00000100:00100000:3.0:1787384366.984237:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203248128 00000100:00100000:3.0:1787384366.984304:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787384366.984312:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3558000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1874208203248128:12345-0@lo:38: 00010000:00080000:3.0:1787384366.984336:0:6523:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:3.0:1787384366.984365:0:6523:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x7ef423838fba26b1 00000004:00100000:3.0:1787384366.984379:0:6523:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787384366.984446:0:6523:0:(import.c:65:import_set_state_nolock()) ffff98f7c354c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787384366.984509:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3558000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874208203248128:12345-0@lo:38: Request processed in 196us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384366.984517:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787384366.984584:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8ee115180 x1874208203248128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787384376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384366.984595:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787384366.984609:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1787384366.984616:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787384366.984620:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787384366.984622:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f7c385f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787384366.984640:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874208203248128:0@lo:38: 00000100:00100000:0.0:1787384366.985931:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3559f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203248640:0@lo:400: 00000100:00100000:0.0:1787384366.985986:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384366.986020:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3559500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203249152:0@lo:400: 00000100:00100000:0.0:1787384366.986044:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384366.986052:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203248640 00000100:00100000:1.0:1787384366.986059:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203248640 00000100:00100000:0.0:1787384366.986074:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787384366.986080:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c355a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203248256:0@lo:400: 00000100:00100000:0.0:1787384366.986103:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384366.986115:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787384366.986119:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3559180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203248768:0@lo:400: 00000100:00100000:1.0:1787384366.986124:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c355a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203248640:12345-0@lo:400: 00000100:00100000:0.0:1787384366.986147:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384366.986171:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c355b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203248384:0@lo:400: 00000100:00100000:1.0:1787384366.986181:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c355a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203248640:12345-0@lo:400: Request processed in 58us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384366.986188:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787384366.986190:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384366.986202:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203248384 00000100:00100000:0.0:1787384366.986204:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3558a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874208203248896:0@lo:400: 00000100:00100000:1.0:1787384366.986205:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203248384 00000100:00100000:1.0:1787384366.986220:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787384366.986225:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3558e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203248384:12345-0@lo:400: 00000100:00100000:0.0:1787384366.986227:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384366.986243:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787384366.986249:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c355aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203248512:0@lo:400: 00000100:00100000:1.0:1787384366.986250:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3558e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203248384:12345-0@lo:400: Request processed in 25us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384366.986256:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787384366.986267:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384366.986277:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c355bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203249024:0@lo:400: 00000100:00100000:0.0:1787384366.986296:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384366.986325:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c355b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203248384:0@lo:400: 00000100:00100000:0.0:1787384366.986352:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203249152 00000100:00100000:0.0:1787384366.986363:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203249152 00000100:00100000:0.0:1787384366.986398:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203249024 00000100:00100000:0.0:1787384366.986401:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203249024 00000100:00100000:0.0:1787384366.986423:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787384366.986429:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c355b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203249152:12345-0@lo:400: 00000100:00100000:0.0:1787384366.986459:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c355b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203249152:12345-0@lo:400: Request processed in 30us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384366.986465:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787384366.986476:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787384366.986482:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3559880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203249024:12345-0@lo:400: 00000100:00100000:1.0:1787384366.986501:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3559f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203248640:0@lo:400: 00000100:00100000:0.0:1787384366.986511:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3559880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203249024:12345-0@lo:400: Request processed in 30us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384366.986517:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787384366.986520:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f7c3559500 x1874208203249152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384366.986530:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3559500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203249152:0@lo:400: 00000100:00100000:0.0:1787384366.986532:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203248256 00000100:00100000:0.0:1787384366.986535:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203248256 00000100:00100000:0.0:1787384366.986551:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203248768 00000100:00100000:0.0:1787384366.986554:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203248768 00000100:00100000:0.0:1787384366.986567:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203248896 00000100:00100000:0.0:1787384366.986569:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203248896 00000100:00100000:0.0:1787384366.986581:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203248512 00000100:00100000:0.0:1787384366.986583:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203248512 00000100:00100000:0.0:1787384366.986595:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787384366.986601:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3558380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203248256:12345-0@lo:400: 00000100:00100000:0.0:1787384366.986772:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3558380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203248256:12345-0@lo:400: Request processed in 169us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384366.986797:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787384366.986809:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787384366.986815:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c355ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203248768:12345-0@lo:400: 00000100:00100000:0.0:1787384366.986843:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c355ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203248768:12345-0@lo:400: Request processed in 28us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384366.986855:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787384366.986866:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787384366.986872:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874208203248896:12345-0@lo:400: 00010000:00080000:1.0:1787384366.986878:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f7c355a300 x1874208203248256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384366.986888:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c355a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203248256:0@lo:400: 00000100:00100000:0.0:1787384366.986896:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874208203248896:12345-0@lo:400: Request processed in 25us (669us total) trans 0 rc 0/0 00010000:00080000:1.0:1787384366.986897:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f7c3559180 x1874208203248768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384366.986902:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787384366.986906:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3559180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203248768:0@lo:400: 00000100:00100000:0.0:1787384366.986912:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787384366.986916:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3559c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203248512:12345-0@lo:400: 00000100:00100000:0.0:1787384366.986940:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3559c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203248512:12345-0@lo:400: Request processed in 23us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384366.986945:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1787384366.986963:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787384366.986972:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787384366.986975:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787384366.987744:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f7c355aa00 x1874208203248512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384366.987755:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c355aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203248512:0@lo:400: 00010000:00080000:0.0:1787384366.987766:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f7c355bb80 x1874208203249024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384366.987773:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c355bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203249024:0@lo:400: 00010000:00080000:0.0:1787384366.987812:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f7c3558a80 x1874208203248896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384366.987820:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3558a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874208203248896:0@lo:400: 00000020:01000004:3.0:1787384366.988301:0:9532:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787384366.988315:0:9532:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff98f7c2898000) 00000100:00100000:2.0:1787384366.988333:0:9534:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee116d80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9534:1874208203249280:0@lo:901: 00000020:00000080:3.0:1787384366.988337:0:9532:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000100:00100000:2.0:1787384366.988382:0:9534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1787384366.988505:0:9532:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f8f7d47800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787384366.988509:0:9532:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f8f7d47800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787384366.988511:0:9532:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f8f7d47800 3 00010000:00080000:3.0:1787384366.988536:0:9532:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f7c3549800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.145@tcp at head 00010000:00010000:3.0:1787384366.990801:0:9532:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:3.0:1787384366.990916:0:9532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1787384366.990960:0:9532:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787384366.990973:0:9532:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x7ef423838fba26bf 00000100:00080000:3.0:1787384366.990982:0:9532:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787384366.990987:0:9532:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff98f7c3549800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:3.0:1787384366.991018:0:9532:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8fd75aa00 x1874208203249408/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787384366.991042:0:9532:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1787384366.991459:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd75aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3650:1874208203249408:0@lo:38: 00000100:00100000:0.0:1787384366.991533:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384366.991589:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203249408 00000100:00100000:0.0:1787384366.991595:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203249408 00000100:00100000:0.0:1787384366.991635:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787384366.991641:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1874208203249408:12345-0@lo:38: 00010000:00080000:0.0:1787384366.991666:0:6522:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:0.0:1787384366.991698:0:6522:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x7ef423838fba26c6 00000004:00100000:0.0:1787384366.991712:0:6522:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787384366.991742:0:6522:0:(import.c:65:import_set_state_nolock()) ffff98f8f7d8f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787384366.991808:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874208203249408:12345-0@lo:38: Request processed in 165us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384366.991815:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787384366.991854:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8fd75aa00 x1874208203249408/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787384376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384366.991863:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787384366.991870:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1787384366.991877:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787384366.991881:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787384366.991884:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f7c3549800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787384366.991890:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd75aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3650:1874208203249408:0@lo:38: 00000100:00100000:2.0:1787384366.992075:0:9534:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3948cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384366.992363:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203249280 00000100:00100000:1.0:1787384366.992368:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203249280 00000100:00100000:1.0:1787384366.992462:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787384366.992471:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9534:x1874208203249280:12345-0@lo:901: 00000100:00100000:1.0:1787384366.992606:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9534:x1874208203249280:12345-0@lo:901: Request processed in 136us (4223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384366.992612:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787384366.992704:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1787384366.996306:0:9532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:1.0:1787384366.997760:0:9515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:1.0:1787384366.997916:0:9515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787384366.997942:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba2695 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba269c expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384366.998044:0:9515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba2695 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba269c expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787384366.998187:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787384366.998194:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787384366.998195:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787384366.998196:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787384366.998197:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787384366.998199:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787384366.998200:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787384366.998201:0:9515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787384366.998202:0:9515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787384366.998204:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787384366.998205:0:9515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787384366.998208:0:9515:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1787384366.998210:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787384366.998211:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787384366.998212:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787384366.998213:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787384366.998214:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787384366.998214:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787384366.998215:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787384366.998216:0:9515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787384366.998217:0:9515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787384366.998218:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787384366.998218:0:9515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787384366.998246:0:9515:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787384366.998268:0:9515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee144a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:9515:1874208203249536:0@lo:253: 00000100:00100000:1.0:1787384366.998338:0:9515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384366.998473:0:9515:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d912b780 going to sleep for 11 seconds 00010000:00080000:1.0:1787384366.998543:0:9534:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8ee116d80 x1874208203249280/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787384382 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384366.998557:0:9534:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee116d80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9534:1874208203249280:0@lo:901: 00000100:00100000:2.0:1787384367.001752:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203249536 00000100:00100000:2.0:1787384367.001768:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203249536 00000100:00100000:2.0:1787384367.001932:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787384367.001942:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+17:9515:x1874208203249536:12345-0@lo:253: 20000000:01000000:2.0:1787384367.001989:0:6516:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787384367.002005:0:6516:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787384367.011928:0:6516:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787384367.011941:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787384367.016872:0:6537:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787384367.016882:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787384367.016907:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98f8f5825000/0x7ef423838fba26cd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384367.016926:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f8cad39a00/0x7ef423838fba25c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba25bc expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384367.016949:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f8f58cdc00/0x7ef423838fba2609 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2602 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384367.019166:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98f8f5825000/0x7ef423838fba26cd lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384367.019217:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f8f58cdc00/0x7ef423838fba2609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba2602 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384367.019231:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f8f58cdc00/0x7ef423838fba2609 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba2602 expref: 17 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384367.019247:0:6537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c355bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874208203249664:0@lo:104: 00000100:00100000:0.0:1787384367.020168:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787384367.020227:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f8cad39a00/0x7ef423838fba25c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba25bc expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384367.020238:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f8cad39a00/0x7ef423838fba25c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba25bc expref: 17 pid: 6514 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384367.020250:0:6537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c355b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874208203249792:0@lo:104: 00000100:00100000:2.0:1787384367.021199:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+17:9515:x1874208203249536:12345-0@lo:253: Request processed in 19252us (22854us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384367.021210:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787384367.021384:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384367.021416:0:6537:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7186540 going to sleep for 11 seconds 00000100:00100000:0.0:1787384367.021512:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203249664 00000100:00100000:0.0:1787384367.021520:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203249664 00000100:00100000:0.0:1787384367.021557:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203249792 00000100:00100000:0.0:1787384367.021560:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203249792 00000100:00100000:0.0:1787384367.021573:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787384367.021580:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c355aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+4:6537:x1874208203249664:12345-0@lo:104: 00010000:00010000:0.0:1787384367.021605:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f8cad38c00/0x7ef423838fba2602 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2609 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384367.021653:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787384367.021659:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c355aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+4:6537:x1874208203249664:12345-0@lo:104: Request processed in 79us (1493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384367.021665:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787384367.021677:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787384367.021683:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3559180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+3:6537:x1874208203249792:12345-0@lo:104: 00010000:00010000:0.0:1787384367.021689:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f8cad39800/0x7ef423838fba25bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba25c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384367.021718:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787384367.021723:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3559180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+3:6537:x1874208203249792:12345-0@lo:104: Request processed in 41us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384367.021729:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1787384367.021743:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787384367.021748:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8cad38c00/0x7ef423838fba2602 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2609 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384367.021755:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8cad38c00 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:0.0:1787384367.021758:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8cad38c00/0x7ef423838fba2602 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba2609 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384367.021766:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8cad38c00/0x7ef423838fba2602 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba2609 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787384367.021773:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8cad38c00/0x7ef423838fba2602 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba2609 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384367.021816:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787384367.021844:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8cad38c00/0x7ef423838fba2602 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2609 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384367.021850:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787384367.021867:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8cad38c00/0x7ef423838fba2602 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2609 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384367.021873:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8cad38c00/0x7ef423838fba2602 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2609 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384367.021886:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384367.021888:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8cad39800/0x7ef423838fba25bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba25c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384367.021893:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8cad39800 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:0.0:1787384367.021896:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8cad39800/0x7ef423838fba25bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba25c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384367.021902:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8cad39800/0x7ef423838fba25bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba25c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787384367.021908:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8cad39800/0x7ef423838fba25bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba25c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384367.021912:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787384367.021923:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8cad39800/0x7ef423838fba25bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba25c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384367.021929:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787384367.021947:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8cad39800/0x7ef423838fba25bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba25c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384367.022022:0:9515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee144a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ca80b7f5-0e34-441a-981f-ebff717028c4:9515:1874208203249536:0@lo:253: 10000000:01000000:1.0:1787384367.022034:0:9515:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787384367.022037:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787384367.022038:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787384367.022039:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787384367.022040:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787384367.022048:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787384367.022177:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787384367.022180:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787384367.022181:0:9515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787384367.022182:0:9515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787384367.022185:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787384367.022186:0:9515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787384367.022201:0:9515:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1787384367.027433:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8cad39800/0x7ef423838fba25bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba25c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384367.027456:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384367.027458:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384367.027461:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384367.027469:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384367.027514:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c355a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203249920:0@lo:103: 00000100:00100000:0.0:1787384367.027579:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384367.027653:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3559500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203250048:0@lo:103: 00000100:00100000:0.0:1787384367.027695:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384367.027761:0:6537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c355bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874208203249664:0@lo:104: 00000100:00100000:0.0:1787384367.027771:0:6537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c355b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874208203249792:0@lo:104: 00010000:00010000:0.0:1787384367.027815:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98f8f5825000/0x7ef423838fba26cd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384367.028049:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203249920 00000100:00100000:3.0:1787384367.028061:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203250048 00000100:00100000:2.0:1787384367.028064:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203249920 00000100:00100000:3.0:1787384367.028070:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203250048 00010000:00010000:2.0:1787384367.028096:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f8f58cdc00/0x7ef423838fba2609 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba2602 expref: 18 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384367.028100:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f8cad39a00/0x7ef423838fba25c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba25bc expref: 18 pid: 6514 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384367.028141:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787384367.028150:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+18:3651:x1874208203250048:12345-0@lo:103: 00010000:00010000:3.0:1787384367.028162:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384367.028167:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f8cad39a00/0x7ef423838fba25c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba25bc expref: 18 pid: 6514 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384367.028181:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f8cad39a00/0x7ef423838fba25c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba25bc expref: 18 pid: 6514 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384367.028196:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8cad39a00/0x7ef423838fba25c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba25bc expref: 18 pid: 6514 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384367.028208:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384367.028247:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+17:3651:x1874208203250048:12345-0@lo:103: Request processed in 99us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384367.028254:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787384367.028272:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787384367.028279:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3559f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+16:3654:x1874208203249920:12345-0@lo:103: 00010000:00010000:3.0:1787384367.028286:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384367.028299:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f8f58cdc00/0x7ef423838fba2609 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba2602 expref: 16 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384367.028310:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f8f58cdc00/0x7ef423838fba2609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba2602 expref: 16 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384367.028319:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f58cdc00/0x7ef423838fba2609 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba2602 expref: 16 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384367.028330:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98f8f5825000/0x7ef423838fba26cd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384367.028338:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f5825000/0x7ef423838fba26cd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787384367.028352:0:6507:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011470392s 00010000:00010000:3.0:1787384367.028362:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f8f5825000/0x7ef423838fba26cd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384367.028369:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f8f5825000/0x7ef423838fba26cd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384367.028377:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98f8f5825000/0x7ef423838fba26cd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384367.028384:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98f8f5825000/0x7ef423838fba26cd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384367.028389:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5825000 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:3.0:1787384367.028393:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98f8f5825000/0x7ef423838fba26cd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384367.028401:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98f8f5825000/0x7ef423838fba26cd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384367.028416:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98f8f5825000/0x7ef423838fba26cd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384367.028424:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384367.028452:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3559f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+15:3654:x1874208203249920:12345-0@lo:103: Request processed in 174us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384367.028459:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787384367.035875:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3559500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203250048:0@lo:103: 00010000:00010000:2.0:1787384367.035913:0:6537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98f8f5825000/0x7ef423838fba26cd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384367.035924:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98f8f5825000/0x7ef423838fba26cd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384367.035930:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f5825000/0x7ef423838fba26cd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1787384367.038398:0:9515:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1787384367.038566:0:9515:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1787384367.038749:0:9515:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1787384367.038928:0:9515:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1787384367.039123:0:9515:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1787384367.039359:0:9515:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:3.0:1787384367.040889:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c355a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203249920:0@lo:103: 00000001:00000004:3.0:1787384367.046638:0:9515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1787384367.048956:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1787384367.066342:0:9515:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787384367.066353:0:9515:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787384367.066395:0:9515:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787384367.066458:0:9515:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.145@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787384367.066478:0:9515:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1787384367.066498:0:9515:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1787384367.070500:0:9515:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787384367.070740:0:9515:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:2.0:1787384367.542927:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787384367.542951:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203250176:0@lo:13: 00000100:00100000:2.0:1787384367.543015:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384367.543065:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203250176 00000100:00100000:1.0:1787384367.543071:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203250176 00000100:00100000:1.0:1787384367.543119:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787384367.543128:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee117480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203250176:12345-0@lo:13: 00002000:00000024:1.0:1787384367.543165:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787384367.543213:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee117480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203250176:12345-0@lo:13: Request processed in 85us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384367.543220:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787384367.543253:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203250304:0@lo:13: 00000100:00100000:0.0:1787384367.543281:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384367.543318:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203250304 00000100:00100000:1.0:1787384367.543322:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203250304 00000100:00100000:1.0:1787384367.543339:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787384367.543345:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203250304:12345-0@lo:13: 00002000:00000024:1.0:1787384367.543356:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787384367.543396:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203250304:12345-0@lo:13: Request processed in 51us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384367.543402:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787384367.543466:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee114380 x1874208203250176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384383 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787384367.543471:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3ad8a80 x1874208203250304/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384383 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384367.543489:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203250176:0@lo:13: 00000100:00100000:0.0:1787384367.543489:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203250304:0@lo:13: 00010000:00010000:1.0:1787384368.058657:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787384368.414565:0:9588:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787384368.417264:0:9588:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787384369.078990:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384370.104372:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd759f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203250432:0@lo:41: 00000100:00100000:3.0:1787384370.104440:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384370.104509:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203250432 00000100:00100000:3.0:1787384370.104516:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203250432 00000100:00100000:3.0:1787384370.104563:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787384370.104572:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd759180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203250432:12345-0@lo:41: 00000004:00000024:3.0:1787384370.104605:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1787384370.104668:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd759180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203250432:12345-0@lo:41: Request processed in 79us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384370.104675:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787384370.104724:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd759f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203250432:0@lo:41: 00010000:00010000:0.0:1787384370.106422:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384370.615089:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787384370.615124:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203250560:0@lo:41: 00000100:00100000:0.0:1787384370.615189:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384370.615344:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203250560 00000100:00100000:2.0:1787384370.615351:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203250560 00000100:00100000:2.0:1787384370.615403:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787384370.615413:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203250560:12345-0@lo:41: 00000004:00000024:2.0:1787384370.615461:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1787384370.615504:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203250560:12345-0@lo:41: Request processed in 93us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384370.615512:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787384370.615729:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203250560:0@lo:41: 00010000:00010000:1.0:1787384371.126974:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384372.151960:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee144a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203250688:0@lo:400: 00000100:00100000:3.0:1787384372.152049:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787384372.152399:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384372.157297:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787384372.157319:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee146d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874208203251072:0@lo:400: 00000100:00100000:3.0:1787384372.157390:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384372.157443:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203250688 00000100:00100000:3.0:1787384372.157451:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203250688 00000100:00100000:3.0:1787384372.157496:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787384372.157504:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+15:3652:x1874208203250688:12345-0@lo:400: 00000100:00100000:3.0:1787384372.157558:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+15:3652:x1874208203250688:12345-0@lo:400: Request processed in 54us (5509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384372.157565:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787384372.157617:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203250816:0@lo:400: 00000100:00100000:3.0:1787384372.157641:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384372.157660:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384372.157666:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee145c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203250944:0@lo:400: 00000100:00100000:3.0:1787384372.157690:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384372.157719:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203251072 00000100:00100000:3.0:1787384372.157724:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203251072 00000100:00100000:3.0:1787384372.157751:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203250816 00000100:00100000:3.0:1787384372.157753:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203250816 00000100:00100000:3.0:1787384372.157771:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787384372.157797:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd759f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874208203251072:12345-0@lo:400: 00000100:00100000:3.0:1787384372.157829:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd759f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874208203251072:12345-0@lo:400: Request processed in 53us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384372.157835:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787384372.157847:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787384372.157852:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203250816:12345-0@lo:400: 00000100:00100000:3.0:1787384372.157880:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203250816:12345-0@lo:400: Request processed in 28us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384372.157886:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787384372.157909:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203250944 00000100:00100000:3.0:1787384372.157913:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203250944 00000100:00100000:3.0:1787384372.157937:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787384372.157942:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd758e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203250944:12345-0@lo:400: 00000100:00100000:3.0:1787384372.157973:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd758e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203250944:12345-0@lo:400: Request processed in 31us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384372.157979:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787384372.158289:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee145c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203250944:0@lo:400: 00010000:00080000:3.0:1787384372.158315:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee144e00 x1874208203250816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384372.158325:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203250816:0@lo:400: 00010000:00080000:3.0:1787384372.158358:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee146d80 x1874208203251072/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384372.158368:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee146d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874208203251072:0@lo:400: 00000100:00100000:3.0:1787384372.158377:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee144a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203250688:0@lo:400: 00000100:00100000:1.0:1787384372.159273:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee144700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203251584:0@lo:400: 00000100:00100000:1.0:1787384372.159323:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384372.159384:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee145880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203251200:0@lo:400: 00000100:00100000:3.0:1787384372.159413:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384372.159438:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee146680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203251712:0@lo:400: 00000100:00100000:3.0:1787384372.159466:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203251200 00000100:00100000:3.0:1787384372.159472:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203251200 00000100:00100000:3.0:1787384372.159509:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787384372.159517:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd759c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203251200:12345-0@lo:400: 00000100:00100000:3.0:1787384372.159577:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd759c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203251200:12345-0@lo:400: Request processed in 60us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384372.159584:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787384372.159766:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee147480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874208203251456:0@lo:400: 00000100:00100000:1.0:1787384372.159826:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384372.159846:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee147800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874208203251968:0@lo:400: 00000100:00100000:1.0:1787384372.159872:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384372.159891:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787384372.159897:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee144380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874208203251328:0@lo:400: 00000100:00100000:1.0:1787384372.159916:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384372.159934:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874208203251840:0@lo:400: 00000100:00100000:1.0:1787384372.159952:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384372.159978:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203251456 00000100:00100000:1.0:1787384372.159982:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203251456 00000100:00100000:1.0:1787384372.160092:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203251968 00000100:00100000:1.0:1787384372.160096:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203251968 00000100:00100000:1.0:1787384372.160123:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203251328 00000100:00100000:1.0:1787384372.160126:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203251328 00000100:00100000:1.0:1787384372.160136:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203251840 00000100:00100000:1.0:1787384372.160138:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203251840 00000100:00100000:1.0:1787384372.160150:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787384372.160156:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee144000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874208203251456:12345-0@lo:400: 00000100:00100000:1.0:1787384372.160193:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee144000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874208203251456:12345-0@lo:400: Request processed in 37us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384372.160199:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787384372.160212:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787384372.160218:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874208203251968:12345-0@lo:400: 00000100:00100000:1.0:1787384372.160243:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874208203251968:12345-0@lo:400: Request processed in 26us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384372.160256:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787384372.160268:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787384372.160274:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee147100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874208203251328:12345-0@lo:400: 00000100:00100000:1.0:1787384372.160304:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee147100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874208203251328:12345-0@lo:400: Request processed in 30us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384372.160310:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787384372.160319:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787384372.160324:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee144a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874208203251840:12345-0@lo:400: 00000100:00100000:1.0:1787384372.160350:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee144a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874208203251840:12345-0@lo:400: Request processed in 26us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384372.160355:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1787384372.160379:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787384372.160383:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787384372.160429:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee144380 x1874208203251328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384372.160441:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee144380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874208203251328:0@lo:400: 00010000:00080000:1.0:1787384372.160453:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee145500 x1874208203251840/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384372.160460:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874208203251840:0@lo:400: 00010000:00080000:1.0:1787384372.160467:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee147480 x1874208203251456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384372.160474:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee147480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874208203251456:0@lo:400: 00010000:00080000:1.0:1787384372.160482:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee147800 x1874208203251968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384372.160500:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee147800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874208203251968:0@lo:400: 00000100:00100000:2.0:1787384372.160644:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384372.169384:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee145880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203251200:0@lo:400: 00000100:00100000:0.0:1787384372.169508:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203251584 00000100:00100000:0.0:1787384372.169516:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203251584 00000100:00100000:0.0:1787384372.169589:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203251712 00000100:00100000:0.0:1787384372.169593:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203251712 00000100:00100000:1.0:1787384372.169608:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787384372.169620:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203251584:12345-0@lo:400: 00000100:00100000:0.0:1787384372.169622:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787384372.169629:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee114700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203251712:12345-0@lo:400: 00000100:00080000:2.0:1787384372.169704:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787384372.169823:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee114700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203251712:12345-0@lo:400: Request processed in 185us (9169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384372.169831:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787384372.171369:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee146680 x1874208203251712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384372.171386:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee146680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203251712:0@lo:400: 00000100:00100000:1.0:1787384372.171858:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203251584:12345-0@lo:400: Request processed in 2238us (12531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384372.171870:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787384372.171996:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee144700 x1874208203251584/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384372.172023:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee144700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203251584:0@lo:400: 00000100:00100000:0.0:1787384372.664592:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787384372.664617:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ad9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203252096:0@lo:13: 00000100:00100000:0.0:1787384372.664681:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384372.664739:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203252096 00000100:00100000:0.0:1787384372.664747:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203252096 00000100:00100000:0.0:1787384372.664830:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787384372.664839:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3adad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203252096:12345-0@lo:13: 00002000:00000024:0.0:1787384372.664867:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787384372.664910:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3adad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203252096:12345-0@lo:13: Request processed in 71us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384372.664917:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1787384372.664956:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3ad9c00 x1874208203252096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384372.664974:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ad9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203252096:0@lo:13: 00000100:00100000:0.0:1787384372.667223:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee147800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203252224:0@lo:13: 00000100:00100000:0.0:1787384372.667374:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384372.667455:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203252224 00000100:00100000:2.0:1787384372.667462:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203252224 00000100:00100000:2.0:1787384372.667510:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787384372.667518:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203252224:12345-0@lo:13: 00002000:00000024:2.0:1787384372.667539:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384372.672693:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203252224:12345-0@lo:13: Request processed in 5165us (5309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384372.672708:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1787384372.673067:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee147800 x1874208203252224/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384372.673089:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee147800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203252224:0@lo:13: 00010000:00010000:0.0:1787384373.175218:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787384373.175273:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787384373.175277:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98f8f5669000 from 39 10000000:01000000:1.0:1787384373.175282:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787384373.175323:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902158400/0x7ef423838fba26d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384373.175335:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f902158400/0x7ef423838fba26d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384373.175345:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f902158400/0x7ef423838fba26d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384373.175367:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee147480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203252352:0@lo:101: 00000100:00100000:1.0:1787384373.175435:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384373.175488:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d139c540 going to sleep for 11 seconds 00000100:00100000:0.0:1787384373.175608:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203252352 00000100:00100000:0.0:1787384373.175616:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203252352 00000100:00100000:0.0:1787384373.175670:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787384373.175679:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+15:6519:x1874208203252352:12345-0@lo:101: 00010000:00010000:0.0:1787384373.175691:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384373.175704:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8f5825200/0x7ef423838fba26db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba26d4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.175727:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f5825200/0x7ef423838fba26db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba26d4 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.175738:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8f5825200/0x7ef423838fba26db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba26d4 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.175748:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f5825200, rc 0) 00000100:00100000:0.0:1787384373.175805:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+16:6519:x1874208203252352:12345-0@lo:101: Request processed in 127us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384373.175811:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787384373.175852:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee147480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203252352:0@lo:101: 00010000:00010000:0.0:1787384373.175876:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f902158400/0x7ef423838fba26d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba26db expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.175897:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f902158400/0x7ef423838fba26d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba26db expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384373.175951:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ad9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203252480:0@lo:501: 00000100:00100000:0.0:1787384373.175975:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384373.175988:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c39480c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384373.176001:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203252480 00000100:00100000:0.0:1787384373.176004:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203252480 00000100:00100000:0.0:1787384373.176026:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787384373.176031:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+16:6519:x1874208203252480:12345-0@lo:501: 00000100:00100000:0.0:1787384373.176156:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+16:6519:x1874208203252480:12345-0@lo:501: Request processed in 124us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384373.176163:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787384373.176191:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ad9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203252480:0@lo:501: 00000100:00100000:0.0:1787384373.176214:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ad9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203252608:0@lo:503: 00000100:00100000:0.0:1787384373.176248:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384373.176259:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c39480c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384373.176268:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203252608 00000100:00100000:0.0:1787384373.176271:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203252608 00000100:00100000:0.0:1787384373.176288:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787384373.176294:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+16:6519:x1874208203252608:12345-0@lo:503: 00000100:00100000:0.0:1787384373.176368:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+16:6519:x1874208203252608:12345-0@lo:503: Request processed in 73us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384373.176374:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787384373.176412:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ad9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203252608:0@lo:503: 00000100:00100000:0.0:1787384373.176624:0:9821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ad9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:9821:1874208203252736:0@lo:502: 00000100:00100000:0.0:1787384373.176657:0:9821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384373.176675:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203252736 00000100:00100000:0.0:1787384373.176678:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203252736 00000100:00100000:0.0:1787384373.176696:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787384373.176702:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+16:9821:x1874208203252736:12345-0@lo:502: 00000100:00100000:0.0:1787384373.176768:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+16:9821:x1874208203252736:12345-0@lo:502: Request processed in 65us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384373.176775:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787384373.176822:0:9821:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3948540 going to sleep for 11 seconds 00000100:00100000:0.0:1787384373.176833:0:9821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ad9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:9821:1874208203252736:0@lo:502: 00000100:00100000:0.0:1787384373.176867:0:9821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ad9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:9821:1874208203252864:0@lo:502: 00000100:00100000:0.0:1787384373.176895:0:9821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384373.176911:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203252864 00000100:00100000:0.0:1787384373.176915:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203252864 00000100:00100000:0.0:1787384373.176932:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787384373.176937:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+16:9821:x1874208203252864:12345-0@lo:502: 00000100:00100000:0.0:1787384373.176988:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+16:9821:x1874208203252864:12345-0@lo:502: Request processed in 49us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384373.176994:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787384373.177020:0:9821:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3948540 going to sleep for 11 seconds 00000100:00100000:0.0:1787384373.177031:0:9821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ad9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:9821:1874208203252864:0@lo:502: 00000040:00080000:0.0:1787384373.177047:0:9821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1787384373.177106:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1787384373.177120:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787384373.177127:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902158400/0x7ef423838fba26d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba26db expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.177141:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f902158400/0x7ef423838fba26d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba26db expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384373.177149:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787384373.177152:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1787384373.177154:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787384373.177171:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f5824400/0x7ef423838fba26e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.177179:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8f5824400/0x7ef423838fba26e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.177187:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8f5824400/0x7ef423838fba26e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384373.177199:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ad9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203252992:0@lo:101: 00000100:00100000:0.0:1787384373.177224:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384373.177237:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3948540 going to sleep for 11 seconds 00000100:00100000:0.0:1787384373.177247:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203252992 00000100:00100000:0.0:1787384373.177250:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203252992 00000100:00100000:0.0:1787384373.177271:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787384373.177277:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+16:6519:x1874208203252992:12345-0@lo:101: 00010000:00010000:0.0:1787384373.177283:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384373.177292:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8f5824a00/0x7ef423838fba26e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba26e2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.177308:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f5824a00/0x7ef423838fba26e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba26e2 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.177326:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8f5824a00/0x7ef423838fba26e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba26e2 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.177334:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f5824a00, rc 0) 00000100:00100000:0.0:1787384373.177361:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+17:6519:x1874208203252992:12345-0@lo:101: Request processed in 85us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384373.177367:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787384373.177396:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ad9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203252992:0@lo:101: 00010000:00010000:0.0:1787384373.177406:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8f5824400/0x7ef423838fba26e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba26e9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.177413:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8f5824400/0x7ef423838fba26e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba26e9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384373.177447:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ad9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203253120:0@lo:501: 00000100:00100000:0.0:1787384373.177469:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384373.177481:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3948540 going to sleep for 11 seconds 00000100:00100000:0.0:1787384373.177491:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203253120 00000100:00100000:0.0:1787384373.177494:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203253120 00000100:00100000:0.0:1787384373.177515:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787384373.177521:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+17:6519:x1874208203253120:12345-0@lo:501: 00000100:00100000:0.0:1787384373.177598:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+17:6519:x1874208203253120:12345-0@lo:501: Request processed in 77us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384373.177605:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787384373.177633:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ad9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203253120:0@lo:501: 00000100:00100000:0.0:1787384373.177653:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ad9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203253248:0@lo:503: 00000100:00100000:0.0:1787384373.177688:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384373.177701:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3948540 going to sleep for 11 seconds 00000100:00100000:0.0:1787384373.177712:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203253248 00000100:00100000:0.0:1787384373.177715:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203253248 00000100:00100000:0.0:1787384373.177735:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787384373.177740:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+17:6519:x1874208203253248:12345-0@lo:503: 00000100:00100000:0.0:1787384373.177823:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+17:6519:x1874208203253248:12345-0@lo:503: Request processed in 81us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384373.177830:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787384373.177865:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ad9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203253248:0@lo:503: 00000100:00100000:0.0:1787384373.184000:0:9822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ad9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:9822:1874208203253376:0@lo:502: 00000100:00100000:0.0:1787384373.184081:0:9822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384373.184236:0:9822:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3948540 going to sleep for 11 seconds 00000100:00100000:2.0:1787384373.184823:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203253376 00000100:00100000:2.0:1787384373.184831:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203253376 00000100:00100000:2.0:1787384373.184884:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787384373.184893:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+17:9822:x1874208203253376:12345-0@lo:502: 00000100:00100000:2.0:1787384373.189142:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+17:9822:x1874208203253376:12345-0@lo:502: Request processed in 4241us (5052us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384373.189157:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787384373.189204:0:9822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ad9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:9822:1874208203253376:0@lo:502: 00000020:01000000:3.0:1787384373.189242:0:9822:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787384373.189252:0:9822:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384373.189260:0:9822:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787384373.189265:0:9822:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787384373.189267:0:9822:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787384373.189311:0:9822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd75aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:9822:1874208203253504:0@lo:502: 00000100:00100000:3.0:1787384373.189358:0:9822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384373.189405:0:9822:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9462600 going to sleep for 11 seconds 00000100:00100000:0.0:1787384373.189441:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203253504 00000100:00100000:0.0:1787384373.189448:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203253504 00000100:00100000:0.0:1787384373.189489:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787384373.189499:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+17:9822:x1874208203253504:12345-0@lo:502: 00000100:00100000:0.0:1787384373.189608:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+17:9822:x1874208203253504:12345-0@lo:502: Request processed in 110us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384373.189615:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787384373.189659:0:9822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd75aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:9822:1874208203253504:0@lo:502: 00000020:01000000:3.0:1787384373.189677:0:9822:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787384373.189681:0:9822:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384373.189683:0:9822:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787384373.189686:0:9822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1787384373.192398:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1787384373.192437:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787384373.192449:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f5824400/0x7ef423838fba26e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba26e9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.192462:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8f5824400/0x7ef423838fba26e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba26e9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384373.192487:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787384373.192490:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98f8f5698000 from 39 10000000:01000000:0.0:1787384373.192493:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787384373.192600:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f5825600/0x7ef423838fba26f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.192609:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8f5825600/0x7ef423838fba26f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.192619:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8f5825600/0x7ef423838fba26f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384373.192642:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ad8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203253632:0@lo:101: 00000100:00100000:0.0:1787384373.192705:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384373.192751:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3948f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787384373.192956:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203253632 00000100:00100000:3.0:1787384373.192963:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203253632 00000100:00100000:3.0:1787384373.193014:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787384373.193024:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+17:6519:x1874208203253632:12345-0@lo:101: 00010000:00010000:3.0:1787384373.193040:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384373.193053:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c2090c00/0x7ef423838fba26f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba26f0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384373.193075:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c2090c00/0x7ef423838fba26f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba26f0 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384373.193085:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c2090c00/0x7ef423838fba26f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba26f0 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384373.193104:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2090c00, rc 0) 00000100:00100000:3.0:1787384373.193145:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+18:6519:x1874208203253632:12345-0@lo:101: Request processed in 122us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384373.193152:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787384373.193202:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ad8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203253632:0@lo:101: 00010000:00010000:3.0:1787384373.193222:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8f5825600/0x7ef423838fba26f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba26f7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384373.193230:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8f5825600/0x7ef423838fba26f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba26f7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384373.193544:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd75aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203253760:0@lo:501: 00000100:00100000:3.0:1787384373.193578:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384373.193609:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9462780 going to sleep for 11 seconds 00000100:00100000:3.0:1787384373.193622:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203253760 00000100:00100000:3.0:1787384373.193625:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203253760 00000100:00100000:3.0:1787384373.193650:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787384373.193656:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+18:6519:x1874208203253760:12345-0@lo:501: 00000100:00100000:3.0:1787384373.193800:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+18:6519:x1874208203253760:12345-0@lo:501: Request processed in 118us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384373.193808:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787384373.193957:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd75aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203253760:0@lo:501: 00000100:00100000:3.0:1787384373.193990:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd75aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203253888:0@lo:503: 00000100:00100000:3.0:1787384373.194028:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384373.194045:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fc1d8240 going to sleep for 11 seconds 00000100:00100000:1.0:1787384373.196849:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203253888 00000100:00100000:1.0:1787384373.196862:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203253888 00000100:00100000:1.0:1787384373.196963:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787384373.196974:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+18:6519:x1874208203253888:12345-0@lo:503: 00000100:00100000:1.0:1787384373.197303:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+18:6519:x1874208203253888:12345-0@lo:503: Request processed in 330us (3273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384373.197423:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787384373.197490:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd75aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203253888:0@lo:503: 00000100:00100000:1.0:1787384373.197889:0:9823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee145500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:9823:1874208203254016:0@lo:502: 00000100:00100000:1.0:1787384373.197937:0:9823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384373.197966:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203254016 00000100:00100000:1.0:1787384373.197971:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203254016 00000100:00100000:1.0:1787384373.197999:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787384373.198007:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+18:9823:x1874208203254016:12345-0@lo:502: 00000100:00100000:0.0:1787384373.198946:0:9823:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d139cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787384373.200215:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+18:9823:x1874208203254016:12345-0@lo:502: Request processed in 2198us (2267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384373.200225:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787384373.203498:0:9823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee145500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:9823:1874208203254016:0@lo:502: 00000100:00100000:2.0:1787384373.203587:0:9823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee114380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:9823:1874208203254144:0@lo:502: 00000100:00100000:2.0:1787384373.203656:0:9823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384373.203698:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203254144 00000100:00100000:2.0:1787384373.203704:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203254144 00000100:00100000:2.0:1787384373.203763:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787384373.203805:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+18:9823:x1874208203254144:12345-0@lo:502: 00000100:00100000:2.0:1787384373.203915:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+18:9823:x1874208203254144:12345-0@lo:502: Request processed in 139us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384373.203923:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787384373.203966:0:9823:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7ea7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384373.203979:0:9823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee114380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:9823:1874208203254144:0@lo:502: 00000040:00080000:2.0:1787384373.204000:0:9823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1787384373.207177:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1787384373.207216:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787384373.207228:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f5825600/0x7ef423838fba26f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba26f7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384373.207241:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8f5825600/0x7ef423838fba26f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba26f7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384373.207253:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787384373.207256:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98f8f5698000 from 6 10000000:01000000:1.0:1787384373.207259:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787384373.207302:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba26fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384373.207312:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba26fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384373.207341:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba26fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384373.207363:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee144380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203254272:0@lo:101: 00000100:00100000:1.0:1787384373.207426:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384373.207484:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8e8ab9180 going to sleep for 11 seconds 00000100:00100000:0.0:1787384373.207806:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203254272 00000100:00100000:0.0:1787384373.207814:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203254272 00000100:00100000:0.0:1787384373.207866:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787384373.207876:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+18:6519:x1874208203254272:12345-0@lo:101: 00010000:00010000:0.0:1787384373.207890:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384373.207905:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8f5824e00/0x7ef423838fba2705 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba26fe expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.207928:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f5824e00/0x7ef423838fba2705 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba26fe expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.207939:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8f5824e00/0x7ef423838fba2705 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba26fe expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.207959:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f5824e00, rc 0) 00000100:00100000:0.0:1787384373.211224:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+19:6519:x1874208203254272:12345-0@lo:101: Request processed in 3340us (3788us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384373.211237:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787384373.211431:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee144380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203254272:0@lo:101: 00010000:00010000:1.0:1787384373.211453:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba26fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2705 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384373.211464:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba26fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2705 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384373.211535:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee144380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203254400:0@lo:256: 00000100:00100000:1.0:1787384373.211589:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384373.211627:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8e8ab9180 going to sleep for 11 seconds 00000100:00100000:0.0:1787384373.211714:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203254400 00000100:00100000:0.0:1787384373.211721:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203254400 00000100:00100000:0.0:1787384373.211772:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787384373.212172:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+19:6519:x1874208203254400:12345-0@lo:256: 20000000:01000000:1.0:1787384373.212195:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787384373.212212:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787384373.212215:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1787384373.212315:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+19:6519:x1874208203254400:12345-0@lo:256: Request processed in 211us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384373.212322:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787384373.212395:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee144380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203254400:0@lo:256: 10000000:01000000:0.0:1787384373.212436:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787384373.212444:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba26fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2705 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.212452:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba26fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2705 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384373.212459:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1787384373.212462:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:0.0:1787384373.212464:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1787384373.212488:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f5825400/0x7ef423838fba270c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.212494:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8f5825400/0x7ef423838fba270c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.212502:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8f5825400/0x7ef423838fba270c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384373.212516:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3adb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203254528:0@lo:101: 00000100:00100000:0.0:1787384373.212550:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384373.212822:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3948cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384373.213114:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203254528 00000100:00100000:1.0:1787384373.213120:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203254528 00000100:00100000:1.0:1787384373.213165:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787384373.213179:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+19:6519:x1874208203254528:12345-0@lo:101: 00010000:00010000:1.0:1787384373.213189:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384373.213202:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f902159400/0x7ef423838fba2713 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba270c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384373.213223:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f902159400/0x7ef423838fba2713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba270c expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384373.213233:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f902159400/0x7ef423838fba2713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba270c expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384373.213242:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f902159400, rc 0) 00000100:00100000:1.0:1787384373.213279:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+20:6519:x1874208203254528:12345-0@lo:101: Request processed in 101us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384373.213285:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787384373.213531:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3adb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203254528:0@lo:101: 00010000:00010000:0.0:1787384373.213546:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8f5825400/0x7ef423838fba270c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2713 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.213555:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8f5825400/0x7ef423838fba270c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2713 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384373.213608:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3adb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203254656:0@lo:501: 00000100:00100000:0.0:1787384373.213632:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384373.213653:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3948cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384373.213844:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203254656 00000100:00100000:1.0:1787384373.213849:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203254656 00000100:00100000:1.0:1787384373.213869:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787384373.213875:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+20:6519:x1874208203254656:12345-0@lo:501: 00000100:00100000:1.0:1787384373.221123:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+20:6519:x1874208203254656:12345-0@lo:501: Request processed in 7239us (7481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384373.221135:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787384373.223451:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3adb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203254656:0@lo:501: 00000100:00100000:0.0:1787384373.223537:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3adb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203254784:0@lo:503: 00000100:00100000:0.0:1787384373.223604:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384373.223652:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3948cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384373.227435:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203254784 00000100:00100000:1.0:1787384373.227452:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203254784 00000100:00100000:1.0:1787384373.227518:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787384373.227529:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+20:6519:x1874208203254784:12345-0@lo:503: 00000100:00100000:1.0:1787384373.227686:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+20:6519:x1874208203254784:12345-0@lo:503: Request processed in 158us (4080us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384373.227703:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787384373.227794:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3adb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203254784:0@lo:503: 00000100:00100000:1.0:1787384373.228001:0:9824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee146d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:9824:1874208203254912:0@lo:502: 00000100:00100000:1.0:1787384373.228044:0:9824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384373.228068:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203254912 00000100:00100000:1.0:1787384373.228071:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203254912 00000100:00100000:1.0:1787384373.228100:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787384373.228107:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cacee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+20:9824:x1874208203254912:12345-0@lo:502: 00000100:00100000:1.0:1787384373.228174:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cacee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+20:9824:x1874208203254912:12345-0@lo:502: Request processed in 67us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384373.228181:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787384373.228219:0:9824:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8e8ab9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787384373.228231:0:9824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee146d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:9824:1874208203254912:0@lo:502: 00000020:01000000:1.0:1787384373.228252:0:9824:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787384373.228259:0:9824:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1787384373.228266:0:9824:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384373.228268:0:9824:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787384373.228273:0:9824:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787384373.228277:0:9824:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.145@tcp to nid 0x20000c0a8cb91 (192.168.203.145@tcp) 00000020:01000000:1.0:1787384373.228296:0:9824:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787384373.228299:0:9824:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787384373.228312:0:9824:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff98f8f1814d40) 00000020:00000080:1.0:1787384373.228334:0:9824:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1787384373.228339:0:9824:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787384373.228411:0:9824:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1787384373.228417:0:9824:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787384373.228431:0:9824:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7ef423838fba2721 00010000:00080000:1.0:1787384373.228460:0:9824:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f8f7d24800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.145@tcp at head 00010000:00010000:1.0:1787384373.228701:0:9824:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1787384373.228837:0:9824:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1787384373.228849:0:9824:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1787384373.229001:0:9824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787384373.229127:0:9824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787384373.229280:0:9824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1787384373.229400:0:9824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1787384373.233711:0:9825:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787384373.233719:0:9825:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787384373.234433:0:9824:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787384373.234446:0:9824:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787384373.234493:0:9824:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787384373.234518:0:9824:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7ef423838fba2728 00000100:00080000:2.0:1787384373.234527:0:9824:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787384373.234532:0:9824:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98f8f7d24800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:2.0:1787384373.234563:0:9824:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8ee114380 x1874208203255040/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787384373.234589:0:9824:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787384373.234631:0:9824:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384373.234635:0:9824:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384373.234637:0:9824:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787384373.234639:0:9824:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787384373.234643:0:9824:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384373.234644:0:9824:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787384373.234647:0:9824:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787384373.234648:0:9824:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787384373.234671:0:9824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee116d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:9824:1874208203255168:0@lo:502: 00000100:00100000:2.0:1787384373.234751:0:9824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384373.234815:0:9824:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7ea7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787384373.235112:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203255040:0@lo:8: 00000100:00100000:1.0:1787384373.235151:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384373.235272:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203255168 00000100:00100000:1.0:1787384373.235279:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203255168 00000100:00100000:1.0:1787384373.235319:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787384373.235328:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cacecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+20:9824:x1874208203255168:12345-0@lo:502: 00000100:00100000:1.0:1787384373.235447:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cacecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+20:9824:x1874208203255168:12345-0@lo:502: Request processed in 119us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384373.235455:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787384373.235493:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203255296:0@lo:400: 00000100:00100000:1.0:1787384373.235519:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384373.235535:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee144380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203255808:0@lo:400: 00000100:00100000:1.0:1787384373.235561:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384373.235578:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee144700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203256320:0@lo:400: 00000100:00100000:1.0:1787384373.235597:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384373.235614:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787384373.235619:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee145c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203255424:0@lo:400: 00000100:00100000:1.0:1787384373.235640:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384373.235658:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203255936:0@lo:400: 00000100:00100000:1.0:1787384373.235685:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384373.235701:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee146680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874208203256448:0@lo:400: 00000100:00100000:1.0:1787384373.235719:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384373.235746:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee145180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203255552:0@lo:400: 00000100:00100000:1.0:1787384373.235769:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384373.235809:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee147480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203256064:0@lo:400: 00000100:00100000:1.0:1787384373.235831:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384373.235852:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787384373.235858:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee145f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203255680:0@lo:400: 00000100:00100000:1.0:1787384373.235877:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384373.235894:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee147800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203256192:0@lo:400: 00000100:00100000:1.0:1787384373.235911:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384373.235942:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203255296 00000100:00100000:1.0:1787384373.235946:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203255296 00000100:00100000:1.0:1787384373.235966:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203255808 00000100:00100000:1.0:1787384373.235968:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203255808 00000100:00100000:1.0:1787384373.235981:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203256320 00000100:00100000:1.0:1787384373.235983:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203256320 00000100:00100000:1.0:1787384373.235992:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203255936 00000100:00100000:1.0:1787384373.235994:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203255936 00000100:00100000:1.0:1787384373.236003:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203256448 00000100:00100000:1.0:1787384373.236005:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203256448 00000100:00100000:1.0:1787384373.236015:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203255552 00000100:00100000:1.0:1787384373.236017:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203255552 00000100:00100000:1.0:1787384373.236029:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787384373.236035:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee145880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203255296:12345-0@lo:400: 00000100:00100000:1.0:1787384373.236073:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee145880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203255296:12345-0@lo:400: Request processed in 38us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384373.236089:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787384373.236115:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787384373.236121:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203255808:12345-0@lo:400: 00000100:00100000:1.0:1787384373.236151:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203255808:12345-0@lo:400: Request processed in 30us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384373.236156:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787384373.236169:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787384373.236174:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee28a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874208203256320:12345-0@lo:400: 00000100:00100000:1.0:1787384373.236199:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee28a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874208203256320:12345-0@lo:400: Request processed in 25us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384373.236204:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787384373.236214:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787384373.236219:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee28b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203255936:12345-0@lo:400: 00000100:00100000:1.0:1787384373.236254:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee28b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203255936:12345-0@lo:400: Request processed in 35us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384373.236260:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787384373.236270:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787384373.236275:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee28b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874208203256448:12345-0@lo:400: 00000100:00100000:1.0:1787384373.236297:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee28b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874208203256448:12345-0@lo:400: Request processed in 22us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384373.236302:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787384373.236312:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787384373.236318:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee28aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203255552:12345-0@lo:400: 00000100:00100000:1.0:1787384373.236344:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee28aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203255552:12345-0@lo:400: Request processed in 27us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384373.236357:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787384373.236381:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203255424 00000100:00100000:1.0:1787384373.236385:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203255424 00000100:00100000:1.0:1787384373.236406:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203255680 00000100:00100000:1.0:1787384373.236408:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203255680 00000100:00100000:1.0:1787384373.236419:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787384373.236423:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee28ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203255424:12345-0@lo:400: 00000100:00100000:1.0:1787384373.236451:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee28ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203255424:12345-0@lo:400: Request processed in 28us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384373.236456:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787384373.236466:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787384373.236471:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203255680:12345-0@lo:400: 00000100:00100000:1.0:1787384373.236495:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203255680:12345-0@lo:400: Request processed in 24us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384373.236500:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787384373.236516:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203255040 00000100:00100000:1.0:1787384373.236519:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203255040 00000100:00100000:1.0:1787384373.236535:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203256064 00000100:00100000:1.0:1787384373.236537:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203256064 00000100:00100000:1.0:1787384373.236549:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203256192 00000100:00100000:1.0:1787384373.236552:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203256192 00000100:00100000:1.0:1787384373.236564:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787384373.236568:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee28bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203256064:12345-0@lo:400: 00000100:00100000:1.0:1787384373.236597:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee28bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203256064:12345-0@lo:400: Request processed in 27us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384373.236602:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787384373.236612:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787384373.236618:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203256192:12345-0@lo:400: 00000100:00100000:1.0:1787384373.236651:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203256192:12345-0@lo:400: Request processed in 33us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384373.236657:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787384373.236667:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787384373.236670:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3650:x1874208203255040:12345-0@lo:8: 00010000:00080000:1.0:1787384373.236695:0:8436:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:1.0:1787384373.236719:0:8436:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7ef423838fba272f 00002000:00100000:1.0:1787384373.236732:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff98f8f7d23800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113671 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1787384373.236736:0:8436:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:1.0:1787384373.236739:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1787384373.236819:0:8436:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787384373.237025:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1787384373.237046:0:8436:0:(import.c:65:import_set_state_nolock()) ffff98f8f7d27800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787384373.237085:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3650:x1874208203255040:12345-0@lo:8: Request processed in 412us (1933us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384373.237105:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1787384373.237152:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee114380 x1874208203255040/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787384383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384373.237163:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787384373.237170:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1787384373.237177:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787384373.237181:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787384373.237183:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f7d24800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787384373.237190:0:3650:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787384373.237195:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203255040:0@lo:8: 00000100:00100000:1.0:1787384373.237227:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee145f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203255680:0@lo:400: 00010000:00080000:1.0:1787384373.237248:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee147800 x1874208203256192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384373.237257:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee147800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203256192:0@lo:400: 00010000:00080000:1.0:1787384373.237266:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee145180 x1874208203255552/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384373.237273:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee145180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203255552:0@lo:400: 00010000:00080000:1.0:1787384373.237282:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee147480 x1874208203256064/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384373.237288:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee147480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203256064:0@lo:400: 00000100:00100000:1.0:1787384373.237319:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee145c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203255424:0@lo:400: 00010000:00080000:1.0:1787384373.237329:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee145500 x1874208203255936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384373.237337:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203255936:0@lo:400: 00010000:00080000:1.0:1787384373.237345:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee146680 x1874208203256448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384373.237352:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee146680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874208203256448:0@lo:400: 00010000:00080000:1.0:1787384373.237362:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee144e00 x1874208203255296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384373.237369:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203255296:0@lo:400: 00010000:00080000:1.0:1787384373.237381:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee144380 x1874208203255808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384373.237388:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee144380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203255808:0@lo:400: 00010000:00080000:1.0:1787384373.237406:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee144700 x1874208203256320/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384373.237414:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee144700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203256320:0@lo:400: 00000100:00100000:1.0:1787384373.237464:0:9826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee144700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9826:1874208203256576:0@lo:700: 00000100:00100000:1.0:1787384373.237493:0:9826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384373.237513:0:9826:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8293840 going to sleep for 11 seconds 00000004:00080000:2.0:1787384373.237647:0:9825:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787384373.237700:0:9825:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 268317921047ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787384373.237707:0:9825:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1787384373.238046:0:9824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee116d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:9824:1874208203255168:0@lo:502: 00000020:01000000:2.0:1787384373.238079:0:9824:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384373.238086:0:9824:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384373.238089:0:9824:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787384373.238102:0:9824:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:1.0:1787384373.242180:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:1.0:1787384373.242217:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1787384373.242228:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f5825400/0x7ef423838fba270c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2713 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384373.242241:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8f5825400/0x7ef423838fba270c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2713 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384373.242253:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787384373.242256:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98f8c896e000 from 39 10000000:01000000:1.0:1787384373.242259:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787384373.242297:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902159200/0x7ef423838fba2736 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384373.242306:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f902159200/0x7ef423838fba2736 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384373.242316:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f902159200/0x7ef423838fba2736 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384373.242338:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee144e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203256704:0@lo:101: 00000100:00100000:1.0:1787384373.242395:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384373.242457:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c6361840 going to sleep for 11 seconds 00000100:00100000:2.0:1787384373.242591:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203256576 00000100:00100000:2.0:1787384373.242599:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203256576 00000100:00100000:2.0:1787384373.242660:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787384373.242668:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9826:x1874208203256576:12345-0@lo:700: 00000100:00100000:2.0:1787384373.242702:0:8446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee116d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8446:1874208203256832:0@lo:700: 00000100:00100000:2.0:1787384373.242730:0:8446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384373.242745:0:8446:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7ea7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787384373.243003:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203256704 00000100:00100000:0.0:1787384373.243007:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203256704 00000100:00100000:0.0:1787384373.243039:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787384373.243045:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cacec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+20:6519:x1874208203256704:12345-0@lo:101: 00010000:00010000:0.0:1787384373.243054:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384373.243065:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8f5824600/0x7ef423838fba273d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba2736 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.243086:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f5824600/0x7ef423838fba273d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba2736 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.243107:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8f5824600/0x7ef423838fba273d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2736 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.243122:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f5824600, rc 0) 00000100:00100000:0.0:1787384373.243161:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cacec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+21:6519:x1874208203256704:12345-0@lo:101: Request processed in 117us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384373.243168:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787384373.243199:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203256832 00000100:00100000:0.0:1787384373.243202:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203256832 00000100:00100000:0.0:1787384373.243239:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787384373.243246:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee115180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8446:x1874208203256832:12345-0@lo:700: 00000100:00100000:0.0:1787384373.243402:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee144e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203256704:0@lo:101: 00010000:00010000:0.0:1787384373.243416:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f902159200/0x7ef423838fba2736 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba273d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.243424:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f902159200/0x7ef423838fba2736 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba273d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384373.243480:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ad8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203256960:0@lo:501: 00000100:00100000:0.0:1787384373.243505:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384373.243526:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3948cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384373.243538:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203256960 00000100:00100000:0.0:1787384373.243541:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203256960 00000100:00100000:0.0:1787384373.243563:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787384373.243568:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+21:6519:x1874208203256960:12345-0@lo:501: 00000100:00100000:0.0:1787384373.243663:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+21:6519:x1874208203256960:12345-0@lo:501: Request processed in 93us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384373.243670:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787384373.243708:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ad8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203256960:0@lo:501: 00000100:00100000:0.0:1787384373.243731:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ad8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203257088:0@lo:503: 00000100:00100000:0.0:1787384373.243769:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384373.243817:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3948cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384373.243829:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203257088 00000100:00100000:0.0:1787384373.243833:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203257088 00000100:00100000:0.0:1787384373.243854:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787384373.243859:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+21:6519:x1874208203257088:12345-0@lo:503: 00000100:00100000:0.0:1787384373.243930:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+21:6519:x1874208203257088:12345-0@lo:503: Request processed in 71us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384373.243937:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787384373.243978:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ad8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203257088:0@lo:503: 00000100:00100000:0.0:1787384373.244171:0:9827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ad8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:9827:1874208203257216:0@lo:502: 00000100:00100000:0.0:1787384373.244208:0:9827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384373.244225:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203257216 00000100:00100000:0.0:1787384373.244229:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203257216 00000100:00100000:0.0:1787384373.244250:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787384373.244255:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+21:9827:x1874208203257216:12345-0@lo:502: 00000100:00100000:0.0:1787384373.244318:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+21:9827:x1874208203257216:12345-0@lo:502: Request processed in 63us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384373.244325:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787384373.244351:0:9827:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f1b9f840 going to sleep for 11 seconds 00000100:00100000:0.0:1787384373.244362:0:9827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ad8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:9827:1874208203257216:0@lo:502: 00000100:00100000:0.0:1787384373.244398:0:9827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ad8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:9827:1874208203257344:0@lo:502: 00000100:00100000:0.0:1787384373.244428:0:9827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384373.244450:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203257344 00000100:00100000:0.0:1787384373.244454:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203257344 00000100:00100000:0.0:1787384373.244473:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787384373.244478:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+21:9827:x1874208203257344:12345-0@lo:502: 00000100:00100000:0.0:1787384373.244531:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+21:9827:x1874208203257344:12345-0@lo:502: Request processed in 52us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384373.244537:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787384373.244572:0:9827:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d0c4cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787384373.244583:0:9827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ad8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:9827:1874208203257344:0@lo:502: 00000040:00080000:0.0:1787384373.244599:0:9827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1787384373.244641:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1787384373.244654:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787384373.244660:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902159200/0x7ef423838fba2736 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba273d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.244670:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f902159200/0x7ef423838fba2736 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba273d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384373.244679:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787384373.244682:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98f8c896e000 from 6 10000000:01000000:0.0:1787384373.244685:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787384373.244704:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f5824000/0x7ef423838fba2744 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.244711:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8f5824000/0x7ef423838fba2744 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.244720:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8f5824000/0x7ef423838fba2744 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384373.244746:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ad8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203257472:0@lo:101: 00000100:00100000:0.0:1787384373.244770:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384373.244803:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d0c4cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787384373.244815:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203257472 00000100:00100000:0.0:1787384373.244819:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203257472 00000100:00100000:0.0:1787384373.244839:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787384373.244845:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+21:6519:x1874208203257472:12345-0@lo:101: 00010000:00010000:0.0:1787384373.244852:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384373.244862:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8f5825800/0x7ef423838fba274b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba2744 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.244880:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f5825800/0x7ef423838fba274b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba2744 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.244889:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8f5825800/0x7ef423838fba274b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2744 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.244898:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f5825800, rc 0) 00000100:00100000:0.0:1787384373.244923:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+22:6519:x1874208203257472:12345-0@lo:101: Request processed in 78us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384373.244930:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787384373.244956:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ad8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203257472:0@lo:101: 00010000:00010000:0.0:1787384373.244967:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8f5824000/0x7ef423838fba2744 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba274b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.244975:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8f5824000/0x7ef423838fba2744 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba274b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384373.245021:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ad8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203257600:0@lo:256: 00000100:00100000:0.0:1787384373.245047:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384373.245058:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d0c4cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787384373.245069:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203257600 00000100:00100000:0.0:1787384373.245072:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203257600 00000100:00100000:0.0:1787384373.245102:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787384373.245109:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+22:6519:x1874208203257600:12345-0@lo:256: 20000000:01000000:0.0:1787384373.245121:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787384373.245135:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787384373.245138:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1787384373.245207:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+22:6519:x1874208203257600:12345-0@lo:256: Request processed in 97us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384373.245214:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787384373.245242:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ad8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203257600:0@lo:256: 10000000:01000000:0.0:1787384373.245279:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787384373.245285:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f5824000/0x7ef423838fba2744 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba274b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.245292:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8f5824000/0x7ef423838fba2744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba274b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384373.245299:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787384373.245301:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1787384373.245303:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787384373.245316:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f5825c00/0x7ef423838fba2752 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.245332:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8f5825c00/0x7ef423838fba2752 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.245338:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8f5825c00/0x7ef423838fba2752 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384373.245349:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ad8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203257728:0@lo:101: 00000100:00100000:0.0:1787384373.245370:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384373.245382:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f5769d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787384373.245393:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203257728 00000100:00100000:0.0:1787384373.245396:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203257728 00000100:00100000:0.0:1787384373.245415:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787384373.245421:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+22:6519:x1874208203257728:12345-0@lo:101: 00010000:00010000:0.0:1787384373.245427:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384373.245434:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8f5824c00/0x7ef423838fba2759 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba2752 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.245447:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f5824c00/0x7ef423838fba2759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba2752 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.245455:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8f5824c00/0x7ef423838fba2759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2752 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.245461:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f5824c00, rc 0) 00000100:00100000:0.0:1787384373.245485:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+23:6519:x1874208203257728:12345-0@lo:101: Request processed in 64us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384373.245490:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787384373.245515:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ad8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203257728:0@lo:101: 00010000:00010000:0.0:1787384373.245530:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8f5825c00/0x7ef423838fba2752 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2759 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.245537:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8f5825c00/0x7ef423838fba2752 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2759 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384373.245571:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ad8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203257856:0@lo:501: 00000100:00100000:0.0:1787384373.245593:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384373.245603:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f5769d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787384373.245614:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203257856 00000100:00100000:0.0:1787384373.245616:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203257856 00000100:00100000:0.0:1787384373.245634:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787384373.245639:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+23:6519:x1874208203257856:12345-0@lo:501: 00000100:00100000:0.0:1787384373.245717:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+23:6519:x1874208203257856:12345-0@lo:501: Request processed in 76us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384373.245723:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787384373.245750:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ad8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203257856:0@lo:501: 00000100:00100000:0.0:1787384373.245770:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ad8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203257984:0@lo:503: 00000100:00100000:0.0:1787384373.245827:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384373.245840:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f5769d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787384373.245850:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203257984 00000100:00100000:0.0:1787384373.245853:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203257984 00000100:00100000:0.0:1787384373.245872:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787384373.245878:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+23:6519:x1874208203257984:12345-0@lo:503: 00000100:00100000:0.0:1787384373.245945:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+23:6519:x1874208203257984:12345-0@lo:503: Request processed in 67us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384373.245953:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787384373.245991:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ad8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203257984:0@lo:503: 00000100:00080000:1.0:1787384373.246351:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 40000000:02000000:1.0:1787384373.254830:0:6528:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000004:00080000:0.0:1787384373.256527:0:7452:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:3.0:1787384373.256764:0:9828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd75b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:9828:1874208203258112:0@lo:502: 00000100:00100000:3.0:1787384373.256857:0:9828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384373.256892:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203258112 00000100:00100000:3.0:1787384373.256898:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203258112 00000100:00100000:3.0:1787384373.256939:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787384373.256947:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+23:9828:x1874208203258112:12345-0@lo:502: 00000100:00100000:3.0:1787384373.257063:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+23:9828:x1874208203258112:12345-0@lo:502: Request processed in 116us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384373.257070:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787384373.257130:0:9828:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fc1d8240 going to sleep for 11 seconds 00000100:00100000:3.0:1787384373.257150:0:9828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd75b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:9828:1874208203258112:0@lo:502: 00000020:01000000:3.0:1787384373.257176:0:9828:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787384373.257183:0:9828:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787384373.257190:0:9828:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384373.257192:0:9828:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787384373.257197:0:9828:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787384373.257201:0:9828:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.145@tcp to nid 0x20000c0a8cb91 (192.168.203.145@tcp) 00000020:01000000:3.0:1787384373.257231:0:9828:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787384373.257234:0:9828:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787384373.257247:0:9828:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff98f7c28999c0) 00000020:00000080:3.0:1787384373.257280:0:9828:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1787384373.257286:0:9828:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787384373.257350:0:9828:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787384373.257355:0:9828:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:3.0:1787384373.257360:0:9828:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7ef423838fba2767 00010000:00080000:3.0:1787384373.257384:0:9828:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f7c3bfd800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.145@tcp at head 00010000:00010000:3.0:1787384373.258224:0:9828:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:3.0:1787384373.258352:0:9828:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1787384373.258365:0:9828:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787384373.258549:0:9828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787384373.258649:0:9828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787384373.258759:0:9828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1787384373.258861:0:9828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000100:00100000:1.0:1787384373.266563:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee115180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8446:x1874208203256832:12345-0@lo:700: Request processed in 23310us (23824us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384373.266577:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787384373.271407:0:8446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee116d80 x1874208203256832/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787384389 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384373.271426:0:8446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee116d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8446:1874208203256832:0@lo:700: 40000000:02000000:2.0:1787384373.271438:0:8446:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000040:00080000:1.0:1787384373.272470:0:9829:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787384373.272475:0:9829:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000001:00100000:1.0:1787384373.284006:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787384373.284198:0:9828:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787384373.284211:0:9828:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787384373.284308:0:9828:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787384373.284333:0:9828:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7ef423838fba276e 00000100:00080000:0.0:1787384373.284343:0:9828:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787384373.284349:0:9828:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98f7c3bfd800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:0.0:1787384373.284384:0:9828:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f7c3ad8700 x1874208203258240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787384373.284413:0:9828:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1787384373.284640:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ad8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203258240:0@lo:8: 00000100:00100000:1.0:1787384373.284708:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384373.284803:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203258240 00000100:00100000:1.0:1787384373.284809:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203258240 00000100:00100000:1.0:1787384373.284841:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787384373.284848:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3650:x1874208203258240:12345-0@lo:8: 00010000:00080000:1.0:1787384373.284874:0:8436:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:1.0:1787384373.284898:0:8436:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7ef423838fba2775 00002000:00100000:1.0:1787384373.284909:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff98f7c2051000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113671 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787384373.284913:0:8436:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1787384373.284915:0:8436:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787384373.284997:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787384373.285017:0:8436:0:(import.c:65:import_set_state_nolock()) ffff98f7c2054800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787384373.285064:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1874208203258240:12345-0@lo:8: Request processed in 215us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384373.285072:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1787384373.285121:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3ad8700 x1874208203258240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787384383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384373.285143:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787384373.285150:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787384373.285157:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787384373.285162:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787384373.285164:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f7c3bfd800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787384373.285173:0:3650:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787384373.285179:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ad8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203258240:0@lo:8: 00000004:00080000:1.0:1787384373.285201:0:9829:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787384373.285263:0:9829:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 268365484204ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787384373.285269:0:9829:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1787384373.286576:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000020:01000000:0.0:1787384373.286745:0:9828:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384373.286752:0:9828:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384373.286754:0:9828:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787384373.286758:0:9828:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787384373.286761:0:9828:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384373.286762:0:9828:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787384373.286765:0:9828:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787384373.286767:0:9828:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787384373.286817:0:9828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ada680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:9828:1874208203258368:0@lo:502: 00000100:00100000:0.0:1787384373.286883:0:9828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384373.286915:0:9828:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f5769cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384373.286934:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203258368 00000100:00100000:0.0:1787384373.286939:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203258368 00000100:00100000:0.0:1787384373.286984:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787384373.286992:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+23:9828:x1874208203258368:12345-0@lo:502: 00000100:00100000:0.0:1787384373.287102:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+23:9828:x1874208203258368:12345-0@lo:502: Request processed in 100us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384373.287109:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787384373.287162:0:9828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ada680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:9828:1874208203258368:0@lo:502: 00000020:01000000:0.0:1787384373.287183:0:9828:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384373.287186:0:9828:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384373.287188:0:9828:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787384373.287191:0:9828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:3.0:1787384373.288196:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:3.0:1787384373.288221:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787384373.288239:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f5825c00/0x7ef423838fba2752 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2759 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384373.288316:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8f5825c00/0x7ef423838fba2752 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2759 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384373.288327:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787384373.288329:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff98f8f96899c0 from 1 10000000:01000000:3.0:1787384373.288332:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787384373.288362:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c2091a00/0x7ef423838fba277c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384373.288371:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f7c2091a00/0x7ef423838fba277c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384373.288380:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f7c2091a00/0x7ef423838fba277c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384373.288398:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd75b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203258496:0@lo:101: 00000100:00100000:3.0:1787384373.288442:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384373.288477:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f96c9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787384373.288511:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9826:x1874208203256576:12345-0@lo:700: Request processed in 45842us (51016us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384373.288520:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787384373.288578:0:9826:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee144700 x1874208203256576/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787384389 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384373.288591:0:9826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee144700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9826:1874208203256576:0@lo:700: 00000100:00100000:0.0:1787384373.288708:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203258496 00000100:00100000:0.0:1787384373.288713:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203258496 00000100:00100000:0.0:1787384373.288743:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787384373.288751:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+23:6519:x1874208203258496:12345-0@lo:101: 00010000:00010000:0.0:1787384373.288760:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384373.288772:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8f5825000/0x7ef423838fba2783 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba277c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.288848:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f5825000/0x7ef423838fba2783 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba277c expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.288858:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8f5825000/0x7ef423838fba2783 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba277c expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384373.288866:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f5825000, rc 0) 00000100:00100000:0.0:1787384373.288898:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+24:6519:x1874208203258496:12345-0@lo:101: Request processed in 148us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384373.288904:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787384373.288924:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd75b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203258496:0@lo:101: 00010000:00010000:3.0:1787384373.288936:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f7c2091a00/0x7ef423838fba277c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2783 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384373.288945:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f7c2091a00/0x7ef423838fba277c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2783 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384373.288991:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd75b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203258624:0@lo:501: 00000100:00100000:3.0:1787384373.289162:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384373.289186:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f96c9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787384373.289199:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203258624 00000100:00100000:0.0:1787384373.289203:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203258624 00000100:00100000:0.0:1787384373.289333:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787384373.289341:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+24:6519:x1874208203258624:12345-0@lo:501: 00000100:00100000:0.0:1787384373.289514:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+24:6519:x1874208203258624:12345-0@lo:501: Request processed in 174us (351us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787384373.289517:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd75b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203258624:0@lo:501: 00000100:00100000:0.0:1787384373.289529:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 10000000:01000000:3.0:1787384373.289541:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787384373.289603:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c2091a00/0x7ef423838fba277c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2783 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384373.289609:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f7c2091a00/0x7ef423838fba277c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2783 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384373.293882:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203258752:0@lo:13: 00000100:00100000:1.0:1787384373.293945:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384373.293998:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203258752 00000100:00100000:1.0:1787384373.294005:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203258752 00000100:00100000:1.0:1787384373.294055:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787384373.294063:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874208203258752:12345-0@lo:13: 00002000:00000024:1.0:1787384373.294089:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1787384373.294140:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874208203258752:12345-0@lo:13: Request processed in 77us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384373.294148:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1787384373.294169:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787384373.294197:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee145500 x1874208203258752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384373.294226:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203258752:0@lo:13: 00000004:00080000:1.0:1787384373.294246:0:9832:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787384373.294277:0:9832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee145500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9832:1874208203258880:0@lo:7: 00000100:00100000:1.0:1787384373.294302:0:9832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384373.294324:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203258880 00000100:00100000:1.0:1787384373.294328:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203258880 00000100:00100000:1.0:1787384373.294353:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787384373.294359:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9832:x1874208203258880:12345-0@lo:7: 00000004:00080000:0.0:1787384373.299684:0:9826:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787384373.299717:0:9826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ad9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9826:1874208203259136:0@lo:7: 00000100:00100000:0.0:1787384373.299806:0:9826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384373.299830:0:9826:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f57699c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384373.300826:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203259008:0@lo:13: 00000100:00100000:1.0:1787384373.300870:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384373.300914:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203259136 00000100:00100000:1.0:1787384373.300921:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203259136 00000100:00100000:1.0:1787384373.300961:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787384373.300970:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3adb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9826:x1874208203259136:12345-0@lo:7: 00000100:00100000:2.0:1787384373.301764:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203259008 00000100:00100000:2.0:1787384373.301796:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203259008 00000100:00100000:2.0:1787384373.301829:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787384373.301837:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3652:x1874208203259008:12345-0@lo:13: 00002000:00000024:2.0:1787384373.301850:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1787384373.301903:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3652:x1874208203259008:12345-0@lo:13: Request processed in 66us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384373.301910:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1787384373.301961:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3ada680 x1874208203259008/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384373.301980:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203259008:0@lo:13: 00002000:00080000:1.0:1787384373.302713:0:8435:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1787384373.302719:0:8435:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787384373.302763:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9832:x1874208203258880:12345-0@lo:7: Request processed in 8403us (8459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384373.302771:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787384373.302809:0:9832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8293840 going to sleep for 11 seconds 00010000:00080000:1.0:1787384373.302826:0:9832:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee145500 x1874208203258880/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787384389 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384373.302836:0:9832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee145500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9832:1874208203258880:0@lo:7: 00000004:00080000:1.0:1787384373.302848:0:9832:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787384373.302877:0:9832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee145500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9832:1874208203259264:0@lo:5: 00000100:00100000:1.0:1787384373.302903:0:9832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384373.302946:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203259264 00000100:00100000:1.0:1787384373.302952:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203259264 00000100:00100000:1.0:1787384373.302990:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787384373.303010:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9832:x1874208203259264:12345-0@lo:5: 00002000:00080000:1.0:1787384373.303029:0:8890:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787384373.303032:0:8890:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00080000:1.0:1787384373.306517:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1787384373.306531:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787384373.306637:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9832:x1874208203259264:12345-0@lo:5: Request processed in 3626us (3729us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787384373.306648:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787384373.306678:0:9832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8293840 going to sleep for 11 seconds 00010000:00080000:1.0:1787384373.306703:0:9832:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee145500 x1874208203259264/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787384389 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384373.306713:0:9832:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787384373.306719:0:9832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee145500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9832:1874208203259264:0@lo:5: 00000004:00080000:1.0:1787384373.306731:0:9832:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787384373.306775:0:9832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee145500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9832:1874208203259392:0@lo:700: 00000100:00100000:1.0:1787384373.306823:0:9832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384373.306911:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203259392 00000100:00100000:1.0:1787384373.306917:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203259392 00000100:00100000:1.0:1787384373.308576:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787384373.308586:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee145f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9832:x1874208203259392:12345-0@lo:700: 00000100:00100000:1.0:1787384373.308684:0:9832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8293840 going to sleep for 11 seconds 00002000:00080000:2.0:1787384373.314537:0:8436:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1787384373.314547:0:8436:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1787384373.314642:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3adb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9826:x1874208203259136:12345-0@lo:7: Request processed in 13669us (14833us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384373.314653:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787384373.314919:0:9826:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3ad9500 x1874208203259136/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787384389 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384373.315035:0:9826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ad9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9826:1874208203259136:0@lo:7: 00000004:00080000:0.0:1787384373.315048:0:9826:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787384373.315085:0:9826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ad9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9826:1874208203259520:0@lo:5: 00000100:00100000:0.0:1787384373.315128:0:9826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384373.315152:0:9826:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f57699c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384373.316075:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203259520 00000100:00100000:0.0:1787384373.316082:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203259520 00000100:00100000:0.0:1787384373.316141:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787384373.316151:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3adbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9826:x1874208203259520:12345-0@lo:5: 00002000:00080000:0.0:1787384373.316178:0:8438:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1787384373.316573:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3adbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9826:x1874208203259520:12345-0@lo:5: Request processed in 423us (1444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384373.316581:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787384373.316616:0:9826:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3ad9500 x1874208203259520/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787384389 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384373.316627:0:9826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ad9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9826:1874208203259520:0@lo:5: 00000004:00080000:0.0:1787384373.316636:0:9826:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787384373.316665:0:9826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ad9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9826:1874208203259648:0@lo:5: 00000100:00100000:0.0:1787384373.316698:0:9826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384373.316758:0:9826:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f57699c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384373.316775:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203259648 00000100:00100000:0.0:1787384373.316794:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203259648 00000100:00100000:2.0:1787384373.323380:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787384373.323405:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3ad8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9826:x1874208203259648:12345-0@lo:5: 00002000:00080000:2.0:1787384373.323450:0:8890:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:2.0:1787384373.328556:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3ad8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:9826:x1874208203259648:12345-0@lo:5: Request processed in 5156us (11849us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787384373.328567:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1787384373.328669:0:9826:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3ad9500 x1874208203259648/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787384389 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384373.328685:0:9826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ad9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9826:1874208203259648:0@lo:5: 00000004:00080000:2.0:1787384373.328699:0:9826:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1787384373.328737:0:9826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee116d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9826:1874208203259776:0@lo:900: 00000100:00100000:2.0:1787384373.328793:0:9826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384373.328815:0:9826:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7ea7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787384373.328843:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203259776 00000100:00100000:2.0:1787384373.328849:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203259776 00000100:00100000:2.0:1787384373.328885:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787384373.328892:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee114e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9826:x1874208203259776:12345-0@lo:900: 00000100:00100000:2.0:1787384373.328933:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee114e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9826:x1874208203259776:12345-0@lo:900: Request processed in 41us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384373.328939:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787384373.328965:0:9826:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee116d80 x1874208203259776/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787384389 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384373.328974:0:9826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee116d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9826:1874208203259776:0@lo:900: 00000001:00080000:3.0:1787384373.336463:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:2.0:1787384373.337610:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee145f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9832:x1874208203259392:12345-0@lo:700: Request processed in 29020us (30781us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384373.337623:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787384373.337835:0:9832:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee145500 x1874208203259392/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787384389 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384373.337850:0:9832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee145500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9832:1874208203259392:0@lo:700: 00000004:02000040:3.0:1787384373.339327:0:9832:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:3.0:1787384373.348522:0:9832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd75b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9832:1874208203259904:0@lo:5: 00000100:00100000:3.0:1787384373.348581:0:9832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384373.348632:0:9832:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f96c9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787384373.348721:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203259904 00000100:00100000:2.0:1787384373.348729:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203259904 00000100:00100000:2.0:1787384373.348795:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787384373.348806:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd75a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9832:x1874208203259904:12345-0@lo:5: 00002000:00080000:2.0:1787384373.352072:0:8438:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1787384373.354600:0:8438:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:2.0:1787384373.356643:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd75a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9832:x1874208203259904:12345-0@lo:5: Request processed in 7832us (8054us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787384373.356656:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1787384373.356931:0:9832:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8fd75b100 x1874208203259904/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787384389 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384373.356949:0:9832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd75b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9832:1874208203259904:0@lo:5: 00000004:00080000:2.0:1787384373.356970:0:9832:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000001:02000400:2.0:1787384374.061375:0:9888:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg345-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787384374.204016:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787384375.057981:0:9940:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787384375.058236:0:9940:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787384375.229333:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384375.229575:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203260032:0@lo:41: 00000100:00100000:1.0:1787384375.229638:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384375.231825:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203260032 00000100:00100000:1.0:1787384375.231837:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203260032 00000100:00100000:1.0:1787384375.231900:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787384375.231907:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee144700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203260032:12345-0@lo:41: 00000004:00000024:1.0:1787384375.231939:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787384375.233556:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee144700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203260032:12345-0@lo:41: Request processed in 1641us (3910us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384375.233568:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787384375.233637:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203260032:0@lo:41: 00000100:00100000:1.0:1787384375.735734:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee116d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203260160:0@lo:41: 00000100:00100000:1.0:1787384375.735862:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384375.736011:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203260160 00000100:00100000:0.0:1787384375.736026:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203260160 00000100:00100000:0.0:1787384375.736096:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787384375.736108:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203260160:12345-0@lo:41: 00000004:00000024:0.0:1787384375.736144:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787384375.746302:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203260160:12345-0@lo:41: Request processed in 10185us (10429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384375.746317:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787384375.751204:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee116d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203260160:0@lo:41: 00000001:00080000:1.0:1787384375.968608:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:0.0:1787384376.250548:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384377.271260:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384377.785445:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787384377.785489:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203260288:0@lo:13: 00000100:00100000:3.0:1787384377.785606:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384377.786449:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203260288 00000100:00100000:0.0:1787384377.786462:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203260288 00000100:00100000:0.0:1787384377.786558:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787384377.786571:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd75b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203260288:12345-0@lo:13: 00002000:00000024:0.0:1787384377.786610:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787384377.786676:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd75b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203260288:12345-0@lo:13: Request processed in 109us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384377.786685:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1787384377.786812:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787384377.786966:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3ada300 x1874208203260288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384393 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384377.787000:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203260288:0@lo:13: 00000100:00100000:2.0:1787384377.787860:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787384377.791749:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203260416:0@lo:13: 00000100:00100000:2.0:1787384377.791875:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384377.792124:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203260416 00000100:00100000:0.0:1787384377.792135:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203260416 00000100:00100000:0.0:1787384377.792245:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787384377.792257:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee114a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203260416:12345-0@lo:13: 00002000:00000024:0.0:1787384377.792291:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787384377.792357:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee114a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203260416:12345-0@lo:13: Request processed in 101us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384377.792390:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1787384377.792693:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3adb100 x1874208203260416/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384393 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384377.792719:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203260416:0@lo:13: 00000100:00080000:1.0:1787384377.792814:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:3.0:1787384378.106164:0:10042:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787384378.106539:0:10042:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787384378.302530:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384378.305903:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787384378.305937:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203260544:0@lo:13: 00000100:00100000:2.0:1787384378.306028:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384378.310764:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874208203261056:0@lo:400: 00000100:00100000:0.0:1787384378.310877:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384378.310932:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ad8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203261568:0@lo:400: 00000100:00100000:0.0:1787384378.310987:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384378.311023:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c355b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203262080:0@lo:400: 00000100:00100000:0.0:1787384378.311051:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384378.311105:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787384378.311111:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3adaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203260672:0@lo:400: 00000100:00100000:0.0:1787384378.311145:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384378.311167:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203261184:0@lo:400: 00000100:00100000:0.0:1787384378.311193:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384378.311212:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ad9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203261696:0@lo:400: 00000100:00100000:0.0:1787384378.311237:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384378.311248:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203261568 00000100:00100000:2.0:1787384378.311259:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203261568 00000100:00100000:0.0:1787384378.311273:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203260544 00000100:00100000:0.0:1787384378.311279:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203260544 00000100:00100000:2.0:1787384378.311319:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203262080 00000100:00100000:2.0:1787384378.311323:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203262080 00000100:00100000:0.0:1787384378.311333:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787384378.311347:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203261696 00000100:00100000:0.0:1787384378.311348:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee116d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203260544:12345-0@lo:13: 00000100:00100000:2.0:1787384378.311353:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203261696 00000100:00100000:2.0:1787384378.311373:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787384378.311382:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203261568:12345-0@lo:400: 00002000:00000024:0.0:1787384378.311387:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787384378.311444:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee116d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203260544:12345-0@lo:13: Request processed in 100us (5415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384378.311457:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787384378.311459:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203261568:12345-0@lo:400: Request processed in 74us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384378.311470:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1787384378.311514:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee116300 x1874208203260544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384378.311527:0:3654:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1787384378.311562:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203260544:0@lo:13: 00000100:00100000:0.0:1787384378.311585:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ad9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203260800:0@lo:400: 00000100:00100000:0.0:1787384378.311614:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384378.311634:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ad8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203261312:0@lo:400: 00000100:00100000:0.0:1787384378.311655:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384378.311673:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c355a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874208203261824:0@lo:400: 00000100:00100000:0.0:1787384378.311694:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384378.311712:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787384378.311718:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203260928:0@lo:400: 00000100:00100000:0.0:1787384378.311741:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384378.311758:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3adb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874208203261440:0@lo:400: 00000100:00100000:0.0:1787384378.311973:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384378.311989:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3559500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203261952:0@lo:400: 00000100:00100000:0.0:1787384378.312011:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384378.312035:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787384378.312044:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203262080:12345-0@lo:400: 00000100:00100000:0.0:1787384378.312094:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203262080:12345-0@lo:400: Request processed in 51us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384378.312101:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787384378.312117:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787384378.312123:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3b90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203261696:12345-0@lo:400: 00000100:00100000:0.0:1787384378.312150:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3b90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203261696:12345-0@lo:400: Request processed in 28us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384378.312156:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787384378.312177:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203260672 00000100:00100000:0.0:1787384378.312188:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203260672 00000100:00100000:0.0:1787384378.312221:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787384378.312229:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3653:x1874208203260672:12345-0@lo:400: 00000100:00100000:0.0:1787384378.312263:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3653:x1874208203260672:12345-0@lo:400: Request processed in 36us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384378.312272:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787384378.312306:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203261184 00000100:00100000:0.0:1787384378.312310:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203261184 00000100:00100000:0.0:1787384378.312347:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203260928 00000100:00100000:0.0:1787384378.312351:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203260928 00000100:00100000:0.0:1787384378.312369:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787384378.312376:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203261184:12345-0@lo:400: 00000100:00100000:0.0:1787384378.312419:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203261184:12345-0@lo:400: Request processed in 42us (1225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384378.312424:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3adaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203260672:0@lo:400: 00000100:00100000:0.0:1787384378.312430:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787384378.312444:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787384378.312453:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203260928:12345-0@lo:400: 00000100:00100000:2.0:1787384378.312461:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203261184:0@lo:400: 00010000:00080000:2.0:1787384378.312481:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3ad9880 x1874208203261696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384378.312493:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ad9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203261696:0@lo:400: 00000100:00100000:0.0:1787384378.312495:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203260928:12345-0@lo:400: Request processed in 41us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384378.312505:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1787384378.312514:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3ad8380 x1874208203261568/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384378.312524:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ad8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203261568:0@lo:400: 00010000:00080000:2.0:1787384378.312537:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c355b100 x1874208203262080/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384378.312543:0:3653:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787384378.312564:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c355b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203262080:0@lo:400: 00000100:00100000:2.0:1787384378.313361:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203261056 00000100:00100000:2.0:1787384378.313370:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203261056 00000100:00100000:2.0:1787384378.313406:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203260800 00000100:00100000:2.0:1787384378.313409:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203260800 00000100:00100000:2.0:1787384378.313421:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203261312 00000100:00100000:2.0:1787384378.313423:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203261312 00000100:00100000:2.0:1787384378.313438:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203261824 00000100:00100000:2.0:1787384378.313440:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203261824 00000100:00100000:2.0:1787384378.313452:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203261440 00000100:00100000:2.0:1787384378.313456:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203261440 00000100:00100000:2.0:1787384378.313468:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203261952 00000100:00100000:2.0:1787384378.313470:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203261952 00000100:00100000:2.0:1787384378.313485:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787384378.313493:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c355bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874208203261056:12345-0@lo:400: 00000100:00100000:2.0:1787384378.313579:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c355bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874208203261056:12345-0@lo:400: Request processed in 86us (2702us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384378.313599:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787384378.313622:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787384378.313628:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203260800:12345-0@lo:400: 00000100:00100000:2.0:1787384378.313661:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203260800:12345-0@lo:400: Request processed in 33us (2046us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384378.313667:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787384378.313678:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787384378.313683:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203261312:12345-0@lo:400: 00000100:00100000:2.0:1787384378.313713:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203261312:12345-0@lo:400: Request processed in 29us (2056us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384378.313719:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787384378.313729:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787384378.313734:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874208203261824:12345-0@lo:400: 00000100:00100000:2.0:1787384378.313762:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874208203261824:12345-0@lo:400: Request processed in 28us (2067us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384378.313769:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787384378.313804:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787384378.313811:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874208203261440:12345-0@lo:400: 00000100:00100000:2.0:1787384378.313838:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874208203261440:12345-0@lo:400: Request processed in 29us (1866us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384378.313844:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787384378.313854:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787384378.313860:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874208203261952:12345-0@lo:400: 00000100:00100000:2.0:1787384378.313887:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874208203261952:12345-0@lo:400: Request processed in 28us (1874us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384378.313900:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787384378.315991:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203260928:0@lo:400: 00010000:00080000:1.0:1787384378.316019:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3adb480 x1874208203261440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384378.316032:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3adb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874208203261440:0@lo:400: 00010000:00080000:1.0:1787384378.316047:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3559500 x1874208203261952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384378.316067:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3559500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203261952:0@lo:400: 00010000:00080000:1.0:1787384378.316082:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3ad9f80 x1874208203260800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384378.316091:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ad9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203260800:0@lo:400: 00010000:00080000:1.0:1787384378.316104:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3ad8700 x1874208203261312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384378.316135:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ad8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203261312:0@lo:400: 00010000:00080000:1.0:1787384378.316153:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c355a300 x1874208203261824/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384378.316161:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c355a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874208203261824:0@lo:400: 00010000:00080000:3.0:1787384378.316257:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3ada300 x1874208203261056/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384378.316269:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874208203261056:0@lo:400: 00000100:00080000:2.0:1787384378.316544:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787384378.316554:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787384378.316558:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787384378.807978:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787384378.808023:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203262208:0@lo:13: 00000100:00100000:2.0:1787384378.808127:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384378.808240:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203262208 00000100:00100000:2.0:1787384378.808249:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203262208 00000100:00100000:2.0:1787384378.808308:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787384378.808318:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee116300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203262208:12345-0@lo:13: 00002000:00000024:2.0:1787384378.808348:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384378.808405:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee116300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203262208:12345-0@lo:13: Request processed in 88us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384378.808413:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1787384378.808463:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee114380 x1874208203262208/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384378.808482:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203262208:0@lo:13: 00010000:00010000:0.0:1787384379.320442:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787384379.344905:0:10090:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787384379.344921:0:10090:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:3.0:1787384379.868414:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384379.872467:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182239360 00000100:00100000:0.0:1787384379.872490:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182239360 00000100:00100000:2.0:1787384379.872636:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 180 00000100:00100000:2.0:1787384379.872650:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2412:x1874208182239360:12345-192.168.203.45@tcp:250: 00010000:00080000:2.0:1787384379.872688:0:6515:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 09777221-fe6d-4549-9ee6-04300d230fb6@192.168.203.45@tcp t0 exp 0000000000000000 cur 274 last 0 00000020:00000080:2.0:1787384379.872735:0:6515:0:(genops.c:1406:class_connect()) connect: client 09777221-fe6d-4549-9ee6-04300d230fb6, cookie 0x7ef423838fba278a 00000100:00080000:2.0:1787384379.873209:0:6515:0:(import.c:65:import_set_state_nolock()) ffff98f7c3858800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787384379.873313:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+5:2412:x1874208182239360:12345-192.168.203.45@tcp:250: Request processed in 663us (4913us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384379.873339:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 180 00000100:00100000:2.0:1787384379.879492:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384379.879687:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182239488 00000100:00100000:1.0:1787384379.879702:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182239488 00000100:00100000:1.0:1787384379.879815:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 181 00000100:00100000:1.0:1787384379.879827:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+5:6172:x1874208182239488:12345-192.168.203.45@tcp:101: 00010000:00010000:1.0:1787384379.879851:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384379.879875:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f902158000/0x7ef423838fba2791 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce35aa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384379.879913:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f902158000/0x7ef423838fba2791 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce35aa expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384379.879926:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f902158000/0x7ef423838fba2791 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce35aa expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384379.879937:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f902158000, rc 0) 00000100:00100000:1.0:1787384379.880026:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+6:6172:x1874208182239488:12345-192.168.203.45@tcp:101: Request processed in 201us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384379.880034:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 181 00000100:00100000:3.0:1787384379.892488:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384379.892626:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182239616 00000100:00100000:2.0:1787384379.892640:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182239616 00000100:00100000:2.0:1787384379.892723:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 182 00000100:00100000:2.0:1787384379.892736:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+6:6172:x1874208182239616:12345-192.168.203.45@tcp:501: 00000100:00100000:2.0:1787384379.892942:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+6:6172:x1874208182239616:12345-192.168.203.45@tcp:501: Request processed in 207us (467us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787384379.892952:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 182 00000100:00100000:1.0:1787384379.898383:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384379.898511:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182239744 00000100:00100000:0.0:1787384379.898524:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182239744 00000100:00100000:0.0:1787384379.898607:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 183 00000100:00100000:0.0:1787384379.898619:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+6:6172:x1874208182239744:12345-192.168.203.45@tcp:101: 00010000:00010000:0.0:1787384379.898641:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384379.898683:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c3b05c00/0x7ef423838fba2798 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce35b1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384379.898720:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c3b05c00/0x7ef423838fba2798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce35b1 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384379.898736:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c3b05c00/0x7ef423838fba2798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce35b1 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384379.898746:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3b05c00, rc 0) 00000100:00100000:0.0:1787384379.898877:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+7:6172:x1874208182239744:12345-192.168.203.45@tcp:101: Request processed in 259us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384379.898885:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 183 00000100:00100000:2.0:1787384379.902305:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384379.902481:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182239872 00000100:00100000:1.0:1787384379.902495:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182239872 00000100:00100000:1.0:1787384379.902579:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 184 00000100:00100000:1.0:1787384379.902608:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+7:6172:x1874208182239872:12345-192.168.203.45@tcp:501: 00000100:00100000:1.0:1787384379.902877:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+8:6172:x1874208182239872:12345-192.168.203.45@tcp:501: Request processed in 270us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384379.902885:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 184 00000100:00100000:3.0:1787384379.910934:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384379.911435:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182240000 00000100:00100000:2.0:1787384379.911449:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182240000 00000100:00100000:2.0:1787384379.911527:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 185 00000100:00100000:2.0:1787384379.911538:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+8:6172:x1874208182240000:12345-192.168.203.45@tcp:503: 00000100:00100000:2.0:1787384379.911754:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+8:6172:x1874208182240000:12345-192.168.203.45@tcp:503: Request processed in 216us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384379.911763:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 185 00000100:00100000:2.0:1787384379.918868:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384379.918979:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182240128 00000100:00100000:0.0:1787384379.918994:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182240128 00000100:00100000:0.0:1787384379.919075:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 186 00000100:00100000:0.0:1787384379.919087:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+8:6191:x1874208182240128:12345-192.168.203.45@tcp:502: 00000100:00100000:0.0:1787384379.919305:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+8:6191:x1874208182240128:12345-192.168.203.45@tcp:502: Request processed in 219us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384379.919314:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 186 00000100:00100000:3.0:1787384379.979519:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384379.979702:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182240256 00000100:00100000:1.0:1787384379.979714:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182240256 00000100:00100000:1.0:1787384379.979819:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 187 00000100:00100000:1.0:1787384379.979831:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d25f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+8:6191:x1874208182240256:12345-192.168.203.45@tcp:502: 00000100:00100000:1.0:1787384379.980238:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d25f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+8:6191:x1874208182240256:12345-192.168.203.45@tcp:502: Request processed in 407us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384379.980247:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 187 00000100:00100000:3.0:1787384379.988107:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384379.988441:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182240384 00000100:00100000:2.0:1787384379.988454:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182240384 00000100:00100000:2.0:1787384379.988529:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 188 00000100:00100000:2.0:1787384379.988541:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d945a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+8:6172:x1874208182240384:12345-192.168.203.45@tcp:101: 00010000:00010000:2.0:1787384379.988563:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384379.988585:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8f58ccc00/0x7ef423838fba279f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce35e2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384379.988646:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f58ccc00/0x7ef423838fba279f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce35e2 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384379.988670:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8f58ccc00/0x7ef423838fba279f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce35e2 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384379.988681:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58ccc00, rc 0) 00000100:00100000:2.0:1787384379.988751:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d945a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+9:6172:x1874208182240384:12345-192.168.203.45@tcp:101: Request processed in 212us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384379.988759:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 188 00000100:00100000:2.0:1787384379.992600:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384379.992760:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182240512 00000100:00100000:1.0:1787384379.992773:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182240512 00000100:00100000:1.0:1787384379.992868:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 189 00000100:00100000:1.0:1787384379.992879:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9458c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+9:6172:x1874208182240512:12345-192.168.203.45@tcp:256: 20000000:01000000:1.0:1787384379.992913:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787384379.992944:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787384379.992949:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787384379.992952:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787384379.992955:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787384379.992957:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1787384379.996557:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9458c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+9:6172:x1874208182240512:12345-192.168.203.45@tcp:256: Request processed in 3662us (3954us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384379.996575:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 189 00000100:00100000:3.0:1787384379.999932:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384380.000168:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182240640 00000100:00100000:2.0:1787384380.000191:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182240640 00000100:00100000:2.0:1787384380.000264:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 190 00000100:00100000:2.0:1787384380.000277:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d945bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+9:6172:x1874208182240640:12345-192.168.203.45@tcp:101: 00010000:00010000:2.0:1787384380.000301:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384380.000325:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8f58cda00/0x7ef423838fba27a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce35e9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384380.000360:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f58cda00/0x7ef423838fba27a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce35e9 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384380.000374:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8f58cda00/0x7ef423838fba27a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce35e9 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384380.000385:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cda00, rc 0) 00000100:00100000:2.0:1787384380.000463:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d945bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+10:6172:x1874208182240640:12345-192.168.203.45@tcp:101: Request processed in 188us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384380.000490:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 190 00000100:00100000:2.0:1787384380.002816:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384380.002926:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182240768 00000100:00100000:1.0:1787384380.002938:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182240768 00000100:00100000:1.0:1787384380.003010:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 191 00000100:00100000:1.0:1787384380.003030:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d945ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+10:6172:x1874208182240768:12345-192.168.203.45@tcp:501: 00000100:00100000:1.0:1787384380.003363:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d945ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+10:6172:x1874208182240768:12345-192.168.203.45@tcp:501: Request processed in 332us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384380.003371:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 191 00000100:00100000:3.0:1787384380.005246:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384380.005355:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182240896 00000100:00100000:0.0:1787384380.005365:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182240896 00000100:00100000:0.0:1787384380.005429:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 192 00000100:00100000:0.0:1787384380.005440:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+10:6172:x1874208182240896:12345-192.168.203.45@tcp:503: 00000100:00100000:0.0:1787384380.005614:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+10:6172:x1874208182240896:12345-192.168.203.45@tcp:503: Request processed in 175us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384380.005623:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 192 00000100:00100000:3.0:1787384380.008935:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384380.009166:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182241024 00000100:00100000:2.0:1787384380.009189:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182241024 00000100:00100000:2.0:1787384380.009265:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 193 00000100:00100000:2.0:1787384380.009277:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+10:6196:x1874208182241024:12345-192.168.203.45@tcp:502: 00000100:00100000:2.0:1787384380.009476:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+10:6196:x1874208182241024:12345-192.168.203.45@tcp:502: Request processed in 199us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384380.009486:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 193 00000100:00100000:2.0:1787384380.012911:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384380.013023:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182241152 00000100:00100000:1.0:1787384380.013036:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182241152 00000100:00100000:1.0:1787384380.013114:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 194 00000100:00100000:1.0:1787384380.013125:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+10:6196:x1874208182241152:12345-192.168.203.45@tcp:502: 00000100:00100000:1.0:1787384380.013337:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+10:6196:x1874208182241152:12345-192.168.203.45@tcp:502: Request processed in 213us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384380.013345:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 194 00000100:00100000:3.0:1787384380.019921:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384380.019982:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384380.020197:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182241280 00000100:00100000:2.0:1787384380.020211:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182241280 00000100:00100000:2.0:1787384380.020270:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182241536 00000100:00100000:2.0:1787384380.020273:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182241536 00000100:00100000:2.0:1787384380.020306:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 7 00000100:00100000:2.0:1787384380.020316:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2412:x1874208182241280:12345-192.168.203.45@tcp:38: 00010000:00080000:2.0:1787384380.020354:0:6521:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 55e96ad5-fd9d-44d4-856e-5db0c40b1329@192.168.203.45@tcp t0 exp 0000000000000000 cur 275 last 0 00000020:00000080:2.0:1787384380.020420:0:6521:0:(genops.c:1406:class_connect()) connect: client 55e96ad5-fd9d-44d4-856e-5db0c40b1329, cookie 0x7ef423838fba27ad 00000004:00100000:2.0:1787384380.020451:0:6521:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:2.0:1787384380.020730:0:6521:0:(import.c:65:import_set_state_nolock()) ffff98f7c385e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787384380.020854:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2412:x1874208182241280:12345-192.168.203.45@tcp:38: Request processed in 538us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384380.020863:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 7 00000100:00100000:2.0:1787384380.020886:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 8 00000100:00100000:2.0:1787384380.020891:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd758700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2412:x1874208182241536:12345-192.168.203.45@tcp:38: 00010000:00080000:2.0:1787384380.020929:0:6521:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 55e96ad5-fd9d-44d4-856e-5db0c40b1329@192.168.203.45@tcp t0 exp 0000000000000000 cur 275 last 0 00000020:00000080:2.0:1787384380.021358:0:6521:0:(genops.c:1406:class_connect()) connect: client 55e96ad5-fd9d-44d4-856e-5db0c40b1329, cookie 0x7ef423838fba27b4 00000004:00100000:2.0:1787384380.021380:0:6521:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:2.0:1787384380.021567:0:6521:0:(import.c:65:import_set_state_nolock()) ffff98f7c385a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787384380.021613:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd758700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2412:x1874208182241536:12345-192.168.203.45@tcp:38: Request processed in 719us (1630us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384380.021621:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 8 00000100:00100000:0.0:1787384380.345438:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203262336:0@lo:41: 00000100:00100000:0.0:1787384380.345550:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787384380.345769:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384380.346298:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203262336 00000100:00100000:1.0:1787384380.346309:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203262336 00000100:00100000:1.0:1787384380.346372:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787384380.346380:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203262336:12345-0@lo:41: 00000004:00000024:1.0:1787384380.346421:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787384380.346496:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203262336:12345-0@lo:41: Request processed in 116us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384380.346503:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787384380.346669:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203262336:0@lo:41: 00000100:00100000:3.0:1787384380.778244:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384380.778288:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384380.778325:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384380.778443:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182241792 00000100:00100000:1.0:1787384380.778457:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182241792 00000100:00100000:1.0:1787384380.778549:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182241408 00000100:00100000:1.0:1787384380.778553:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182241408 00000100:00100000:1.0:1787384380.778567:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182241664 00000100:00100000:1.0:1787384380.778570:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182241664 00000100:00100000:1.0:1787384380.778591:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 9 00000100:00100000:1.0:1787384380.778603:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd75ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:6172:x1874208182241792:12345-192.168.203.45@tcp:41: 00000004:00000024:1.0:1787384380.778677:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1787384380.778756:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd75ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:6172:x1874208182241792:12345-192.168.203.45@tcp:41: Request processed in 154us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384380.778764:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 9 00000100:00100000:1.0:1787384380.778835:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 10 00000100:00100000:1.0:1787384380.778843:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd75b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:0:x1874208182241408:12345-192.168.203.45@tcp:41: 00000004:00000024:1.0:1787384380.778854:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1787384380.778877:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd75b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:0:x1874208182241408:12345-192.168.203.45@tcp:41: Request processed in 36us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384380.778884:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 10 00000100:00100000:1.0:1787384380.778897:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 11 00000100:00100000:1.0:1787384380.778905:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:0:x1874208182241664:12345-192.168.203.45@tcp:41: 00000004:00000024:1.0:1787384380.778917:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787384380.778941:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:0:x1874208182241664:12345-192.168.203.45@tcp:41: Request processed in 38us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384380.778947:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 11 00000100:00080000:3.0:1787384380.779942:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787384380.779953:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384380.783989:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384380.784118:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182241920 00000100:00100000:1.0:1787384380.784131:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182241920 00000100:00100000:1.0:1787384380.784213:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 12 00000100:00100000:1.0:1787384380.784225:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:6172:x1874208182241920:12345-192.168.203.45@tcp:40: 00000100:00100000:1.0:1787384380.784347:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:6172:x1874208182241920:12345-192.168.203.45@tcp:40: Request processed in 123us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384380.784356:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 12 00000100:00100000:3.0:1787384380.792613:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384380.792663:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384380.792725:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384380.792933:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182242304 00000100:00100000:2.0:1787384380.792946:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182242304 00000100:00100000:2.0:1787384380.793027:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 4 00000100:00100000:2.0:1787384380.793038:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd75b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:6172:x1874208182242304:12345-192.168.203.45@tcp:900: 00000100:00100000:2.0:1787384380.793161:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd75b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:6172:x1874208182242304:12345-192.168.203.45@tcp:900: Request processed in 124us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384380.793178:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 4 00000100:00100000:1.0:1787384380.793717:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182242048 00000100:00100000:1.0:1787384380.793724:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182242048 00000100:00100000:1.0:1787384380.793767:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182242176 00000100:00100000:1.0:1787384380.793771:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182242176 00000100:00100000:1.0:1787384380.793822:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 16 00000100:00100000:1.0:1787384380.793830:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd75aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2412:x1874208182242048:12345-192.168.203.45@tcp:8: 00010000:00080000:1.0:1787384380.793864:0:8436:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 55e96ad5-fd9d-44d4-856e-5db0c40b1329@192.168.203.45@tcp t0 exp 0000000000000000 cur 275 last 0 00000020:00000080:1.0:1787384380.793905:0:8436:0:(genops.c:1406:class_connect()) connect: client 55e96ad5-fd9d-44d4-856e-5db0c40b1329, cookie 0x7ef423838fba27bb 00002000:00100000:1.0:1787384380.793920:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 55e96ad5-fd9d-44d4-856e-5db0c40b1329/ffff98f7c3510000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113671 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787384380.793942:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00000100:00100000:0.0:1787384380.794102:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 17 00000100:00100000:0.0:1787384380.794110:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee31ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2412:x1874208182242176:12345-192.168.203.45@tcp:8: 00010000:00080000:0.0:1787384380.794130:0:8435:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 55e96ad5-fd9d-44d4-856e-5db0c40b1329@192.168.203.45@tcp t0 exp 0000000000000000 cur 275 last 0 00000020:00000080:0.0:1787384380.794150:0:8435:0:(genops.c:1406:class_connect()) connect: client 55e96ad5-fd9d-44d4-856e-5db0c40b1329, cookie 0x7ef423838fba27c2 00002000:00100000:0.0:1787384380.794155:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 55e96ad5-fd9d-44d4-856e-5db0c40b1329/ffff98f8f7d8e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113671 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787384380.794167:0:8435:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:0.0:1787384380.794306:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787384380.794341:0:8435:0:(import.c:65:import_set_state_nolock()) ffff98f8f7d8d800 : changing import state from RECOVER to FULL 00002000:00080000:1.0:1787384380.794375:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787384380.794397:0:8436:0:(import.c:65:import_set_state_nolock()) ffff98f7c3513800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787384380.794410:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee31ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2412:x1874208182242176:12345-192.168.203.45@tcp:8: Request processed in 299us (1684us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384380.794419:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 17 00000100:00100000:1.0:1787384380.794699:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd75aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2412:x1874208182242048:12345-192.168.203.45@tcp:8: Request processed in 867us (2034us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384380.794707:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 16 00000100:00100000:2.0:1787384380.803868:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384380.803968:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182242432 00000100:00100000:3.0:1787384380.803981:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182242432 00000100:00100000:3.0:1787384380.804056:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 0 00000100:00100000:3.0:1787384380.804068:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c355a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:6172:x1874208182242432:12345-192.168.203.45@tcp:33: 00000004:00080000:3.0:1787384380.850263:0:6524:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 46080us 00000100:00100000:2.0:1787384380.858838:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787384380.858873:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3559500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203262464:0@lo:41: 00000100:00100000:2.0:1787384380.858977:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384380.859353:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203262464 00000100:00100000:2.0:1787384380.859363:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203262464 00000100:00100000:2.0:1787384380.859442:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787384380.859453:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c355b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203262464:12345-0@lo:41: 00000004:00000024:2.0:1787384380.859490:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1787384380.859568:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c355b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203262464:12345-0@lo:41: Request processed in 116us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384380.859576:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787384380.859631:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3559500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203262464:0@lo:41: 00000004:00200000:0.0:1787384380.905880:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787384380.906272:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c355a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:6172:x1874208182242432:12345-192.168.203.45@tcp:33: Request processed in 102196us (102406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384380.906289:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 0 00000100:00100000:0.0:1787384381.113045:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384381.113207:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182242560 00000100:00100000:2.0:1787384381.113221:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182242560 00000100:00100000:2.0:1787384381.113295:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 13 00000100:00100000:2.0:1787384381.113307:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:6214:x1874208182242560:12345-192.168.203.45@tcp:101: 00010000:00010000:2.0:1787384381.113334:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384381.116891:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091c00/0x7ef423838fba27c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce361a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384381.116990:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba27d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384381.117004:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba27d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384381.117019:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba27d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384381.117070:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787384381.117074:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787384381.117088:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba27d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384381.117328:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091c00/0x7ef423838fba27c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce361a expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384381.117349:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba27d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce361a expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384381.117357:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c2950000) 00010000:00010000:3.0:1787384381.117361:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787384381.117363:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2091400, rc 0) 00000100:00100000:3.0:1787384381.117429:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:6214:x1874208182242560:12345-192.168.203.45@tcp:101: Request processed in 4124us (4407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384381.117438:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 13 00010000:00010000:2.0:1787384381.367053:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384382.391163:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384382.903036:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3559500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203262592:0@lo:13: 00000100:00100000:3.0:1787384382.903101:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384382.903221:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203262592 00000100:00100000:2.0:1787384382.903229:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203262592 00000100:00100000:2.0:1787384382.903284:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787384382.903293:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee31df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203262592:12345-0@lo:13: 00002000:00000024:2.0:1787384382.903323:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384382.903374:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee31df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203262592:12345-0@lo:13: Request processed in 82us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384382.903381:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1787384382.903489:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787384382.903515:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3559500 x1874208203262592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384398 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384382.903542:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3559500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203262592:0@lo:13: 00000100:00100000:3.0:1787384382.903862:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384382.903872:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203262720:0@lo:13: 00000100:00100000:3.0:1787384382.903898:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384382.904003:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203262720 00000100:00100000:2.0:1787384382.904007:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203262720 00000100:00100000:2.0:1787384382.904053:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787384382.904059:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee31d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203262720:12345-0@lo:13: 00002000:00000024:2.0:1787384382.904069:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384382.904105:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee31d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203262720:12345-0@lo:13: Request processed in 46us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384382.904111:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1787384382.904168:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3b93800 x1874208203262720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384398 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384382.904181:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203262720:0@lo:13: 00000100:00080000:3.0:1787384382.904251:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787384383.415202:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3b93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874208203263232:0@lo:400: 00000100:00100000:1.0:1787384383.415282:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384383.415343:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203263744:0@lo:400: 00000100:00100000:1.0:1787384383.415383:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384383.415409:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203264256:0@lo:400: 00000100:00100000:1.0:1787384383.415432:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384383.415461:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787384383.415468:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203263104:0@lo:400: 00000100:00100000:1.0:1787384383.415490:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384383.415516:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874208203263616:0@lo:400: 00000100:00100000:1.0:1787384383.415538:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384383.415554:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874208203264128:0@lo:400: 00000100:00100000:1.0:1787384383.415572:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384383.415814:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3b90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874208203262976:0@lo:400: 00000100:00100000:1.0:1787384383.415847:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384383.415865:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874208203263488:0@lo:400: 00000100:00100000:1.0:1787384383.415882:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384383.415890:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee255c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874208203264000:0@lo:400: 00000100:00100000:1.0:1787384383.415909:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384383.415919:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1787384383.415924:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203262848:0@lo:400: 00000100:00100000:1.0:1787384383.415950:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384383.415968:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203263360:0@lo:400: 00000100:00100000:1.0:1787384383.416032:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384383.416049:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203263872:0@lo:400: 00000100:00100000:1.0:1787384383.416068:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384383.416082:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203264384:0@lo:400: 00000100:00100000:1.0:1787384383.416102:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384383.416132:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203263744 00000100:00100000:1.0:1787384383.416139:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203263744 00000100:00100000:1.0:1787384383.416177:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203264256 00000100:00100000:1.0:1787384383.416180:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203264256 00000100:00100000:1.0:1787384383.416205:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203263872 00000100:00100000:1.0:1787384383.416440:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203263872 00000100:00100000:1.0:1787384383.416461:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203264384 00000100:00100000:1.0:1787384383.416463:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203264384 00000100:00100000:1.0:1787384383.416489:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787384383.416497:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7debb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203263744:12345-0@lo:400: 00000100:00100000:1.0:1787384383.416555:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7debb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203263744:12345-0@lo:400: Request processed in 58us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384383.416562:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787384383.416578:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787384383.416585:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203264256:12345-0@lo:400: 00000100:00100000:0.0:1787384383.416711:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203263232 00000100:00100000:0.0:1787384383.416726:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203263232 00000100:00100000:0.0:1787384383.416750:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203263616 00000100:00100000:0.0:1787384383.416752:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203263616 00000100:00100000:3.0:1787384383.416754:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203264128 00000100:00100000:3.0:1787384383.416758:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203264128 00000100:00100000:0.0:1787384383.416793:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203262976 00000100:00100000:0.0:1787384383.416797:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203262976 00000100:00100000:3.0:1787384383.416799:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203263488 00000100:00100000:3.0:1787384383.416802:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203263488 00000100:00100000:0.0:1787384383.416808:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203264000 00000100:00100000:0.0:1787384383.416811:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203264000 00000100:00100000:3.0:1787384383.416816:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787384383.416822:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874208203263232:12345-0@lo:400: 00000100:00100000:0.0:1787384383.416824:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787384383.416836:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7deb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874208203263616:12345-0@lo:400: 00000100:00100000:3.0:1787384383.416860:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874208203263232:12345-0@lo:400: Request processed in 38us (1577us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384383.416862:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7deb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874208203263616:12345-0@lo:400: Request processed in 28us (1324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384383.416866:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787384383.416868:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787384383.416877:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787384383.416883:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7deaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874208203264128:12345-0@lo:400: 00000100:00100000:3.0:1787384383.416911:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7deaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874208203264128:12345-0@lo:400: Request processed in 28us (1337us total) trans 0 rc 0/0 00010000:00010000:2.0:1787384383.417016:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384383.417045:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203263104 00000100:00100000:2.0:1787384383.417049:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203263104 00000100:00100000:2.0:1787384383.417074:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203263360 00000100:00100000:2.0:1787384383.417077:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203263360 00000100:00100000:2.0:1787384383.417091:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787384383.417097:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203263104:12345-0@lo:400: 00000100:00100000:2.0:1787384383.417133:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203263104:12345-0@lo:400: Request processed in 36us (1642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384383.417140:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787384383.417152:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787384383.417157:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203263360:12345-0@lo:400: 00000100:00100000:2.0:1787384383.417193:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203263360:12345-0@lo:400: Request processed in 36us (1171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384383.417199:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787384383.417233:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787384383.417240:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203263872:12345-0@lo:400: 00000100:00100000:2.0:1787384383.417268:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203263872:12345-0@lo:400: Request processed in 29us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384383.417273:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787384383.417284:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787384383.417289:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203264384:12345-0@lo:400: 00000100:00100000:2.0:1787384383.417311:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203264384:12345-0@lo:400: Request processed in 22us (1209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384383.417316:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787384383.417449:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3559500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203264512:0@lo:13: 00000100:00100000:2.0:1787384383.417480:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384383.417520:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203263360:0@lo:400: 00010000:00080000:2.0:1787384383.417545:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee254e00 x1874208203263872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384383.417556:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203263872:0@lo:400: 00010000:00080000:2.0:1787384383.417567:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee254380 x1874208203264384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384383.417575:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203264384:0@lo:400: 00000100:00100000:2.0:1787384383.417620:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203264512 00000100:00100000:2.0:1787384383.417624:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203264512 00000100:00100000:2.0:1787384383.417647:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787384383.417653:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3ada300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203264512:12345-0@lo:13: 00002000:00000024:2.0:1787384383.417672:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384383.417703:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3ada300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203264512:12345-0@lo:13: Request processed in 50us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384383.417709:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1787384383.417731:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3559500 x1874208203264512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384399 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384383.417744:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3559500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203264512:0@lo:13: 00000100:00100000:2.0:1787384383.417888:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203262848 00000100:00100000:2.0:1787384383.417892:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203262848 00000100:00100000:2.0:1787384383.417933:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787384383.417940:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3652:x1874208203262848:12345-0@lo:400: 00000100:00100000:2.0:1787384383.417977:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3652:x1874208203262848:12345-0@lo:400: Request processed in 37us (2025us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384383.417983:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787384383.418032:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203262848:0@lo:400: 00000100:00100000:1.0:1787384383.418382:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203264256:12345-0@lo:400: Request processed in 1795us (2947us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384383.418390:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1787384383.418411:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787384383.418415:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787384383.418420:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787384383.418442:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203263104:0@lo:400: 00010000:00080000:1.0:1787384383.418457:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee255180 x1874208203263616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384383.418467:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874208203263616:0@lo:400: 00010000:00080000:1.0:1787384383.418477:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee256d80 x1874208203264128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384383.418486:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874208203264128:0@lo:400: 00000100:00100000:1.0:1787384383.418498:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3b93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874208203263232:0@lo:400: 00010000:00080000:1.0:1787384383.418509:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee254a80 x1874208203263744/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384383.418516:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203263744:0@lo:400: 00010000:00080000:1.0:1787384383.418538:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee255880 x1874208203264256/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384383.418546:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203264256:0@lo:400: 00000100:00100000:0.0:1787384383.423012:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787384383.423050:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874208203262976:12345-0@lo:400: 00000100:00100000:0.0:1787384383.423160:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874208203262976:12345-0@lo:400: Request processed in 126us (7310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384383.423168:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787384383.423201:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787384383.424478:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874208203263488:12345-0@lo:400: 00000100:00100000:0.0:1787384383.424551:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874208203263488:12345-0@lo:400: Request processed in 1343us (8667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384383.424560:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787384383.424586:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787384383.424595:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874208203264000:12345-0@lo:400: 00000100:00100000:0.0:1787384383.424624:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874208203264000:12345-0@lo:400: Request processed in 31us (8715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384383.424630:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787384383.424686:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3b90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874208203262976:0@lo:400: 00000100:00100000:0.0:1787384383.424699:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874208203263488:0@lo:400: 00000100:00100000:0.0:1787384383.424710:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee255c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874208203264000:0@lo:400: 00000100:00100000:3.0:1787384383.430731:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787384383.504534:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384383.504645:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182242688 00000100:00100000:0.0:1787384383.504655:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182242688 00000100:00100000:0.0:1787384383.504738:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 14 00000100:00100000:0.0:1787384383.504762:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee31ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:6266:x1874208182242688:12345-192.168.203.45@tcp:41: 00000004:00000024:0.0:1787384383.504849:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787384383.504918:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee31ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:6266:x1874208182242688:12345-192.168.203.45@tcp:41: Request processed in 157us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384383.504925:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 14 00000100:00080000:1.0:1787384383.505383:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384383.509659:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384383.510521:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182242816 00000100:00100000:0.0:1787384383.510535:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182242816 00000100:00100000:0.0:1787384383.510663:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 15 00000100:00100000:0.0:1787384383.510676:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3ad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:6266:x1874208182242816:12345-192.168.203.45@tcp:41: 00000004:00000024:0.0:1787384383.510733:0:8195:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787384383.510863:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3ad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:6266:x1874208182242816:12345-192.168.203.45@tcp:41: Request processed in 189us (1217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384383.510871:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 15 00000100:00080000:1.0:1787384383.511624:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787384383.521380:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384383.522489:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182242944 00000100:00100000:0.0:1787384383.522506:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182242944 00000100:00100000:0.0:1787384383.522629:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 19 00000100:00100000:0.0:1787384383.522642:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:6266:x1874208182242944:12345-192.168.203.45@tcp:13: 00002000:00000024:0.0:1787384383.522679:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787384383.522810:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:6266:x1874208182242944:12345-192.168.203.45@tcp:13: Request processed in 139us (1413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384383.522819:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 19 00000100:00080000:1.0:1787384383.523963:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787384383.525904:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384383.526257:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182243072 00000100:00100000:0.0:1787384383.526269:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182243072 00000100:00100000:0.0:1787384383.526361:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 20 00000100:00100000:0.0:1787384383.526373:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee31ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:6266:x1874208182243072:12345-192.168.203.45@tcp:13: 00002000:00000024:0.0:1787384383.526407:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787384383.526526:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee31ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:6266:x1874208182243072:12345-192.168.203.45@tcp:13: Request processed in 155us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384383.526535:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 20 00000100:00080000:1.0:1787384383.526929:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787384383.929742:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3adb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203264640:0@lo:13: 00000100:00100000:1.0:1787384383.929864:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384383.930067:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203264640 00000100:00100000:0.0:1787384383.930079:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203264640 00000100:00100000:2.0:1787384383.930255:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787384383.930269:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203264640:12345-0@lo:13: 00002000:00000024:2.0:1787384383.930305:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384383.930360:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203264640:12345-0@lo:13: Request processed in 94us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384383.930368:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1787384383.930558:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3adb480 x1874208203264640/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384399 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384383.935850:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3adb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203264640:0@lo:13: 00010000:00010000:2.0:1787384384.439547:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787384384.973138:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 55e96ad5-fd9d-44d4-856e-5db0c40b1329 00010000:00010000:0.0:1787384385.463114:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384385.463388:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7de8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203264768:0@lo:41: 00000100:00100000:3.0:1787384385.463479:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384385.463678:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203264768 00000100:00100000:2.0:1787384385.463689:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203264768 00000100:00100000:2.0:1787384385.463761:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787384385.463771:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee31dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203264768:12345-0@lo:41: 00000004:00000024:2.0:1787384385.463840:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787384385.465826:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee31dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203264768:12345-0@lo:41: Request processed in 2044us (2334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384385.465842:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787384385.471923:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7de8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203264768:0@lo:41: 00000100:00100000:2.0:1787384385.893509:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384385.893555:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384385.893582:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384385.893602:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384385.893626:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384385.893657:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182243456 00000100:00100000:2.0:1787384385.893670:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182243456 00000100:00100000:2.0:1787384385.893741:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182243328 00000100:00100000:2.0:1787384385.893745:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182243328 00000100:00100000:2.0:1787384385.893770:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 55 00000100:00100000:2.0:1787384385.893805:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3adb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2416:x1874208182243456:12345-192.168.203.45@tcp:400: 00000100:00100000:2.0:1787384385.893916:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3adb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2416:x1874208182243456:12345-192.168.203.45@tcp:400: Request processed in 136us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384385.893925:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 55 00000100:00100000:2.0:1787384385.893947:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 56 00000100:00100000:2.0:1787384385.893953:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3ad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:2416:x1874208182243328:12345-192.168.203.45@tcp:400: 00000100:00100000:2.0:1787384385.893980:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3ad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:2416:x1874208182243328:12345-192.168.203.45@tcp:400: Request processed in 27us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384385.894567:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182243200 00000100:00100000:3.0:1787384385.894576:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182243200 00000100:00100000:3.0:1787384385.894654:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 196 00000100:00100000:3.0:1787384385.894666:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+10:2416:x1874208182243200:12345-192.168.203.45@tcp:400: 00000100:00100000:3.0:1787384385.894715:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+10:2416:x1874208182243200:12345-192.168.203.45@tcp:400: Request processed in 53us (1219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384385.894721:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 196 00000100:00100000:2.0:1787384385.898094:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 56 00000100:00100000:2.0:1787384385.898172:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182243712 00000100:00100000:2.0:1787384385.898182:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182243712 00000100:00100000:2.0:1787384385.898244:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182243584 00000100:00100000:2.0:1787384385.898247:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182243584 00000100:00100000:2.0:1787384385.898278:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 17 00000100:00100000:2.0:1787384385.898288:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3ad8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2416:x1874208182243712:12345-192.168.203.45@tcp:400: 00000100:00100000:2.0:1787384385.898387:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3ad8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2416:x1874208182243712:12345-192.168.203.45@tcp:400: Request processed in 100us (4803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384385.898395:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 17 00000100:00100000:2.0:1787384385.898406:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 18 00000100:00100000:2.0:1787384385.898413:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3ada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2416:x1874208182243584:12345-192.168.203.45@tcp:400: 00000100:00100000:2.0:1787384385.898438:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3ada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2416:x1874208182243584:12345-192.168.203.45@tcp:400: Request processed in 25us (4811us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384385.898444:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 18 00000100:00080000:2.0:1787384385.898468:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787384385.898474:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787384385.898477:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787384385.898489:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787384385.976564:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787384385.976601:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3adaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203264896:0@lo:41: 00000100:00100000:2.0:1787384385.976694:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384385.976770:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203264896 00000100:00100000:2.0:1787384385.976797:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203264896 00000100:00100000:2.0:1787384385.976853:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787384385.976862:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3ad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203264896:12345-0@lo:41: 00000004:00000024:2.0:1787384385.976902:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1787384385.976947:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3ad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203264896:12345-0@lo:41: Request processed in 86us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384385.976955:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000001:00100000:1.0:1787384385.978121:0:6501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 55e96ad5-fd9d-44d4-856e-5db0c40b1329 00000100:00100000:2.0:1787384385.978242:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3adaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203264896:0@lo:41: 00000001:00100000:3.0:1787384385.978357:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 55e96ad5-fd9d-44d4-856e-5db0c40b1329 00000001:02000400:0.0:1787384386.338557:0:10188:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787384386.486991:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787384387.025360:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 55e96ad5-fd9d-44d4-856e-5db0c40b1329 00010000:00010000:2.0:1787384387.511267:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384388.028892:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3adaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203265024:0@lo:13: 00000100:00100000:2.0:1787384388.029003:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384388.029090:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203265024 00000100:00100000:2.0:1787384388.029100:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203265024 00000100:00100000:2.0:1787384388.029164:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787384388.029175:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3adb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203265024:12345-0@lo:13: 00002000:00000024:2.0:1787384388.029211:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384388.029262:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3adb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203265024:12345-0@lo:13: Request processed in 89us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384388.029269:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1787384388.029295:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787384388.029331:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3adaa00 x1874208203265024/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384404 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384388.029351:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3adaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203265024:0@lo:13: 00000100:00100000:2.0:1787384388.038238:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787384388.038281:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee31ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203265152:0@lo:13: 00000100:00100000:2.0:1787384388.038383:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384388.039279:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203265152 00000100:00100000:2.0:1787384388.039291:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203265152 00000100:00100000:2.0:1787384388.039360:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787384388.039371:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3adaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203265152:12345-0@lo:13: 00002000:00000024:2.0:1787384388.039405:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384388.039485:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3adaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203265152:12345-0@lo:13: Request processed in 114us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384388.039494:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1787384388.040285:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787384388.040342:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee31ed80 x1874208203265152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384404 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384388.040371:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee31ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203265152:0@lo:13: 00000100:00100000:2.0:1787384388.534949:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3559500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203265280:0@lo:13: 00000100:00100000:2.0:1787384388.535067:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384388.535163:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203265280 00000100:00100000:2.0:1787384388.535172:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203265280 00000100:00100000:2.0:1787384388.535250:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787384388.535262:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203265280:12345-0@lo:13: 00002000:00000024:2.0:1787384388.535297:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384388.535347:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203265280:12345-0@lo:13: Request processed in 87us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384388.535355:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1787384388.535380:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787384388.535428:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3559500 x1874208203265280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384404 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384388.535449:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3559500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203265280:0@lo:13: 00000100:00100000:0.0:1787384388.538411:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203265408:0@lo:400: 00010000:00010000:2.0:1787384388.538491:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384388.538508:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874208203265536:0@lo:400: 00000100:00100000:0.0:1787384388.538518:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384388.538556:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384388.538580:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7deb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203265920:0@lo:400: 00000100:00100000:2.0:1787384388.538598:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7de8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874208203266048:0@lo:400: 00000100:00100000:0.0:1787384388.538615:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384388.538631:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384388.538641:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4030e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203266432:0@lo:400: 00000100:00100000:2.0:1787384388.538656:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4031c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203266560:0@lo:400: 00000100:00100000:0.0:1787384388.538672:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384388.538690:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384388.538734:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203265536 00000100:00100000:2.0:1787384388.538743:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203265536 00000100:00100000:2.0:1787384388.538819:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203266048 00000100:00100000:2.0:1787384388.538823:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203266048 00000100:00100000:2.0:1787384388.538848:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203266432 00000100:00100000:2.0:1787384388.538851:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203266432 00000100:00100000:2.0:1787384388.538871:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787384388.538881:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874208203265536:12345-0@lo:400: 00000100:00100000:2.0:1787384388.538940:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874208203265536:12345-0@lo:400: Request processed in 60us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384388.538948:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787384388.538976:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787384388.538984:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874208203266048:12345-0@lo:400: 00000100:00100000:2.0:1787384388.539022:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874208203266048:12345-0@lo:400: Request processed in 39us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384388.539028:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787384388.539040:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787384388.539056:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874208203266432:12345-0@lo:400: 00000100:00100000:2.0:1787384388.539092:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874208203266432:12345-0@lo:400: Request processed in 36us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384388.539098:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787384388.539119:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203265920 00000100:00100000:2.0:1787384388.539122:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203265920 00000100:00100000:2.0:1787384388.539146:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787384388.539153:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203265920:12345-0@lo:400: 00000100:00100000:2.0:1787384388.539186:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203265920:12345-0@lo:400: Request processed in 33us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384388.539191:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787384388.539217:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203266560 00000100:00100000:2.0:1787384388.539221:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203266560 00000100:00100000:2.0:1787384388.539264:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787384388.539271:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203266560:12345-0@lo:400: 00000100:00100000:2.0:1787384388.539300:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203266560:12345-0@lo:400: Request processed in 29us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384388.539306:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787384388.539336:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203265664:0@lo:400: 00000100:00100000:2.0:1787384388.539366:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384388.539386:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4031180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203266176:0@lo:400: 00000100:00100000:2.0:1787384388.539408:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384388.539427:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787384388.539434:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874208203265792:0@lo:400: 00000100:00100000:2.0:1787384388.539457:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384388.539473:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4030a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203266304:0@lo:400: 00000100:00100000:2.0:1787384388.539508:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384388.539534:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203265664 00000100:00100000:2.0:1787384388.539539:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203265664 00000100:00100000:2.0:1787384388.539563:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787384388.539569:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203265664:12345-0@lo:400: 00000100:00100000:2.0:1787384388.539603:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203265664:12345-0@lo:400: Request processed in 34us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384388.539609:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787384388.539625:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203266176 00000100:00100000:2.0:1787384388.539628:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203266176 00000100:00100000:2.0:1787384388.539647:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203265792 00000100:00100000:2.0:1787384388.539650:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203265792 00000100:00100000:2.0:1787384388.539661:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203266304 00000100:00100000:2.0:1787384388.539663:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203266304 00000100:00100000:2.0:1787384388.539677:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787384388.539683:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203266176:12345-0@lo:400: 00000100:00100000:2.0:1787384388.539711:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203266176:12345-0@lo:400: Request processed in 28us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384388.539716:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787384388.539727:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787384388.539733:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3559500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874208203265792:12345-0@lo:400: 00000100:00100000:2.0:1787384388.539757:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3559500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874208203265792:12345-0@lo:400: Request processed in 25us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384388.539762:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787384388.539771:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787384388.539808:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874208203266304:12345-0@lo:400: 00000100:00100000:2.0:1787384388.539837:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874208203266304:12345-0@lo:400: Request processed in 61us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384388.539851:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1787384388.539873:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787384388.539878:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787384388.539880:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384388.539919:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874208203265792:0@lo:400: 00000100:00100000:2.0:1787384388.539931:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4030a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203266304:0@lo:400: 00000100:00100000:2.0:1787384388.539939:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203265664:0@lo:400: 00010000:00080000:2.0:1787384388.539950:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4031180 x1874208203266176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384388.539959:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4031180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203266176:0@lo:400: 00000100:00100000:2.0:1787384388.540015:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874208203265536:0@lo:400: 00000100:00100000:2.0:1787384388.540028:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7de8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874208203266048:0@lo:400: 00010000:00080000:2.0:1787384388.540038:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4031c00 x1874208203266560/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384388.540047:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4031c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203266560:0@lo:400: 00000100:00100000:2.0:1787384388.540081:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7deb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203265920:0@lo:400: 00010000:00080000:2.0:1787384388.540100:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4030e00 x1874208203266432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384388.540110:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4030e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203266432:0@lo:400: 00000100:00100000:1.0:1787384388.540451:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203265408 00000100:00100000:1.0:1787384388.540457:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203265408 00000100:00100000:1.0:1787384388.540508:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787384388.540517:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3651:x1874208203265408:12345-0@lo:400: 00000100:00100000:1.0:1787384388.540587:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3651:x1874208203265408:12345-0@lo:400: Request processed in 72us (2074us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384388.540594:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787384388.540636:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203265408:0@lo:400: 00000100:00100000:0.0:1787384389.049068:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787384389.049097:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203266688:0@lo:13: 00000100:00100000:0.0:1787384389.049168:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384389.049228:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203266688 00000100:00100000:1.0:1787384389.049243:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203266688 00000100:00100000:1.0:1787384389.049368:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787384389.049379:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203266688:12345-0@lo:13: 00002000:00000024:1.0:1787384389.049425:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787384389.049507:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203266688:12345-0@lo:13: Request processed in 130us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384389.049515:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1787384389.062922:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee254700 x1874208203266688/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384389.062956:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203266688:0@lo:13: 00010000:00010000:2.0:1787384389.560955:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787384390.238751:0:10335:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffd6222d580 00000020:00000080:0.0:1787384390.238768:0:10335:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:0.0:1787384390.238773:0:10335:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:0.0:1787384390.238807:0:10335:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd6222f810 20000000:00000080:0.0:1787384390.238816:0:10335:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98f7c3bb3400 uarg=0000000000000000 20000000:01000000:0.0:1787384390.238857:0:10335:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1787384390.238859:0:10335:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1787384390.238862:0:10335:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787384390.238867:0:10335:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787384390.238871:0:10335:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1787384390.238936:0:10335:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787384390.238939:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787384390.239936:0:10336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:0.0:1787384390.242956:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:0.0:1787384390.243012:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:0.0:1787384390.243028:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:0.0:1787384390.243038:0:10335:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787384390.243156:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787384390.244722:0:10337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1787384390.245223:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1787384390.245255:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1787384390.245433:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:2.0:1787384390.245447:0:10335:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787384390.245450:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787384390.245996:0:10338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:0.0:1787384390.246588:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:0.0:1787384390.246613:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:0.0:1787384390.246629:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:0.0:1787384390.246639:0:10335:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787384390.246641:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787384390.247194:0:10339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:0.0:1787384390.247514:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:0.0:1787384390.247537:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:0.0:1787384390.247553:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:0.0:1787384390.247565:0:10335:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1787384390.247567:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787384390.248313:0:10340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1787384390.248485:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:2.0:1787384390.248504:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:2.0:1787384390.248515:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 10000000:01000000:2.0:1787384390.248526:0:10335:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787384390.248545:0:10335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98f8f58cd800/0x7ef423838fba27d7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.248563:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f7c2090800/0x7ef423838fba2672 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba266b expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.248571:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f902159a00/0x7ef423838fba269c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2695 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.248578:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f8f5825200/0x7ef423838fba26db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba26d4 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.248586:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f8f5824a00/0x7ef423838fba26e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba26e2 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.248593:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f7c2090c00/0x7ef423838fba26f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba26f0 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.248599:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f902159400/0x7ef423838fba2713 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba270c expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.248606:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f8f5824600/0x7ef423838fba273d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2736 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.248622:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f8f5824c00/0x7ef423838fba2759 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2752 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.248628:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f8f5825000/0x7ef423838fba2783 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba277c expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.248637:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f902158000/0x7ef423838fba2791 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce35aa expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.248645:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f7c3b05c00/0x7ef423838fba2798 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce35b1 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.248652:0:10335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98f8f58cd800/0x7ef423838fba27d7 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.248686:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f7c3b05c00/0x7ef423838fba2798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce35b1 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.248701:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f7c3b05c00/0x7ef423838fba2798 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce35b1 expref: 9 pid: 6516 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384390.248716:0:10335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c20d3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1874208203266816:192.168.203.45@tcp:104: 00010000:00010000:2.0:1787384390.249044:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f902158000/0x7ef423838fba2791 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce35aa expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.249054:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f902158000/0x7ef423838fba2791 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce35aa expref: 9 pid: 6514 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384390.249063:0:10335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c20d0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1874208203266944:192.168.203.45@tcp:104: 00010000:00010000:2.0:1787384390.250500:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f8f5825000/0x7ef423838fba2783 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba277c expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.250515:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f8f5825000/0x7ef423838fba2783 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba277c expref: 23 pid: 6514 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384390.250529:0:10335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7deb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1874208203267072:0@lo:104: 00000100:00100000:2.0:1787384390.250584:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787384390.250701:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f8f5824c00/0x7ef423838fba2759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba2752 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.250710:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f8f5824c00/0x7ef423838fba2759 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba2752 expref: 23 pid: 6516 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384390.250718:0:10335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7de8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1874208203267200:0@lo:104: 00000100:00100000:2.0:1787384390.250740:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787384390.250853:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f8f5824600/0x7ef423838fba273d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba2736 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.250862:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f8f5824600/0x7ef423838fba273d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba2736 expref: 23 pid: 6514 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384390.250871:0:10335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dea680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1874208203267328:0@lo:104: 00000100:00100000:2.0:1787384390.250892:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384390.250909:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203267072 00000100:00100000:1.0:1787384390.250916:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203267072 00000100:00100000:1.0:1787384390.250958:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203267200 00000100:00100000:1.0:1787384390.250961:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203267200 00000100:00100000:1.0:1787384390.250987:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787384390.250995:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7deb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+4:10335:x1874208203267072:12345-0@lo:104: 00000100:00100000:0.0:1787384390.251007:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1787384390.251008:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f7c2091a00/0x7ef423838fba277c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2783 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384390.251016:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+4:10335:x1874208203267200:12345-0@lo:104: 00010000:00010000:0.0:1787384390.251022:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f8f5825c00/0x7ef423838fba2752 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2759 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384390.254451:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787384390.254468:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7deb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+4:10335:x1874208203267072:12345-0@lo:104: Request processed in 3469us (3879us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384390.254479:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787384390.254514:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203267328 00000100:00100000:1.0:1787384390.254521:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203267328 00000100:00100000:1.0:1787384390.254551:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787384390.254560:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+4:10335:x1874208203267328:12345-0@lo:104: 00010000:00010000:1.0:1787384390.254575:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f902159200/0x7ef423838fba2736 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba273d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384390.254644:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787384390.254661:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+4:10335:x1874208203267328:12345-0@lo:104: Request processed in 103us (3768us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384390.254667:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1787384390.254900:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f902159400/0x7ef423838fba2713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba270c expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.254914:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f902159400/0x7ef423838fba2713 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba270c expref: 23 pid: 6514 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384390.254940:0:10335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9148000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1874208203267456:0@lo:104: 00000100:00100000:2.0:1787384390.254985:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787384390.255132:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f7c2090c00/0x7ef423838fba26f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba26f0 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.255144:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f7c2090c00/0x7ef423838fba26f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba26f0 expref: 23 pid: 6514 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384390.255154:0:10335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1874208203267584:0@lo:104: 00010000:00010000:2.0:1787384390.255182:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f8f5824a00/0x7ef423838fba26e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba26e2 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.255190:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f8f5824a00/0x7ef423838fba26e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba26e2 expref: 23 pid: 6514 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384390.255197:0:10335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1874208203267712:0@lo:104: 00010000:00010000:2.0:1787384390.255376:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f8f5825200/0x7ef423838fba26db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba26d4 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.255385:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f8f5825200/0x7ef423838fba26db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba26d4 expref: 23 pid: 6516 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384390.255392:0:10335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1874208203267840:0@lo:104: 00010000:00010000:2.0:1787384390.255417:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f902159a00/0x7ef423838fba269c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba2695 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.255424:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f902159a00/0x7ef423838fba269c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba2695 expref: 23 pid: 6516 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384390.255443:0:10335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1874208203267968:0@lo:104: 00010000:00010000:2.0:1787384390.255469:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f7c2090800/0x7ef423838fba2672 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba266b expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.255476:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f7c2090800/0x7ef423838fba2672 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba266b expref: 23 pid: 6515 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384390.255482:0:10335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1874208203268096:0@lo:104: 00000100:00100000:2.0:1787384390.255497:0:10335:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9462540 going to sleep for 11 seconds 00000100:00100000:2.0:1787384390.255518:0:10335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7deb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1874208203267072:0@lo:104: 00000100:00100000:2.0:1787384390.255526:0:10335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7de8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1874208203267200:0@lo:104: 00000100:00100000:2.0:1787384390.255533:0:10335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dea680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1874208203267328:0@lo:104: 00010000:00010000:2.0:1787384390.255553:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787384390.255559:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f7c2091a00/0x7ef423838fba277c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2783 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.255565:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2091a00 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384390.255569:0:8453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f7c2091a00/0x7ef423838fba277c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba2783 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.255577:0:8453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f7c2091a00/0x7ef423838fba277c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba2783 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384390.255583:0:8453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f7c2091a00/0x7ef423838fba277c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba2783 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384390.255588:0:8453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787384390.255621:0:8453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f7c2091a00/0x7ef423838fba277c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2783 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.255628:0:8453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787384390.255647:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f7c2091a00/0x7ef423838fba277c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2783 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.255654:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f7c2091a00/0x7ef423838fba277c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2783 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.255666:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384390.255669:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f902159200/0x7ef423838fba2736 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba273d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.255674:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f902159200 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384390.255677:0:8453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f902159200/0x7ef423838fba2736 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba273d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.255684:0:8453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f902159200/0x7ef423838fba2736 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba273d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384390.255691:0:8453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f902159200/0x7ef423838fba2736 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba273d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384390.255696:0:8453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787384390.255729:0:8453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f902159200/0x7ef423838fba2736 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba273d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.255736:0:8453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787384390.255753:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f902159200/0x7ef423838fba2736 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba273d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.255768:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f902159200/0x7ef423838fba2736 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba273d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.255827:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384390.255829:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384390.255831:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384390.255837:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384390.255850:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203268224:0@lo:103: 00000100:00100000:2.0:1787384390.255881:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384390.255914:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203268352:0@lo:103: 00000100:00100000:2.0:1787384390.255936:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384390.255965:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203268224 00000100:00100000:2.0:1787384390.255970:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203268224 00010000:00010000:2.0:1787384390.256004:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f8f5825000/0x7ef423838fba2783 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba277c expref: 24 pid: 6514 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384390.256025:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203268352 00000100:00100000:2.0:1787384390.256028:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203268352 00010000:00010000:2.0:1787384390.256038:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f8f5824600/0x7ef423838fba273d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba2736 expref: 25 pid: 6514 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384390.256056:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787384390.256064:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f18e1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ca80b7f5-0e34-441a-981f-ebff717028c4+25:3654:x1874208203268224:12345-0@lo:103: 00000100:00100000:1.0:1787384390.256352:0:6506:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787384390.256371:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384390.256384:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384390.256393:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384390.256401:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384390.256409:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384390.256416:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203267456 00000100:00100000:1.0:1787384390.256420:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203267456 00000100:00100000:1.0:1787384390.256439:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203267584 00000100:00100000:1.0:1787384390.256441:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203267584 00000100:00100000:1.0:1787384390.256452:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203267712 00000100:00100000:1.0:1787384390.256454:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203267712 00000100:00100000:1.0:1787384390.256462:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203267840 00000100:00100000:1.0:1787384390.256465:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203267840 00000100:00100000:1.0:1787384390.256473:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203267968 00000100:00100000:1.0:1787384390.256475:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203267968 00000100:00100000:1.0:1787384390.256483:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203268096 00000100:00100000:1.0:1787384390.256485:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203268096 00000100:00100000:1.0:1787384390.256494:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787384390.256499:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c359f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+9:10335:x1874208203267456:12345-0@lo:104: 00010000:00010000:1.0:1787384390.256509:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f8f5825400/0x7ef423838fba270c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2713 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384390.256555:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787384390.256560:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c359f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+9:10335:x1874208203267456:12345-0@lo:104: Request processed in 61us (1584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384390.256565:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787384390.256580:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787384390.256594:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4032d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+8:10335:x1874208203267584:12345-0@lo:104: 00010000:00010000:1.0:1787384390.256601:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f8f5825600/0x7ef423838fba26f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba26f7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384390.256637:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787384390.256642:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4032d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+8:10335:x1874208203267584:12345-0@lo:104: Request processed in 48us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384390.256647:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787384390.256660:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787384390.256665:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4031880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+7:10335:x1874208203267712:12345-0@lo:104: 00010000:00010000:1.0:1787384390.256672:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f8f5824400/0x7ef423838fba26e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba26e9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384390.256702:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787384390.256707:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4031880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+7:10335:x1874208203267712:12345-0@lo:104: Request processed in 43us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384390.256712:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787384390.256724:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787384390.256729:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4030380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+6:10335:x1874208203267840:12345-0@lo:104: 00010000:00010000:1.0:1787384390.256736:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f902158400/0x7ef423838fba26d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba26db expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384390.256760:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787384390.256764:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4030380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+6:10335:x1874208203267840:12345-0@lo:104: Request processed in 35us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384390.256769:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787384390.256797:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787384390.256809:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4033480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+5:10335:x1874208203267968:12345-0@lo:104: 00010000:00010000:1.0:1787384390.256816:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba2695 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba269c expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384390.256843:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1787384390.256847:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4033480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+5:10335:x1874208203267968:12345-0@lo:104: Request processed in 40us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384390.256852:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787384390.256864:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787384390.256869:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4030700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+4:10335:x1874208203268096:12345-0@lo:104: 00010000:00010000:1.0:1787384390.256875:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f8f5825a00/0x7ef423838fba266b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2672 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384390.256900:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1787384390.256904:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4030700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+4:10335:x1874208203268096:12345-0@lo:104: Request processed in 36us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384390.256909:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1787384390.256987:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384390.256994:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f8f5825000/0x7ef423838fba2783 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba277c expref: 25 pid: 6514 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.257004:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f8f5825000/0x7ef423838fba2783 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba277c expref: 25 pid: 6514 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.257026:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f5825000/0x7ef423838fba2783 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba277c expref: 25 pid: 6514 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.257039:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384390.257207:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f18e1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3654:x1874208203268224:12345-0@lo:103: Request processed in 1143us (1324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384390.257224:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787384390.257268:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787384390.257275:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ca80b7f5-0e34-441a-981f-ebff717028c4+23:3651:x1874208203268352:12345-0@lo:103: 00010000:00010000:2.0:1787384390.257579:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384390.257586:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f8f5824600/0x7ef423838fba273d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba2736 expref: 23 pid: 6514 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.257596:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f8f5824600/0x7ef423838fba273d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba2736 expref: 23 pid: 6514 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.257607:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f5824600/0x7ef423838fba273d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba2736 expref: 23 pid: 6514 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.257617:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384390.257650:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ca80b7f5-0e34-441a-981f-ebff717028c4+22:3651:x1874208203268352:12345-0@lo:103: Request processed in 376us (1713us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384390.257656:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1787384390.257678:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1787384390.257683:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8f5825400/0x7ef423838fba270c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2713 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.257691:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5825400 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384390.257701:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8f5825400/0x7ef423838fba270c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba2713 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.257709:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8f5825400/0x7ef423838fba270c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba2713 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384390.257716:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8f5825400/0x7ef423838fba270c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba2713 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384390.257722:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787384390.257745:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8f5825400/0x7ef423838fba270c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2713 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.257752:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787384390.257764:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8f5825400/0x7ef423838fba270c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2713 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.257771:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8f5825400/0x7ef423838fba270c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2713 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.257801:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787384390.257805:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8f5825600/0x7ef423838fba26f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba26f7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.257811:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5825600 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384390.257815:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8f5825600/0x7ef423838fba26f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba26f7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.257821:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8f5825600/0x7ef423838fba26f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba26f7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384390.257839:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8f5825600/0x7ef423838fba26f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba26f7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384390.257845:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787384390.257859:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8f5825600/0x7ef423838fba26f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba26f7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.257864:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787384390.257874:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8f5825600/0x7ef423838fba26f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba26f7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.257881:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8f5825600/0x7ef423838fba26f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba26f7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.257889:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787384390.257892:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8f5824400/0x7ef423838fba26e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba26e9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.257897:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5824400 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384390.257900:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8f5824400/0x7ef423838fba26e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba26e9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.257907:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8f5824400/0x7ef423838fba26e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba26e9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384390.257912:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8f5824400/0x7ef423838fba26e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba26e9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384390.257916:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787384390.257935:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8f5824400/0x7ef423838fba26e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba26e9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.257940:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787384390.257946:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8f5824400/0x7ef423838fba26e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba26e9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.257952:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8f5824400/0x7ef423838fba26e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba26e9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.257960:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787384390.257963:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f902158400/0x7ef423838fba26d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba26db expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.257968:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f902158400 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384390.257970:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f902158400/0x7ef423838fba26d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba26db expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.257988:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f902158400/0x7ef423838fba26d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba26db expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384390.257994:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f902158400/0x7ef423838fba26d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba26db expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384390.258000:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787384390.258012:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f902158400/0x7ef423838fba26d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba26db expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.258017:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787384390.258023:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f902158400/0x7ef423838fba26d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba26db expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.258038:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f902158400/0x7ef423838fba26d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba26db expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384390.258353:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203268736:0@lo:103: 00000100:00100000:1.0:1787384390.258393:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384390.258439:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203268224:0@lo:103: 00000100:00100000:1.0:1787384390.258458:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787384390.258464:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203268608:0@lo:103: 00000100:00100000:1.0:1787384390.258486:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787384390.258545:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787384390.258548:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba2695 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba269c expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.258554:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f902158600 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384390.258558:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba2695 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba269c expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.258565:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba2695 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba269c expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384390.258572:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba2695 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba269c expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384390.258577:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787384390.258594:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba2695 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba269c expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.258599:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787384390.258604:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba2695 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba269c expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.258610:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba2695 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba269c expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.258618:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384390.258628:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8f5825a00/0x7ef423838fba266b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2672 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.258634:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5825a00 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384390.258636:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8f5825a00/0x7ef423838fba266b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba2672 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.258642:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8f5825a00/0x7ef423838fba266b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba2672 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384390.258647:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8f5825a00/0x7ef423838fba266b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba2672 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384390.258651:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787384390.258663:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8f5825a00/0x7ef423838fba266b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2672 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.258668:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787384390.258685:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8f5825a00/0x7ef423838fba266b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2672 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.258691:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8f5825a00/0x7ef423838fba266b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2672 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.258698:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384390.258700:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384390.258702:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384390.258714:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203268736 00000100:00100000:2.0:1787384390.258719:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203268736 00010000:00010000:2.0:1787384390.258738:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f8f5824a00/0x7ef423838fba26e9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba26e2 expref: 22 pid: 6514 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384390.258765:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203268608 00000100:00100000:2.0:1787384390.258768:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203268608 00010000:00010000:2.0:1787384390.258804:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f7c2090c00/0x7ef423838fba26f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba26f0 expref: 23 pid: 6514 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384390.258818:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787384390.258825:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4032680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+23:3654:x1874208203268736:12345-0@lo:103: 00010000:00010000:2.0:1787384390.258835:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384390.258839:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f8f5824a00/0x7ef423838fba26e9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba26e2 expref: 23 pid: 6514 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.258847:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f8f5824a00/0x7ef423838fba26e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba26e2 expref: 23 pid: 6514 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.258860:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384390.258887:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4032680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+23:3654:x1874208203268736:12345-0@lo:103: Request processed in 62us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384390.258892:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787384390.258906:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787384390.258913:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4031500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+22:3654:x1874208203268608:12345-0@lo:103: 00010000:00010000:2.0:1787384390.258920:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384390.258924:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f7c2090c00/0x7ef423838fba26f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba26f0 expref: 22 pid: 6514 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.258932:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f7c2090c00/0x7ef423838fba26f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba26f0 expref: 22 pid: 6514 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.258940:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384390.258968:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4031500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+22:3654:x1874208203268608:12345-0@lo:103: Request processed in 56us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384390.258985:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787384390.259005:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203268480:0@lo:103: 00000100:00100000:2.0:1787384390.259028:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384390.259237:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203268608:0@lo:103: 00000100:00100000:1.0:1787384390.259246:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203268736:0@lo:103: 00000100:00100000:1.0:1787384390.259259:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787384390.259271:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203269120:0@lo:103: 00000100:00100000:1.0:1787384390.259416:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384390.259457:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203268992:0@lo:103: 00000100:00100000:2.0:1787384390.259482:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384390.259496:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787384390.259501:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203268864:0@lo:103: 00000100:00100000:2.0:1787384390.259521:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787384390.259546:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384390.259555:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203268480 00000100:00100000:2.0:1787384390.259558:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203268480 00010000:00010000:2.0:1787384390.259574:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f902159400/0x7ef423838fba2713 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba270c expref: 22 pid: 6514 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384390.259586:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203269120 00000100:00100000:2.0:1787384390.259589:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203269120 00010000:00010000:2.0:1787384390.259597:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f7c2090800/0x7ef423838fba2672 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba266b expref: 23 pid: 6515 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384390.259607:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203268992 00000100:00100000:2.0:1787384390.259610:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203268992 00010000:00010000:2.0:1787384390.259619:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f902159a00/0x7ef423838fba269c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba2695 expref: 24 pid: 6516 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384390.259627:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203268864 00000100:00100000:2.0:1787384390.259629:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203268864 00010000:00010000:2.0:1787384390.259637:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f8f5825200/0x7ef423838fba26db lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba26d4 expref: 25 pid: 6516 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384390.259663:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787384390.259669:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+25:3652:x1874208203268480:12345-0@lo:103: 00010000:00010000:2.0:1787384390.259677:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384390.259681:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f902159400/0x7ef423838fba2713 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba270c expref: 25 pid: 6514 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.259690:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f902159400/0x7ef423838fba2713 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba270c expref: 25 pid: 6514 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.259701:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384390.259775:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+25:3652:x1874208203268480:12345-0@lo:103: Request processed in 105us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384390.259799:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787384390.259813:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787384390.259818:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4033800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3654:x1874208203269120:12345-0@lo:103: 00010000:00010000:2.0:1787384390.259826:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384390.259831:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f7c2090800/0x7ef423838fba2672 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba266b expref: 24 pid: 6515 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.259838:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f7c2090800/0x7ef423838fba2672 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba266b expref: 24 pid: 6515 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.259848:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384390.259875:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4033800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3654:x1874208203269120:12345-0@lo:103: Request processed in 57us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384390.259881:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787384390.259893:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787384390.259905:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+23:3652:x1874208203268992:12345-0@lo:103: 00010000:00010000:2.0:1787384390.259913:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384390.259917:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f902159a00/0x7ef423838fba269c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba2695 expref: 23 pid: 6516 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.259925:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f902159a00/0x7ef423838fba269c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba2695 expref: 23 pid: 6516 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.259934:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384390.259955:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+23:3652:x1874208203268992:12345-0@lo:103: Request processed in 50us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384390.259961:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787384390.259985:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787384390.259991:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b45c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+22:3652:x1874208203268864:12345-0@lo:103: 00010000:00010000:2.0:1787384390.259998:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384390.260002:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f8f5825200/0x7ef423838fba26db lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba26d4 expref: 22 pid: 6516 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.260011:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f8f5825200/0x7ef423838fba26db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba26d4 expref: 22 pid: 6516 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.260020:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384390.260053:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b45c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+22:3652:x1874208203268864:12345-0@lo:103: Request processed in 50us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384390.260060:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787384390.260181:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203268352:0@lo:103: 00010000:00010000:2.0:1787384390.260198:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384390.260221:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203269120:0@lo:103: 00010000:00010000:2.0:1787384390.260269:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f902159400/0x7ef423838fba2713 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba270c expref: 21 pid: 6514 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384390.260294:0:10335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9148000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1874208203267456:0@lo:104: 00010000:00010000:2.0:1787384390.260306:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c2090c00/0x7ef423838fba26f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba26f0 expref: 20 pid: 6514 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384390.260312:0:10335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1874208203267584:0@lo:104: 00010000:00010000:2.0:1787384390.260322:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f5824a00/0x7ef423838fba26e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba26e2 expref: 19 pid: 6514 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384390.260330:0:10335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1874208203267712:0@lo:104: 00010000:00010000:2.0:1787384390.260340:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f5825200/0x7ef423838fba26db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba26d4 expref: 18 pid: 6516 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384390.260348:0:10335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1874208203267840:0@lo:104: 00010000:00010000:2.0:1787384390.260357:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f902159a00/0x7ef423838fba269c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba2695 expref: 17 pid: 6516 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384390.260365:0:10335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1874208203267968:0@lo:104: 00010000:00010000:2.0:1787384390.260374:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c2090800/0x7ef423838fba2672 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba266b expref: 16 pid: 6515 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384390.260381:0:10335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1874208203268096:0@lo:104: 00000100:00100000:3.0:1787384390.260644:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384390.260668:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384390.260697:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182243840 00000100:00100000:3.0:1787384390.260701:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182243840 00010000:00010000:3.0:1787384390.260719:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f7c3b05c00/0x7ef423838fba2798 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce35b1 expref: 10 pid: 6516 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384390.260732:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182243968 00000100:00100000:3.0:1787384390.260734:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182243968 00010000:00010000:3.0:1787384390.260741:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f902158000/0x7ef423838fba2791 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce35aa expref: 11 pid: 6514 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384390.260752:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 32 00000100:00100000:3.0:1787384390.260758:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee31d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09777221-fe6d-4549-9ee6-04300d230fb6+11:2415:x1874208182243840:12345-192.168.203.45@tcp:103: 00010000:00010000:3.0:1787384390.260766:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384390.260775:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f7c3b05c00/0x7ef423838fba2798 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce35b1 expref: 11 pid: 6516 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384390.260819:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f7c3b05c00/0x7ef423838fba2798 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce35b1 expref: 11 pid: 6516 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384390.260838:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384390.260873:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee31d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09777221-fe6d-4549-9ee6-04300d230fb6+11:2415:x1874208182243840:12345-192.168.203.45@tcp:103: Request processed in 115us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384390.260880:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 32 00000100:00100000:3.0:1787384390.261061:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 33 00000100:00100000:3.0:1787384390.261069:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee31c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09777221-fe6d-4549-9ee6-04300d230fb6+10:2416:x1874208182243968:12345-192.168.203.45@tcp:103: 00010000:00010000:3.0:1787384390.261077:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384390.261083:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f902158000/0x7ef423838fba2791 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce35aa expref: 10 pid: 6514 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384390.261092:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f902158000/0x7ef423838fba2791 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce35aa expref: 10 pid: 6514 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384390.261163:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384390.261184:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee31c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09777221-fe6d-4549-9ee6-04300d230fb6+10:2416:x1874208182243968:12345-192.168.203.45@tcp:103: Request processed in 116us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384390.261191:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 33 00010000:00010000:3.0:1787384390.262379:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c3b05c00/0x7ef423838fba2798 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce35b1 expref: 9 pid: 6516 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384390.262396:0:10335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c20d3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1874208203266816:192.168.203.45@tcp:104: 00010000:00010000:3.0:1787384390.262408:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f902158000/0x7ef423838fba2791 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce35aa expref: 8 pid: 6514 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384390.262431:0:10335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c20d0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1874208203266944:192.168.203.45@tcp:104: 00010000:00010000:3.0:1787384390.262478:0:10335:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98f8f58cd800/0x7ef423838fba27d7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384390.262920:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203268480:0@lo:103: 00000100:00100000:1.0:1787384390.262932:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203268992:0@lo:103: 00000100:00100000:1.0:1787384390.262949:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203268864:0@lo:103: 00010000:00010000:0.0:1787384390.263335:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787384390.263344:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+3:10335:x1874208203267200:12345-0@lo:104: Request processed in 12329us (12603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384390.263354:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1787384390.263378:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384390.263385:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8f5825c00/0x7ef423838fba2752 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2759 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.263405:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5825c00 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384390.263408:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8f5825c00/0x7ef423838fba2752 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba2759 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.263419:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8f5825c00/0x7ef423838fba2752 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba2759 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384390.263425:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8f5825c00/0x7ef423838fba2752 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba2759 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384390.263431:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787384390.263474:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8f5825c00/0x7ef423838fba2752 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2759 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.263482:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787384390.263510:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8f5825c00/0x7ef423838fba2752 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2759 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.263517:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8f5825c00/0x7ef423838fba2752 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2759 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.263533:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384390.263535:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384390.263537:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1787384390.263537:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384390.263551:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203269248:0@lo:103: 00000100:00100000:3.0:1787384390.263963:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384390.264041:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203269248 00000100:00100000:0.0:1787384390.264048:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203269248 00010000:00010000:0.0:1787384390.264080:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f8f5824c00/0x7ef423838fba2759 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba2752 expref: 16 pid: 6516 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384390.264196:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787384390.264205:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee31f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+16:3653:x1874208203269248:12345-0@lo:103: 00010000:00010000:0.0:1787384390.264224:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384390.264229:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f8f5824c00/0x7ef423838fba2759 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba2752 expref: 16 pid: 6516 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384390.264240:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f8f5824c00/0x7ef423838fba2759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba2752 expref: 16 pid: 6516 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384390.264253:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f5824c00/0x7ef423838fba2759 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba2752 expref: 16 pid: 6516 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384390.264266:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98f8f58cd800/0x7ef423838fba27d7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384390.264273:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f58cd800/0x7ef423838fba27d7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384390.264289:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f8f58cd800/0x7ef423838fba27d7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384390.264296:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f8f58cd800/0x7ef423838fba27d7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384390.264302:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98f8f58cd800/0x7ef423838fba27d7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384390.264309:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98f8f58cd800/0x7ef423838fba27d7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384390.264314:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cd800 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384390.264317:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98f8f58cd800/0x7ef423838fba27d7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384390.264335:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98f8f58cd800/0x7ef423838fba27d7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384390.264358:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98f8f58cd800/0x7ef423838fba27d7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384390.264369:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384390.264413:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee31f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+15:3653:x1874208203269248:12345-0@lo:103: Request processed in 210us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384390.264420:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:2.0:1787384390.264489:0:10335:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98f8f58cd800/0x7ef423838fba27d7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384390.264490:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203269248:0@lo:103: 00010000:00010000:2.0:1787384390.264497:0:10335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98f8f58cd800/0x7ef423838fba27d7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384390.264513:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f58cd800/0x7ef423838fba27d7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384390.583578:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4033b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203269376:0@lo:41: 00000100:00100000:2.0:1787384390.583664:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384390.583740:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203269376 00000100:00100000:2.0:1787384390.583747:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203269376 00000100:00100000:2.0:1787384390.583806:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787384390.583814:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203269376:12345-0@lo:41: 00010000:00010000:0.0:1787384390.583846:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000024:2.0:1787384390.583859:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787384390.583915:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203269376:12345-0@lo:41: Request processed in 100us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384390.583922:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787384390.584167:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4033b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203269376:0@lo:41: 00000100:00100000:2.0:1787384391.011640:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384391.011685:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384391.011722:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384391.011831:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384391.011860:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182244608 00000100:00100000:2.0:1787384391.011870:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182244608 00000100:00100000:2.0:1787384391.011917:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182244736 00000100:00100000:2.0:1787384391.011920:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182244736 00000100:00100000:2.0:1787384391.011937:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 20 00000100:00100000:2.0:1787384391.011945:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2413:x1874208182244608:12345-192.168.203.45@tcp:400: 00000100:00100000:2.0:1787384391.012020:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2413:x1874208182244608:12345-192.168.203.45@tcp:400: Request processed in 74us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384391.012028:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 20 00000100:00100000:2.0:1787384391.012060:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 21 00000100:00100000:2.0:1787384391.012067:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2413:x1874208182244736:12345-192.168.203.45@tcp:400: 00000100:00100000:2.0:1787384391.012094:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2413:x1874208182244736:12345-192.168.203.45@tcp:400: Request processed in 27us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384391.012100:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 21 00000100:00080000:2.0:1787384391.012115:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787384391.012118:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787384391.012185:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182244096 00000100:00100000:0.0:1787384391.012189:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182244096 00000100:00100000:0.0:1787384391.012221:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 198 00000100:00100000:0.0:1787384391.012228:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+8:6186:x1874208182244096:12345-192.168.203.45@tcp:101: 00010000:00010000:0.0:1787384391.012237:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384391.012253:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c3b05600/0x7ef423838fba27de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3621 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384391.012276:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c3b05600/0x7ef423838fba27de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3621 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384391.012287:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c3b05600/0x7ef423838fba27de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3621 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384391.012297:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3b05600, rc 0) 00000100:00100000:0.0:1787384391.012317:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+9:6186:x1874208182244096:12345-192.168.203.45@tcp:101: Request processed in 90us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384391.012329:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 198 00000100:00100000:3.0:1787384391.012832:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182244352 00000100:00100000:3.0:1787384391.012837:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182244352 00000100:00100000:3.0:1787384391.012888:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 63 00000100:00100000:3.0:1787384391.012894:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2413:x1874208182244352:12345-192.168.203.45@tcp:400: 00000100:00100000:3.0:1787384391.012927:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2413:x1874208182244352:12345-192.168.203.45@tcp:400: Request processed in 33us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384391.012934:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 63 00000100:00080000:0.0:1787384391.013113:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787384391.017436:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384391.017482:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384391.017579:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182244480 00000100:00100000:0.0:1787384391.017588:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182244480 00000100:00100000:0.0:1787384391.017666:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 64 00000100:00100000:0.0:1787384391.017676:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee31c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2414:x1874208182244480:12345-192.168.203.45@tcp:400: 00000100:00080000:1.0:1787384391.017723:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787384391.017759:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee31c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2414:x1874208182244480:12345-192.168.203.45@tcp:400: Request processed in 85us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384391.017768:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 64 00000100:00100000:2.0:1787384391.017874:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182244224 00000100:00100000:2.0:1787384391.017879:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182244224 00000100:00100000:2.0:1787384391.017916:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 199 00000100:00100000:2.0:1787384391.017923:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+9:2414:x1874208182244224:12345-192.168.203.45@tcp:400: 00000100:00100000:2.0:1787384391.017952:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+9:2414:x1874208182244224:12345-192.168.203.45@tcp:400: Request processed in 30us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384391.017959:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 199 00000100:00100000:3.0:1787384391.023354:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384391.026864:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182244864 00000100:00100000:2.0:1787384391.026880:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182244864 00000100:00100000:2.0:1787384391.026958:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 200 00000100:00100000:2.0:1787384391.026976:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+9:6186:x1874208182244864:12345-192.168.203.45@tcp:501: 00000100:00100000:2.0:1787384391.027134:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+9:6186:x1874208182244864:12345-192.168.203.45@tcp:501: Request processed in 167us (3789us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384391.027142:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 200 00000100:00100000:1.0:1787384391.040414:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384391.041042:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182244992 00000100:00100000:0.0:1787384391.041053:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182244992 00000100:00100000:0.0:1787384391.041106:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 201 00000100:00100000:0.0:1787384391.041115:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+9:6186:x1874208182244992:12345-192.168.203.45@tcp:503: 00000100:00100000:0.0:1787384391.041252:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+9:6186:x1874208182244992:12345-192.168.203.45@tcp:503: Request processed in 138us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384391.041267:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 201 00000100:00100000:3.0:1787384391.046354:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384391.050881:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182245120 00000100:00100000:2.0:1787384391.050897:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182245120 00000100:00100000:2.0:1787384391.050966:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 202 00000100:00100000:2.0:1787384391.050986:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+9:6660:x1874208182245120:12345-192.168.203.45@tcp:502: 00000100:00100000:2.0:1787384391.051186:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+9:6660:x1874208182245120:12345-192.168.203.45@tcp:502: Request processed in 201us (4842us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384391.051202:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 202 00000100:00100000:1.0:1787384391.053943:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384391.054034:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182245248 00000100:00100000:3.0:1787384391.054044:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182245248 00000100:00100000:3.0:1787384391.054110:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 203 00000100:00100000:3.0:1787384391.054119:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+9:6660:x1874208182245248:12345-192.168.203.45@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787384391.054508:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+9:6660:x1874208182245248:12345-192.168.203.45@tcp:502:llog_process_th.0 Request processed in 388us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384391.054517:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 203 00000100:00100000:1.0:1787384391.070627:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384391.071196:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182245376 00000100:00100000:2.0:1787384391.071207:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182245376 00000100:00100000:2.0:1787384391.071281:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 204 00000100:00100000:2.0:1787384391.071292:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+9:6186:x1874208182245376:12345-192.168.203.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787384391.071309:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384391.071327:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8f58cde00/0x7ef423838fba27e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3628 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384391.071355:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f58cde00/0x7ef423838fba27e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3628 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384391.071366:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8f58cde00/0x7ef423838fba27e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3628 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384391.071374:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cde00, rc 0) 00000100:00100000:2.0:1787384391.071437:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+10:6186:x1874208182245376:12345-192.168.203.45@tcp:101:ll_cfg_requeue.0 Request processed in 146us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384391.071444:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 204 00000100:00100000:2.0:1787384391.077296:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384391.077375:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182245504 00000100:00100000:3.0:1787384391.077386:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182245504 00000100:00100000:3.0:1787384391.077440:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 205 00000100:00100000:3.0:1787384391.077450:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+10:6186:x1874208182245504:12345-192.168.203.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384391.077581:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+10:6186:x1874208182245504:12345-192.168.203.45@tcp:501:ll_cfg_requeue.0 Request processed in 132us (294us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787384391.077589:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 205 00000100:00100000:0.0:1787384391.096171:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787384391.096196:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee31e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203269504:0@lo:41: 00000100:00100000:0.0:1787384391.096284:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384391.096529:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203269504 00000100:00100000:2.0:1787384391.096538:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203269504 00000100:00100000:2.0:1787384391.096590:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787384391.096599:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203269504:12345-0@lo:41: 00000004:00000024:2.0:1787384391.096634:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787384391.096691:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203269504:12345-0@lo:41: Request processed in 92us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384391.096714:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787384391.097069:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee31e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203269504:0@lo:41: 00010000:00010000:2.0:1787384391.607073:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787384391.991031:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787384391.991038:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98f8f7d47800 from 48 10000000:01000000:3.0:1787384391.991044:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787384391.991093:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c2091c00/0x7ef423838fba27ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384391.991105:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f7c2091c00/0x7ef423838fba27ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384391.991116:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f7c2091c00/0x7ef423838fba27ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384391.991141:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee31e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203269632:0@lo:101: 00000100:00100000:3.0:1787384391.991211:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384391.991339:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fd4b7540 going to sleep for 11 seconds 00000100:00100000:0.0:1787384391.996843:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203269632 00000100:00100000:0.0:1787384391.996859:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203269632 00000100:00100000:0.0:1787384391.997002:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1787384391.997014:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+15:6519:x1874208203269632:12345-0@lo:101: 00010000:00010000:0.0:1787384391.997030:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384391.997049:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c3b04e00/0x7ef423838fba27f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba27ec expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384391.997095:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c3b04e00/0x7ef423838fba27f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba27ec expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384391.997106:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c3b04e00/0x7ef423838fba27f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba27ec expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384391.997125:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3b04e00, rc 0) 00000100:00100000:0.0:1787384391.997235:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+16:6519:x1874208203269632:12345-0@lo:101: Request processed in 223us (6023us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384391.997243:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787384391.997301:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee31e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203269632:0@lo:101: 00010000:00010000:1.0:1787384391.997320:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f7c2091c00/0x7ef423838fba27ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba27f3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384391.997330:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f7c2091c00/0x7ef423838fba27ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba27f3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384391.997418:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4030000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203269760:0@lo:501: 00000100:00100000:1.0:1787384391.997452:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384392.003268:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d139c6c0 going to sleep for 10 seconds 00000100:00100000:3.0:1787384392.005198:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203269760 00000100:00100000:3.0:1787384392.005220:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203269760 00000100:00100000:3.0:1787384392.005295:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1787384392.005306:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+16:6519:x1874208203269760:12345-0@lo:501: 00000100:00100000:3.0:1787384392.005911:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+16:6519:x1874208203269760:12345-0@lo:501: Request processed in 605us (8456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384392.005935:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787384392.006832:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4030000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203269760:0@lo:501: 00000100:00100000:1.0:1787384392.006884:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4030000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203269888:0@lo:503: 00000100:00100000:1.0:1787384392.006936:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384392.007038:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d139c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384392.011804:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203269888 00000100:00100000:3.0:1787384392.011819:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203269888 00000100:00100000:3.0:1787384392.012072:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1787384392.013200:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+16:6519:x1874208203269888:12345-0@lo:503: 00000100:00100000:3.0:1787384392.013436:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+16:6519:x1874208203269888:12345-0@lo:503: Request processed in 1353us (6498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384392.013445:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787384392.016396:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4030000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203269888:0@lo:503: 00000100:00100000:3.0:1787384392.023252:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee31d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10360:1874208203270016:0@lo:502: 00000100:00100000:3.0:1787384392.023348:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384392.023402:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3948180 going to sleep for 11 seconds 00000100:00100000:2.0:1787384392.023542:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203270016 00000100:00100000:2.0:1787384392.023549:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203270016 00000100:00100000:2.0:1787384392.023597:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787384392.023606:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+16:10360:x1874208203270016:12345-0@lo:502: 00000100:00100000:2.0:1787384392.023735:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+16:10360:x1874208203270016:12345-0@lo:502: Request processed in 129us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384392.023743:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1787384392.024006:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee31d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10360:1874208203270016:0@lo:502: 00000100:00100000:1.0:1787384392.024049:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4030000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10360:1874208203270144:0@lo:502: 00000100:00100000:1.0:1787384392.024083:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384392.024120:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d139c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384392.024266:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203270144 00000100:00100000:2.0:1787384392.024271:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203270144 00000100:00100000:2.0:1787384392.024307:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1787384392.024314:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+16:10360:x1874208203270144:12345-0@lo:502: 00000100:00100000:2.0:1787384392.024380:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+16:10360:x1874208203270144:12345-0@lo:502: Request processed in 65us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384392.024386:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1787384392.024980:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4030000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10360:1874208203270144:0@lo:502: 00000040:00080000:1.0:1787384392.025010:0:10360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787384392.025277:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1787384392.025300:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787384392.025311:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c2091c00/0x7ef423838fba27ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba27f3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384392.025323:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f7c2091c00/0x7ef423838fba27ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba27f3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384392.025334:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1787384392.025337:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1787384392.025339:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787384392.025370:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c2090e00/0x7ef423838fba27fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384392.025379:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f7c2090e00/0x7ef423838fba27fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384392.025400:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f7c2090e00/0x7ef423838fba27fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384392.025416:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee31f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203270272:0@lo:101: 00000100:00100000:3.0:1787384392.025457:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384392.025492:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3948840 going to sleep for 11 seconds 00000100:00100000:2.0:1787384392.025555:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203270272 00000100:00100000:2.0:1787384392.025561:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203270272 00000100:00100000:2.0:1787384392.025598:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1787384392.025605:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+16:6519:x1874208203270272:12345-0@lo:101: 00010000:00010000:2.0:1787384392.025615:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384392.025625:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8f58cd400/0x7ef423838fba2801 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba27fa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384392.025644:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f58cd400/0x7ef423838fba2801 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba27fa expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384392.025666:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8f58cd400/0x7ef423838fba2801 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba27fa expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384392.025681:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cd400, rc 0) 00000100:00100000:2.0:1787384392.025723:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+17:6519:x1874208203270272:12345-0@lo:101: Request processed in 119us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384392.025729:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1787384392.028066:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee31f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203270272:0@lo:101: 00010000:00010000:1.0:1787384392.028099:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f7c2090e00/0x7ef423838fba27fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2801 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.028111:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f7c2090e00/0x7ef423838fba27fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2801 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384392.028195:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4030000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203270400:0@lo:501: 00000100:00100000:1.0:1787384392.028250:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384392.028287:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d139c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384392.028583:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203270400 00000100:00100000:2.0:1787384392.028590:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203270400 00000100:00100000:2.0:1787384392.028635:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1787384392.028644:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+17:6519:x1874208203270400:12345-0@lo:501: 00000100:00100000:2.0:1787384392.028808:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+17:6519:x1874208203270400:12345-0@lo:501: Request processed in 164us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384392.028816:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1787384392.029071:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4030000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203270400:0@lo:501: 00000100:00100000:3.0:1787384392.029116:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee31fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203270528:0@lo:503: 00000100:00100000:3.0:1787384392.029161:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384392.029194:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c39486c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384392.029252:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203270528 00000100:00100000:0.0:1787384392.029257:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203270528 00000100:00100000:0.0:1787384392.029291:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787384392.029299:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+17:6519:x1874208203270528:12345-0@lo:503: 00000100:00100000:0.0:1787384392.029378:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+17:6519:x1874208203270528:12345-0@lo:503: Request processed in 79us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384392.029384:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1787384392.029588:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee31fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203270528:0@lo:503: 00000100:00100000:3.0:1787384392.031424:0:10361:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee31fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10361:1874208203270656:0@lo:502: 00000100:00100000:3.0:1787384392.031500:0:10361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384392.031548:0:10361:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3948780 going to sleep for 11 seconds 00000100:00100000:0.0:1787384392.031765:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203270656 00000100:00100000:0.0:1787384392.031772:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203270656 00000100:00100000:0.0:1787384392.031855:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1787384392.031864:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+17:10361:x1874208203270656:12345-0@lo:502: 00000100:00100000:0.0:1787384392.031987:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+17:10361:x1874208203270656:12345-0@lo:502: Request processed in 122us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384392.031997:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1787384392.032363:0:10361:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee31fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10361:1874208203270656:0@lo:502: 00000020:01000000:2.0:1787384392.032391:0:10361:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787384392.032402:0:10361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384392.032404:0:10361:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787384392.032410:0:10361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787384392.032438:0:10361:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10361:1874208203270784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384392.032478:0:10361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384392.032506:0:10361:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9354180 going to sleep for 11 seconds 00000100:00100000:1.0:1787384392.032699:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203270784 00000100:00100000:1.0:1787384392.032704:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203270784 00000100:00100000:1.0:1787384392.032740:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787384392.032747:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+17:10361:x1874208203270784:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787384392.032864:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+17:10361:x1874208203270784:12345-0@lo:502:llog_process_th.0 Request processed in 117us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384392.032870:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787384392.034322:0:10361:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10361:1874208203270784:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787384392.034362:0:10361:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384392.034371:0:10361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384392.034374:0:10361:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787384392.034378:0:10361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:0.0:1787384392.036193:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1787384392.036230:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787384392.036242:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c2090e00/0x7ef423838fba27fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2801 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384392.036264:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f7c2090e00/0x7ef423838fba27fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2801 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384392.036274:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787384392.036277:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98f8f5669000 from 48 10000000:01000000:0.0:1787384392.036280:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787384392.036318:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04a00/0x7ef423838fba2808 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384392.036327:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04a00/0x7ef423838fba2808 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384392.036337:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04a00/0x7ef423838fba2808 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384392.036359:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee257800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203270912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787384392.036421:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384392.036462:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7240840 going to sleep for 11 seconds 00000100:00100000:1.0:1787384392.036480:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203270912 00000100:00100000:1.0:1787384392.036488:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203270912 00000100:00100000:1.0:1787384392.036543:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1787384392.036559:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+17:6519:x1874208203270912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787384392.036571:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384392.036583:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c3952a00/0x7ef423838fba280f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba2808 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.036607:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c3952a00/0x7ef423838fba280f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba2808 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.036618:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c3952a00/0x7ef423838fba280f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2808 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.036628:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3952a00, rc 0) 00000100:00100000:1.0:1787384392.037163:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+18:6519:x1874208203270912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 604us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384392.037171:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1787384392.039135:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee257800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203270912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787384392.039161:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04a00/0x7ef423838fba2808 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba280f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384392.039174:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04a00/0x7ef423838fba2808 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba280f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384392.039251:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee257800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203271040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384392.039301:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384392.039357:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7240840 going to sleep for 11 seconds 00000100:00100000:1.0:1787384392.041383:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203271040 00000100:00100000:1.0:1787384392.041395:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203271040 00000100:00100000:1.0:1787384392.041446:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787384392.041456:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+18:6519:x1874208203271040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787384392.041619:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+18:6519:x1874208203271040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 164us (2317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384392.041626:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1787384392.041936:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee257800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203271040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787384392.042009:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203271168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787384392.042053:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384392.042078:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9354180 going to sleep for 11 seconds 00000100:00100000:0.0:1787384392.042615:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203271168 00000100:00100000:0.0:1787384392.042621:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203271168 00000100:00100000:0.0:1787384392.042667:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1787384392.042675:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+18:6519:x1874208203271168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787384392.042771:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+18:6519:x1874208203271168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384392.042803:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1787384392.043117:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203271168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787384392.043457:0:10362:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4032300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10362:1874208203271296:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787384392.043499:0:10362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384392.043530:0:10362:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d139c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384392.043570:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203271296 00000100:00100000:0.0:1787384392.043574:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203271296 00000100:00100000:0.0:1787384392.043604:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1787384392.043611:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+18:10362:x1874208203271296:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787384392.043716:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+18:10362:x1874208203271296:12345-0@lo:502:llog_process_th.0 Request processed in 104us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384392.043724:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1787384392.043987:0:10362:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4032300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10362:1874208203271296:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384392.044032:0:10362:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10362:1874208203271424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384392.044072:0:10362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384392.044108:0:10362:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9354180 going to sleep for 11 seconds 00000100:00100000:1.0:1787384392.044251:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203271424 00000100:00100000:1.0:1787384392.044256:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203271424 00000100:00100000:1.0:1787384392.044283:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1787384392.044298:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+18:10362:x1874208203271424:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787384392.044395:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+18:10362:x1874208203271424:12345-0@lo:502:llog_process_th.0 Request processed in 97us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384392.044401:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1787384392.044518:0:10362:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10362:1874208203271424:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787384392.044537:0:10362:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787384392.045180:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1787384392.045200:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787384392.045211:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04a00/0x7ef423838fba2808 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba280f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384392.045222:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04a00/0x7ef423838fba2808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba280f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384392.045231:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787384392.045233:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1787384392.045236:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787384392.045264:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05200/0x7ef423838fba2816 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384392.045283:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05200/0x7ef423838fba2816 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384392.045293:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05200/0x7ef423838fba2816 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384392.045310:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee257b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203271552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787384392.045349:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384392.045383:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7240540 going to sleep for 11 seconds 00000100:00100000:1.0:1787384392.045435:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203271552 00000100:00100000:1.0:1787384392.045441:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203271552 00000100:00100000:1.0:1787384392.045476:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787384392.045483:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+18:6519:x1874208203271552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787384392.045493:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384392.045506:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c3953200/0x7ef423838fba281d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba2816 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.045528:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c3953200/0x7ef423838fba281d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba2816 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.045539:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c3953200/0x7ef423838fba281d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2816 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.045547:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3953200, rc 0) 00000100:00100000:1.0:1787384392.045585:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+19:6519:x1874208203271552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384392.045591:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787384392.045746:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee257b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203271552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787384392.045760:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05200/0x7ef423838fba2816 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba281d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384392.045769:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05200/0x7ef423838fba2816 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba281d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384392.046350:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203271680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787384392.046385:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384392.046418:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9354180 going to sleep for 11 seconds 00000100:00100000:0.0:1787384392.046729:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203271680 00000100:00100000:0.0:1787384392.046735:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203271680 00000100:00100000:0.0:1787384392.046799:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1787384392.046809:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+19:6519:x1874208203271680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384392.046933:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+19:6519:x1874208203271680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384392.046940:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1787384392.051811:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203271680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787384392.051884:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203271808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787384392.051960:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384392.052023:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9354180 going to sleep for 11 seconds 00000100:00100000:0.0:1787384392.052224:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203271808 00000100:00100000:0.0:1787384392.052231:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203271808 00000100:00100000:0.0:1787384392.052289:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787384392.052298:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+19:6519:x1874208203271808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787384392.052420:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+19:6519:x1874208203271808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 122us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384392.052438:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1787384392.054677:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203271808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384392.055219:0:10363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee31c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10363:1874208203271936:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787384392.055292:0:10363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384392.055336:0:10363:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3948c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787384392.055700:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203271936 00000100:00100000:0.0:1787384392.055707:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203271936 00000100:00100000:0.0:1787384392.055810:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787384392.055827:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+19:10363:x1874208203271936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787384392.055947:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+19:10363:x1874208203271936:12345-0@lo:502:llog_process_th.0 Request processed in 121us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384392.055957:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787384392.056075:0:10363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee31c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10363:1874208203271936:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787384392.056101:0:10363:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787384392.056111:0:10363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384392.056113:0:10363:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787384392.056119:0:10363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787384392.056140:0:10363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee31c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10363:1874208203272064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787384392.056173:0:10363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384392.056571:0:10363:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3948c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787384392.056730:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203272064 00000100:00100000:2.0:1787384392.056737:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203272064 00000100:00100000:2.0:1787384392.056764:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787384392.056770:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+19:10363:x1874208203272064:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384392.056879:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+19:10363:x1874208203272064:12345-0@lo:502:llog_process_th.0 Request processed in 108us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384392.056886:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787384392.057049:0:10363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee31c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10363:1874208203272064:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787384392.057070:0:10363:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787384392.057076:0:10363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384392.057078:0:10363:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787384392.057082:0:10363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:0.0:1787384392.057407:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1787384392.057494:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787384392.057504:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05200/0x7ef423838fba2816 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba281d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384392.057632:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05200/0x7ef423838fba2816 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba281d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384392.057642:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787384392.057645:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98f8f5698000 from 48 10000000:01000000:0.0:1787384392.057648:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787384392.057675:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05c00/0x7ef423838fba2824 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384392.057683:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05c00/0x7ef423838fba2824 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384392.057692:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05c00/0x7ef423838fba2824 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384392.057711:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee254000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203272192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787384392.057749:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384392.057859:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203272192 00000100:00100000:2.0:1787384392.057864:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203272192 00000100:00100000:0.0:1787384392.057943:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9462600 going to sleep for 11 seconds 00000100:00100000:2.0:1787384392.057993:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787384392.058001:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+19:6519:x1874208203272192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787384392.058011:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384392.058022:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8f58cca00/0x7ef423838fba282b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba2824 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384392.058042:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f58cca00/0x7ef423838fba282b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba2824 expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384392.058052:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8f58cca00/0x7ef423838fba282b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2824 expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384392.058061:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cca00, rc 0) 00000100:00100000:2.0:1787384392.058102:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+20:6519:x1874208203272192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384392.058109:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787384392.058304:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee254000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203272192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787384392.058331:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05c00/0x7ef423838fba2824 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba282b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384392.058340:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05c00/0x7ef423838fba2824 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba282b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384392.058390:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee254000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203272320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384392.058414:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384392.058839:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9462600 going to sleep for 11 seconds 00000100:00100000:3.0:1787384392.058891:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203272320 00000100:00100000:3.0:1787384392.058896:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203272320 00000100:00100000:3.0:1787384392.058923:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787384392.058929:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cacee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+20:6519:x1874208203272320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384392.059097:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cacee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+20:6519:x1874208203272320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 166us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384392.059104:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787384392.059331:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee254000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203272320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384392.059366:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee254000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203272448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787384392.059408:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384392.059650:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9462600 going to sleep for 11 seconds 00000100:00100000:3.0:1787384392.059694:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203272448 00000100:00100000:3.0:1787384392.059699:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203272448 00000100:00100000:3.0:1787384392.059762:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1787384392.059770:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cacecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+20:6519:x1874208203272448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384392.059874:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cacecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+20:6519:x1874208203272448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384392.059881:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1787384392.059948:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee254000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203272448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787384392.060182:0:10364:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee254000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10364:1874208203272576:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787384392.060216:0:10364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384392.060376:0:10364:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8293cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384392.060412:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203272576 00000100:00100000:2.0:1787384392.060417:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203272576 00000100:00100000:2.0:1787384392.060523:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1787384392.061027:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cacec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+20:10364:x1874208203272576:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384392.061332:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cacec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+20:10364:x1874208203272576:12345-0@lo:502:llog_process_th.0 Request processed in 309us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384392.061339:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1787384392.061631:0:10364:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee254000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10364:1874208203272576:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787384392.061686:0:10364:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee254000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10364:1874208203272704:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787384392.061727:0:10364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384392.061816:0:10364:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9462600 going to sleep for 11 seconds 00000100:00100000:2.0:1787384392.061906:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203272704 00000100:00100000:2.0:1787384392.061911:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203272704 00000100:00100000:2.0:1787384392.061984:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787384392.061991:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+20:10364:x1874208203272704:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384392.062074:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+20:10364:x1874208203272704:12345-0@lo:502:llog_process_th.0 Request processed in 83us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384392.062080:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787384392.062155:0:10364:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee254000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10364:1874208203272704:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787384392.062176:0:10364:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787384392.062239:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1787384392.062261:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787384392.062269:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05c00/0x7ef423838fba2824 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba282b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384392.062279:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05c00/0x7ef423838fba2824 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba282b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384392.062287:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1787384392.062290:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:0.0:1787384392.062292:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1787384392.062314:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04600/0x7ef423838fba2832 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384392.062321:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04600/0x7ef423838fba2832 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384392.062329:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04600/0x7ef423838fba2832 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384392.062341:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee254000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203272832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787384392.062365:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384392.062732:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8293cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384392.062919:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203272832 00000100:00100000:3.0:1787384392.062925:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203272832 00000100:00100000:3.0:1787384392.062953:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1787384392.062960:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+20:6519:x1874208203272832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384392.062979:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384392.062991:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c2091600/0x7ef423838fba2839 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba2832 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384392.063028:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c2091600/0x7ef423838fba2839 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba2832 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384392.063038:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c2091600/0x7ef423838fba2839 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2832 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384392.063047:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2091600, rc 0) 00000100:00100000:3.0:1787384392.063095:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+21:6519:x1874208203272832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384392.063102:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787384392.063186:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee254000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203272832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787384392.063199:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04600/0x7ef423838fba2832 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2839 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384392.063208:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04600/0x7ef423838fba2832 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2839 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384392.063268:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee254000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203272960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384392.063303:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384392.063313:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8293cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384392.063361:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203272960 00000100:00100000:3.0:1787384392.063365:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203272960 00000100:00100000:3.0:1787384392.063380:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787384392.063385:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+21:6519:x1874208203272960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384392.063695:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+21:6519:x1874208203272960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 309us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384392.063702:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1787384392.063769:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee254000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203272960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384392.063828:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee254000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203273088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787384392.063864:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384392.063881:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8293cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384392.063931:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203273088 00000100:00100000:3.0:1787384392.063935:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203273088 00000100:00100000:3.0:1787384392.063954:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787384392.063959:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+21:6519:x1874208203273088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384392.064055:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+21:6519:x1874208203273088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384392.064061:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1787384392.064216:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee254000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203273088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787384392.064702:0:10365:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee254000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10365:1874208203273216:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787384392.064744:0:10365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384392.064760:0:10365:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8293cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384392.064834:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203273216 00000100:00100000:3.0:1787384392.064838:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203273216 00000100:00100000:3.0:1787384392.064864:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787384392.064869:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+21:10365:x1874208203273216:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787384392.064952:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+21:10365:x1874208203273216:12345-0@lo:502:llog_process_th.0 Request processed in 81us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384392.064960:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787384392.065044:0:10365:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee254000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10365:1874208203273216:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787384392.065067:0:10365:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787384392.065075:0:10365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384392.065078:0:10365:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787384392.065084:0:10365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787384392.065103:0:10365:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee254000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10365:1874208203273344:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787384392.065135:0:10365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384392.065154:0:10365:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c5f0fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787384392.065191:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203273344 00000100:00100000:3.0:1787384392.065195:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203273344 00000100:00100000:3.0:1787384392.065213:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787384392.065218:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+21:10365:x1874208203273344:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787384392.065318:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+21:10365:x1874208203273344:12345-0@lo:502:llog_process_th.0 Request processed in 99us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384392.065324:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1787384392.065498:0:10365:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee254000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10365:1874208203273344:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787384392.065650:0:10365:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384392.065655:0:10365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384392.065656:0:10365:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787384392.065660:0:10365:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:3.0:1787384392.065945:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:3.0:1787384392.065973:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1787384392.065983:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04600/0x7ef423838fba2832 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2839 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384392.065993:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04600/0x7ef423838fba2832 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2839 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384392.066065:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787384392.066069:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98f8c896e000 from 48 10000000:01000000:2.0:1787384392.066072:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787384392.066098:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc200/0x7ef423838fba2840 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384392.066105:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc200/0x7ef423838fba2840 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384392.066114:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc200/0x7ef423838fba2840 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384392.066128:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203273472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787384392.066163:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384392.066220:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8e8ab96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384392.066251:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203273472 00000100:00100000:3.0:1787384392.066255:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203273472 00000100:00100000:3.0:1787384392.066314:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787384392.066322:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+21:6519:x1874208203273472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384392.066330:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384392.066341:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c2090a00/0x7ef423838fba2847 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba2840 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384392.066374:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c2090a00/0x7ef423838fba2847 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba2840 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384392.066384:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c2090a00/0x7ef423838fba2847 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2840 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384392.066392:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2090a00, rc 0) 00000100:00100000:3.0:1787384392.066647:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+22:6519:x1874208203273472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 209us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384392.066655:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1787384392.066735:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203273472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787384392.066747:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc200/0x7ef423838fba2840 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2847 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384392.066762:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc200/0x7ef423838fba2840 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2847 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384392.066906:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee254000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203273600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384392.066932:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384392.066949:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8293cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384392.067004:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203273600 00000100:00100000:3.0:1787384392.067008:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203273600 00000100:00100000:3.0:1787384392.067078:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787384392.067086:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+22:6519:x1874208203273600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384392.067195:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+22:6519:x1874208203273600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384392.067201:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1787384392.067251:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee254000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203273600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384392.067278:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee254000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203273728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787384392.067315:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384392.073999:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203273728 00000100:00100000:2.0:1787384392.074013:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203273728 00000100:00100000:2.0:1787384392.074094:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787384392.074103:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+22:6519:x1874208203273728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787384392.074246:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+22:6519:x1874208203273728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (6930us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384392.074254:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787384392.077697:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8293cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384392.077734:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee254000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203273728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787384392.078348:0:10366:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10366:1874208203273856:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384392.078417:0:10366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384392.078660:0:10366:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8e8ab96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384392.079035:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203273856 00000100:00100000:0.0:1787384392.079043:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203273856 00000100:00100000:0.0:1787384392.079125:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787384392.079136:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+22:10366:x1874208203273856:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787384392.079267:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+22:10366:x1874208203273856:12345-0@lo:502:llog_process_th.0 Request processed in 132us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384392.079276:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787384392.079349:0:10366:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10366:1874208203273856:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384392.079397:0:10366:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10366:1874208203273984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384392.079441:0:10366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384392.079710:0:10366:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3520480 going to sleep for 11 seconds 00000100:00100000:3.0:1787384392.079997:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203273984 00000100:00100000:3.0:1787384392.080002:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203273984 00000100:00100000:3.0:1787384392.080031:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787384392.080038:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+22:10366:x1874208203273984:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787384392.080128:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+22:10366:x1874208203273984:12345-0@lo:502:llog_process_th.0 Request processed in 89us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384392.080135:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787384392.080204:0:10366:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10366:1874208203273984:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787384392.080225:0:10366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787384392.080380:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1787384392.080399:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787384392.080414:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc200/0x7ef423838fba2840 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2847 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384392.080598:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc200/0x7ef423838fba2840 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2847 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384392.080610:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787384392.080613:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:3.0:1787384392.080616:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787384392.080641:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c2091200/0x7ef423838fba284e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384392.080649:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f7c2091200/0x7ef423838fba284e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384392.080658:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f7c2091200/0x7ef423838fba284e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384392.080673:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee31c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203274112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787384392.080706:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384392.080765:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3948840 going to sleep for 11 seconds 00000100:00100000:1.0:1787384392.082004:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203274112 00000100:00100000:1.0:1787384392.082015:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203274112 00000100:00100000:2.0:1787384392.082190:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1787384392.082202:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+22:6519:x1874208203274112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787384392.082215:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384392.082231:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8f58cd200/0x7ef423838fba2855 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba284e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384392.082257:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f58cd200/0x7ef423838fba2855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba284e expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384392.082268:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8f58cd200/0x7ef423838fba2855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba284e expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384392.082294:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cd200, rc 0) 00000100:00100000:2.0:1787384392.082361:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+23:6519:x1874208203274112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (1654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384392.082368:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787384392.082455:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee31c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203274112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787384392.082471:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f7c2091200/0x7ef423838fba284e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2855 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384392.082481:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f7c2091200/0x7ef423838fba284e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2855 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384392.082742:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee254000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203274240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384392.082921:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384392.083004:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8293cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384392.083037:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203274240 00000100:00100000:2.0:1787384392.083042:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203274240 00000100:00100000:2.0:1787384392.083104:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787384392.083111:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+23:6519:x1874208203274240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787384392.083229:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+23:6519:x1874208203274240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384392.083236:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787384392.083294:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee254000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203274240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384392.083318:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee31e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203274368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384392.083347:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384392.083409:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3948d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787384392.083464:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203274368 00000100:00100000:0.0:1787384392.083468:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203274368 00000100:00100000:0.0:1787384392.083490:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787384392.083495:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+23:6519:x1874208203274368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787384392.083868:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+23:6519:x1874208203274368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 371us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384392.083874:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787384392.084024:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee31e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203274368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384392.084320:0:10367:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee31e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10367:1874208203274496:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787384392.084362:0:10367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384392.084385:0:10367:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3948180 going to sleep for 11 seconds 00000100:00100000:0.0:1787384392.084484:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203274496 00000100:00100000:0.0:1787384392.084490:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203274496 00000100:00100000:0.0:1787384392.084635:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787384392.084644:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+23:10367:x1874208203274496:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787384392.084729:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+23:10367:x1874208203274496:12345-0@lo:502:llog_process_th.0 Request processed in 86us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384392.084736:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787384392.084828:0:10367:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee31e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10367:1874208203274496:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787384392.084849:0:10367:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787384392.084857:0:10367:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384392.084859:0:10367:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787384392.084864:0:10367:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787384392.084883:0:10367:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee31e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10367:1874208203274624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787384392.084914:0:10367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384392.084931:0:10367:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3948180 going to sleep for 11 seconds 00000100:00100000:0.0:1787384392.085043:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203274624 00000100:00100000:0.0:1787384392.085048:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203274624 00000100:00100000:0.0:1787384392.085065:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787384392.085071:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+23:10367:x1874208203274624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787384392.085142:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+23:10367:x1874208203274624:12345-0@lo:502:llog_process_th.0 Request processed in 70us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384392.085149:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787384392.085217:0:10367:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee31e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10367:1874208203274624:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787384392.085236:0:10367:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787384392.085240:0:10367:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384392.085241:0:10367:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787384392.085244:0:10367:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1787384392.085373:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1787384392.085391:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787384392.085399:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c2091200/0x7ef423838fba284e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2855 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384392.085409:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f7c2091200/0x7ef423838fba284e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2855 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384392.085418:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787384392.085421:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff98f8f96899c0 from 1 10000000:01000000:0.0:1787384392.085487:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787384392.085908:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04400/0x7ef423838fba285c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384392.085918:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04400/0x7ef423838fba285c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384392.085928:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04400/0x7ef423838fba285c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384392.085944:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee256300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203274752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787384392.085985:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384392.086009:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2b71f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787384392.087276:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203274752 00000100:00100000:2.0:1787384392.087285:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203274752 00000100:00100000:2.0:1787384392.087326:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1787384392.087334:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+23:6519:x1874208203274752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787384392.087345:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384392.087361:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8f58cc400/0x7ef423838fba2863 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba285c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384392.087383:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f58cc400/0x7ef423838fba2863 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba285c expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384392.087394:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8f58cc400/0x7ef423838fba2863 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba285c expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384392.087403:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cc400, rc 0) 00000100:00100000:2.0:1787384392.087478:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+24:6519:x1874208203274752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (1491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384392.087485:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787384392.088128:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee256300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203274752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787384392.088146:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04400/0x7ef423838fba285c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2863 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384392.088156:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04400/0x7ef423838fba285c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2863 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384392.088234:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee256300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203274880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384392.088269:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384392.088297:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2b71f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787384392.088370:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203274880 00000100:00100000:2.0:1787384392.088375:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203274880 00000100:00100000:2.0:1787384392.088396:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787384392.088402:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+24:6519:x1874208203274880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787384392.088725:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+24:6519:x1874208203274880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 320us (453us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787384392.088732:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1787384392.088946:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee256300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203274880:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1787384392.088982:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787384392.088989:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04400/0x7ef423838fba285c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2863 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384392.088997:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04400/0x7ef423838fba285c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2863 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1787384392.581561:0:10397:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffd8193f330 00000020:00000080:3.0:1787384392.581578:0:10397:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:3.0:1787384392.581583:0:10397:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:3.0:1787384392.581591:0:10397:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd819415c0 20000000:00000080:3.0:1787384392.581598:0:10397:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98f7c2b41c00 uarg=0000000000000000 20000000:01000000:3.0:1787384392.581641:0:10397:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787384392.581647:0:10397:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787384392.581652:0:10397:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787384392.582091:0:10398:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1787384392.582224:0:10397:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1787384392.590384:0:10397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1787384392.590424:0:10397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1787384392.590440:0:10397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1787384392.590455:0:10397:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787384392.590476:0:10397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98f7c2090400/0x7ef423838fba286a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384392.590583:0:10397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f8c0031000/0x7ef423838fba24b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba24ab expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384392.590593:0:10397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f902159e00/0x7ef423838fba2506 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba24ff expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384392.590601:0:10397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f902158e00/0x7ef423838fba2568 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2561 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384392.590608:0:10397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f7c2091e00/0x7ef423838fba268e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2687 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384392.590618:0:10397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f8f58cda00/0x7ef423838fba27a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce35e9 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384392.590626:0:10397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98f7c2090400/0x7ef423838fba286a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384392.590735:0:10397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f8f58cda00/0x7ef423838fba27a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce35e9 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384392.590752:0:10397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f8f58cda00/0x7ef423838fba27a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce35e9 expref: 9 pid: 6515 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384392.590768:0:10397:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee31e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1874208203275008:192.168.203.45@tcp:104: 00010000:00010000:3.0:1787384392.592213:0:10397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f7c2091e00/0x7ef423838fba268e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba2687 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384392.592227:0:10397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f7c2091e00/0x7ef423838fba268e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba2687 expref: 23 pid: 6515 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384392.592250:0:10397:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee31f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1874208203275136:0@lo:104: 00000100:00100000:3.0:1787384392.592303:0:10397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787384392.592337:0:10397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f902158e00/0x7ef423838fba2568 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba2561 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384392.592346:0:10397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f902158e00/0x7ef423838fba2568 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba2561 expref: 23 pid: 6515 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384392.592356:0:10397:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee31fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1874208203275264:0@lo:104: 00000100:00100000:3.0:1787384392.592382:0:10397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384392.592463:0:6506:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1787384392.592468:0:10397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f902159e00/0x7ef423838fba2506 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba24ff expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384392.592475:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203275136 00010000:00010000:3.0:1787384392.592476:0:10397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f902159e00/0x7ef423838fba2506 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba24ff expref: 23 pid: 6515 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384392.592481:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203275136 00000100:00100000:3.0:1787384392.592483:0:10397:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee31f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1874208203275392:0@lo:104: 00000100:00100000:3.0:1787384392.592516:0:10397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384392.592528:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203275264 00000100:00100000:1.0:1787384392.592531:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203275264 00010000:00010000:3.0:1787384392.592535:0:10397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f8c0031000/0x7ef423838fba24b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba24ab expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384392.592542:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203275392 00010000:00010000:3.0:1787384392.592544:0:10397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f8c0031000/0x7ef423838fba24b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba24ab expref: 23 pid: 6516 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384392.592544:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203275392 00000100:00100000:3.0:1787384392.592552:0:10397:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee31e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1874208203275520:0@lo:104: 00000100:00100000:1.0:1787384392.592556:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787384392.592563:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee31c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+5:10397:x1874208203275136:12345-0@lo:104: 00000100:00100000:3.0:1787384392.592571:0:10397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787384392.592575:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f8f5825e00/0x7ef423838fba2687 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba268e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384392.592580:0:10397:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d956c180 going to sleep for 11 seconds 00010000:00010000:1.0:1787384392.592632:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787384392.592637:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee31c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+5:10397:x1874208203275136:12345-0@lo:104: Request processed in 75us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384392.592644:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787384392.592659:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203275520 00000100:00100000:1.0:1787384392.592662:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203275520 00000100:00100000:1.0:1787384392.592676:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787384392.592681:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c405f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+5:10397:x1874208203275264:12345-0@lo:104: 00010000:00010000:1.0:1787384392.592689:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f8f5824200/0x7ef423838fba2561 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2568 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384392.592711:0:10397:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee31f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1874208203275136:0@lo:104: 00010000:00010000:1.0:1787384392.592718:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787384392.592722:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c405f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+5:10397:x1874208203275264:12345-0@lo:104: Request processed in 42us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384392.592727:0:10397:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee31fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1874208203275264:0@lo:104: 00000100:00100000:1.0:1787384392.592727:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787384392.592754:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787384392.592760:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee31d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+4:10397:x1874208203275392:12345-0@lo:104: 00010000:00010000:1.0:1787384392.592767:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f8cad38800/0x7ef423838fba24ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2506 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.592840:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787384392.592845:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee31d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+4:10397:x1874208203275392:12345-0@lo:104: Request processed in 86us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384392.592851:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787384392.592864:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787384392.592870:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee31ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+3:10397:x1874208203275520:12345-0@lo:104: 00010000:00010000:1.0:1787384392.592877:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f8c0030e00/0x7ef423838fba24ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba24b2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.592902:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787384392.592906:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee31ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+3:10397:x1874208203275520:12345-0@lo:104: Request processed in 37us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384392.592912:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1787384392.592928:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787384392.592933:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8f5825e00/0x7ef423838fba2687 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba268e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.592941:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5825e00 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:1.0:1787384392.592945:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8f5825e00/0x7ef423838fba2687 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba268e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.592953:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8f5825e00/0x7ef423838fba2687 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba268e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787384392.592969:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8f5825e00/0x7ef423838fba2687 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba268e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384392.592975:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787384392.593007:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8f5825e00/0x7ef423838fba2687 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba268e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.593013:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787384392.593031:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8f5825e00/0x7ef423838fba2687 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba268e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.593039:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8f5825e00/0x7ef423838fba2687 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba268e expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.593052:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787384392.593055:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8f5824200/0x7ef423838fba2561 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2568 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.593060:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5824200 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:1.0:1787384392.593063:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8f5824200/0x7ef423838fba2561 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba2568 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.593069:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8f5824200/0x7ef423838fba2561 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba2568 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787384392.593075:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8f5824200/0x7ef423838fba2561 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba2568 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384392.593080:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787384392.593098:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8f5824200/0x7ef423838fba2561 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2568 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.593104:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787384392.593110:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8f5824200/0x7ef423838fba2561 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2568 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.593126:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8f5824200/0x7ef423838fba2561 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2568 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.593134:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787384392.593137:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8cad38800/0x7ef423838fba24ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2506 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.593142:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8cad38800 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:1.0:1787384392.593144:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8cad38800/0x7ef423838fba24ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba2506 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.593151:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8cad38800/0x7ef423838fba24ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba2506 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787384392.593157:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8cad38800/0x7ef423838fba24ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba2506 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384392.593161:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787384392.593174:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8cad38800/0x7ef423838fba24ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2506 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.593179:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787384392.593193:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8cad38800/0x7ef423838fba24ff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2506 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.593199:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8cad38800/0x7ef423838fba24ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2506 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.593206:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384392.593214:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8c0030e00/0x7ef423838fba24ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba24b2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.593219:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c0030e00 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:1.0:1787384392.593222:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8c0030e00/0x7ef423838fba24ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba24b2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.593228:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8c0030e00/0x7ef423838fba24ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba24b2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787384392.593234:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8c0030e00/0x7ef423838fba24ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba24b2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384392.593239:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787384392.593250:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8c0030e00/0x7ef423838fba24ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba24b2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.593255:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787384392.593260:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8c0030e00/0x7ef423838fba24ab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba24b2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.593266:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8c0030e00/0x7ef423838fba24ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba24b2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.593279:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384392.593281:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384392.593282:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384392.593290:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384392.593316:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4032d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203275648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384392.593343:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384392.593372:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787384392.593385:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4031880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203275776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384392.593405:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384392.593429:0:10397:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee31f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1874208203275392:0@lo:104: 00000100:00100000:1.0:1787384392.593429:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4030380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203275904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787384392.593437:0:10397:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee31e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1874208203275520:0@lo:104: 00000100:00100000:1.0:1787384392.593449:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384392.593467:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787384392.593470:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203275648 00000100:00100000:1.0:1787384392.593472:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4033480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203276032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787384392.593474:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203275648 00010000:00010000:3.0:1787384392.593492:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f7c2091e00/0x7ef423838fba268e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba2687 expref: 24 pid: 6515 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384392.593493:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384392.593516:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203275776 00000100:00100000:3.0:1787384392.593518:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203275904 00000100:00100000:1.0:1787384392.593519:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203275776 00000100:00100000:3.0:1787384392.593520:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203275904 00010000:00010000:3.0:1787384392.593531:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f902159e00/0x7ef423838fba2506 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba24ff expref: 26 pid: 6515 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.593532:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f902158e00/0x7ef423838fba2568 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba2561 expref: 26 pid: 6515 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384392.593541:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203276032 00000100:00100000:3.0:1787384392.593543:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203276032 00010000:00010000:3.0:1787384392.593552:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f8c0031000/0x7ef423838fba24b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba24ab expref: 27 pid: 6516 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384392.593556:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787384392.593562:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4030700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ca80b7f5-0e34-441a-981f-ebff717028c4+27:3653:x1874208203275648:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787384392.593564:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787384392.593569:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4032a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+27:3651:x1874208203275904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787384392.593572:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384392.593574:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384392.593578:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f902159e00/0x7ef423838fba2506 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba24ff expref: 27 pid: 6515 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.593578:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f7c2091e00/0x7ef423838fba268e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba2687 expref: 27 pid: 6515 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384392.593588:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f902159e00/0x7ef423838fba2506 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba24ff expref: 27 pid: 6515 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384392.593652:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384392.593667:0:6507:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1787384392.593674:0:6507:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:0.0:1787384392.593766:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787384392.593772:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4033100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+27:3653:x1874208203275776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787384392.593795:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384392.593800:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f902158e00/0x7ef423838fba2568 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba2561 expref: 27 pid: 6515 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.593840:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f7c2091e00/0x7ef423838fba268e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba2687 expref: 27 pid: 6515 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.593854:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c2091e00/0x7ef423838fba268e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba2687 expref: 27 pid: 6515 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.593866:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384392.593897:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4030700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ca80b7f5-0e34-441a-981f-ebff717028c4+26:3653:x1874208203275648:12345-0@lo:103:ldlm_bl.0 Request processed in 335us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384392.593904:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787384392.593919:0:8463:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1787384392.593932:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787384392.593938:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b46450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ca80b7f5-0e34-441a-981f-ebff717028c4+25:3651:x1874208203276032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787384392.593945:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384392.593949:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f8c0031000/0x7ef423838fba24b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba24ab expref: 25 pid: 6516 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.593957:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f8c0031000/0x7ef423838fba24b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba24ab expref: 25 pid: 6516 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.593978:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8c0031000/0x7ef423838fba24b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba24ab expref: 25 pid: 6516 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.593987:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384392.594013:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b46450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3651:x1874208203276032:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384392.594019:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787384392.594051:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4033480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203276032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384392.594073:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4032d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203275648:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787384392.595494:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f902159e00/0x7ef423838fba2506 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba24ff expref: 23 pid: 6515 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384392.595601:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384392.595726:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4032a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+22:3651:x1874208203275904:12345-0@lo:103:ldlm_bl.0 Request processed in 2155us (2274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384392.595735:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1787384392.596373:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f902158e00/0x7ef423838fba2568 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba2561 expref: 21 pid: 6515 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384392.596389:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f902158e00/0x7ef423838fba2568 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba2561 expref: 21 pid: 6515 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384392.596400:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384392.596499:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4033100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+20:3653:x1874208203275776:12345-0@lo:103:ldlm_bl.0 Request processed in 2726us (3091us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384392.596515:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787384392.597066:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4031880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203275776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384392.598627:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4030380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203275904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787384392.598978:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384392.599224:0:10397:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee31e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1874208203275008:192.168.203.45@tcp:104: 00010000:00010000:0.0:1787384392.599262:0:10397:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98f7c2090400/0x7ef423838fba286a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384392.600709:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182245632 00000100:00100000:1.0:1787384392.600720:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182245632 00010000:00010000:1.0:1787384392.600760:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f8f58cda00/0x7ef423838fba27a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce35e9 expref: 10 pid: 6515 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384392.600819:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 39 00000100:00100000:1.0:1787384392.600829:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee31d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09777221-fe6d-4549-9ee6-04300d230fb6+10:2415:x1874208182245632:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384392.600844:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384392.600862:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f8f58cda00/0x7ef423838fba27a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce35e9 expref: 10 pid: 6515 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.600875:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f8f58cda00/0x7ef423838fba27a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce35e9 expref: 10 pid: 6515 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.600893:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f58cda00/0x7ef423838fba27a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce35e9 expref: 10 pid: 6515 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.600909:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98f7c2090400/0x7ef423838fba286a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.600917:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c2090400/0x7ef423838fba286a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.600932:0:8463:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f7c2090400/0x7ef423838fba286a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.600938:0:8463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f7c2090400/0x7ef423838fba286a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.600945:0:8463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98f7c2090400/0x7ef423838fba286a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.600951:0:8463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98f7c2090400/0x7ef423838fba286a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.601024:0:8463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2090400 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384392.601030:0:8463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98f7c2090400/0x7ef423838fba286a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.601038:0:8463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98f7c2090400/0x7ef423838fba286a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.601064:0:8463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98f7c2090400/0x7ef423838fba286a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.601076:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384392.601131:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee31d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09777221-fe6d-4549-9ee6-04300d230fb6+9:2415:x1874208182245632:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 303us (2155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384392.601139:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 39 00010000:00010000:0.0:1787384392.601172:0:10397:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98f7c2090400/0x7ef423838fba286a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384392.601182:0:10397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98f7c2090400/0x7ef423838fba286a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384392.601189:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c2090400/0x7ef423838fba286a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384392.643941:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384393.145427:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee31c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203276288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787384393.145500:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384393.145571:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787384393.145579:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203276160:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787384393.145603:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384393.145818:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203276288 00000100:00100000:1.0:1787384393.145825:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203276288 00000100:00100000:1.0:1787384393.145879:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203276160 00000100:00100000:1.0:1787384393.145882:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203276160 00000100:00100000:1.0:1787384393.145905:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787384393.145913:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203276288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787384393.145953:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787384393.146012:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203276288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384393.146020:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787384393.146037:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787384393.146043:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203276160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787384393.146053:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787384393.146087:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203276160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384393.146094:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1787384393.146145:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3a6f800 x1874208203276160/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384409 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384393.146183:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203276160:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1787384393.146196:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee31c380 x1874208203276288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384409 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384393.146207:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee31c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203276288:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787384393.146913:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787384393.660811:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4030380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203276416:0@lo:400:kworker.0 00000100:00100000:1.0:1787384393.660884:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384393.660933:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4031880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203276928:0@lo:400:kworker.0 00000100:00100000:1.0:1787384393.660973:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384393.660995:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4032300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203277440:0@lo:400:kworker.0 00000100:00100000:1.0:1787384393.661019:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384393.661046:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787384393.661052:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4032d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203276544:0@lo:400:kworker.0 00000100:00100000:1.0:1787384393.661072:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384393.661089:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4030700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203277056:0@lo:400:kworker.0 00000100:00100000:1.0:1787384393.661109:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384393.661125:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203277568:0@lo:400:kworker.0 00000100:00100000:1.0:1787384393.661145:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384393.661171:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4033480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203276672:0@lo:400:kworker.0 00000100:00100000:1.0:1787384393.661207:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384393.661224:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4032a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203277184:0@lo:400:kworker.0 00000100:00100000:1.0:1787384393.661243:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384393.661259:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4033b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203277696:0@lo:400:kworker.0 00000100:00100000:1.0:1787384393.661297:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384393.661317:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787384393.661323:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4031f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874208203276800:0@lo:400:kworker.0 00000100:00100000:1.0:1787384393.661343:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384393.661354:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203277312:0@lo:400:kworker.0 00000100:00100000:1.0:1787384393.661370:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384393.661396:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203276928 00000100:00100000:1.0:1787384393.661402:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203276928 00000100:00100000:1.0:1787384393.661441:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203276672 00000100:00100000:1.0:1787384393.661444:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203276672 00000100:00100000:1.0:1787384393.661459:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787384393.661466:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4032680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203276928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384393.661668:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4032680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203276928:12345-0@lo:400:kworker.0 Request processed in 201us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384393.661676:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787384393.661695:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787384393.661700:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4031180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203276672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384393.661732:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4031180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203276672:12345-0@lo:400:kworker.0 Request processed in 31us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384393.661738:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787384393.661755:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203277440 00000100:00100000:1.0:1787384393.661759:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203277440 00000100:00100000:1.0:1787384393.661804:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203276544 00000100:00100000:1.0:1787384393.661808:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203276544 00000100:00100000:1.0:1787384393.661819:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203277056 00000100:00100000:1.0:1787384393.661820:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203277056 00000100:00100000:1.0:1787384393.661833:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203277184 00000100:00100000:1.0:1787384393.661835:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203277184 00000100:00100000:1.0:1787384393.661856:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203276800 00000100:00100000:1.0:1787384393.661858:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203276800 00000100:00100000:1.0:1787384393.661869:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203277312 00000100:00100000:1.0:1787384393.661871:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203277312 00000100:00100000:1.0:1787384393.661885:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787384393.661890:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4031500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874208203277440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384393.661922:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4031500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874208203277440:12345-0@lo:400:kworker.0 Request processed in 31us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384393.661929:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787384393.661940:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787384393.661946:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4033800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203276544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384393.661982:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4033800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203276544:12345-0@lo:400:kworker.0 Request processed in 35us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384393.661988:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787384393.661999:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787384393.662005:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4030e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203277056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384393.662031:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4030e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203277056:12345-0@lo:400:kworker.0 Request processed in 26us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384393.662037:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787384393.662048:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787384393.662054:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4030a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203277184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384393.662079:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4030a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203277184:12345-0@lo:400:kworker.0 Request processed in 26us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384393.662085:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787384393.662096:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787384393.662101:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874208203276800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384393.662139:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874208203276800:12345-0@lo:400:kworker.0 Request processed in 38us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384393.662144:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787384393.662157:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787384393.662163:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874208203277312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384393.663673:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203276416 00000100:00100000:2.0:1787384393.663683:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203276416 00000100:00100000:2.0:1787384393.663728:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1787384393.663735:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+20:3651:x1874208203276416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384393.663844:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+20:3651:x1874208203276416:12345-0@lo:400:kworker.0 Request processed in 108us (2959us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384393.663852:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1787384393.664028:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203277568 00000100:00100000:2.0:1787384393.664033:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203277568 00000100:00100000:2.0:1787384393.664059:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203277696 00000100:00100000:2.0:1787384393.664062:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203277696 00000100:00100000:2.0:1787384393.664082:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787384393.664088:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4031c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203277568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384393.664121:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4031c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203277568:12345-0@lo:400:kworker.0 Request processed in 34us (2975us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384393.664142:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787384393.664155:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787384393.664161:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203277696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384393.664191:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203277696:12345-0@lo:400:kworker.0 Request processed in 30us (2893us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384393.664196:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787384393.664412:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874208203277312:12345-0@lo:400:kworker.0 Request processed in 2247us (3038us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384393.664420:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787384393.664473:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4032d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203276544:0@lo:400:kworker.0 00000100:00100000:1.0:1787384393.664488:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4030700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203277056:0@lo:400:kworker.0 00010000:00080000:1.0:1787384393.664650:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4030000 x1874208203277568/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384393.664662:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203277568:0@lo:400:kworker.0 00000100:00100000:1.0:1787384393.664676:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4030380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203276416:0@lo:400:kworker.0 00000100:00100000:1.0:1787384393.664687:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4031880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203276928:0@lo:400:kworker.0 00010000:00080000:1.0:1787384393.664698:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4032300 x1874208203277440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384393.664705:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4032300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203277440:0@lo:400:kworker.0 00000100:00100000:1.0:1787384393.664749:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4031f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874208203276800:0@lo:400:kworker.0 00000100:00100000:1.0:1787384393.664759:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203277312:0@lo:400:kworker.0 00000100:00100000:1.0:1787384393.664770:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4033480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203276672:0@lo:400:kworker.0 00010000:00080000:1.0:1787384393.664812:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4032a00 x1874208203277184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384393.664821:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4032a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203277184:0@lo:400:kworker.0 00010000:00080000:1.0:1787384393.664832:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4033b80 x1874208203277696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384393.664840:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4033b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203277696:0@lo:400:kworker.0 00000100:00100000:1.0:1787384393.664856:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787384393.664865:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203277824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787384393.664896:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787384393.666860:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787384393.666868:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787384393.666871:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787384393.668846:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384393.677214:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203277824 00000100:00100000:2.0:1787384393.677227:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203277824 00000100:00100000:2.0:1787384393.677292:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787384393.677303:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203277824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787384393.677335:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384393.677414:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203277824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (12516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384393.677421:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1787384393.677472:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3a6fb80 x1874208203277824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384409 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384393.677492:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203277824:0@lo:13:osp-pre-1-0.0 10000000:01000000:2.0:1787384393.723281:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787384393.723288:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98f8f7d47800 from 4 10000000:01000000:2.0:1787384393.723292:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787384393.723341:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba2871 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384393.723353:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba2871 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384393.723364:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba2871 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384393.723401:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203277952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787384393.723462:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384393.723513:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3520000 going to sleep for 11 seconds 00000100:00100000:3.0:1787384393.723600:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203277952 00000100:00100000:3.0:1787384393.723609:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203277952 00000100:00100000:3.0:1787384393.723663:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1787384393.723673:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+20:6519:x1874208203277952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384393.723686:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384393.723701:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c2091800/0x7ef423838fba2878 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba2871 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384393.723724:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c2091800/0x7ef423838fba2878 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba2871 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384393.723734:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c2091800/0x7ef423838fba2878 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2871 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384393.723742:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2091800, rc 0) 00000100:00100000:3.0:1787384393.723812:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+21:6519:x1874208203277952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384393.723819:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1787384393.723906:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203277952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787384393.723920:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba2871 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2878 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384393.723930:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba2871 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2878 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384393.724002:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4033b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203278080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787384393.724032:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384393.724062:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c356bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787384393.724326:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203278080 00000100:00100000:2.0:1787384393.724331:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203278080 00000100:00100000:2.0:1787384393.724367:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1787384393.724374:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+21:6519:x1874208203278080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787384393.724488:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+21:6519:x1874208203278080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384393.724495:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1787384393.724605:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4033b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203278080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787384393.724637:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4033b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203278208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787384393.724677:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384393.724701:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c356bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787384393.724742:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203278208 00000100:00100000:3.0:1787384393.724746:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203278208 00000100:00100000:3.0:1787384393.724810:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1787384393.724818:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d25f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+21:6519:x1874208203278208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384393.724911:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d25f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+21:6519:x1874208203278208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384393.724919:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1787384393.725150:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4033b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203278208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384393.726843:0:10429:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee31f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10429:1874208203278336:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384393.726997:0:10429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384393.727037:0:10429:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7ea7600 going to sleep for 11 seconds 00000100:00100000:0.0:1787384393.727108:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203278336 00000100:00100000:0.0:1787384393.727115:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203278336 00000100:00100000:0.0:1787384393.727163:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1787384393.727172:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d945a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+21:10429:x1874208203278336:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787384393.727297:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d945a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+21:10429:x1874208203278336:12345-0@lo:502:llog_process_th.0 Request processed in 125us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384393.727304:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1787384393.727628:0:10429:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee31f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10429:1874208203278336:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787384393.727655:0:10429:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787384393.727666:0:10429:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384393.727668:0:10429:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787384393.727676:0:10429:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f8f7d47800 00000020:00000080:3.0:1787384393.727679:0:10429:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787384393.727756:0:10429:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee31f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10429:1874208203278464:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787384393.727894:0:10429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384393.727925:0:10429:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7ea7600 going to sleep for 11 seconds 00000100:00100000:1.0:1787384393.727979:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203278464 00000100:00100000:1.0:1787384393.727984:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203278464 00000100:00100000:1.0:1787384393.728019:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1787384393.728027:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9458c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+21:10429:x1874208203278464:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787384393.728126:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9458c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+21:10429:x1874208203278464:12345-0@lo:502:llog_process_th.0 Request processed in 100us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384393.728133:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1787384393.728235:0:10429:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee31f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10429:1874208203278464:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787384393.728254:0:10429:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787384393.728258:0:10429:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384393.728259:0:10429:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787384393.728263:0:10429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787384393.728411:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787384393.728434:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787384393.728444:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba2871 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2878 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384393.728455:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba2871 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2878 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384393.728464:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787384393.728467:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98f8f5669000 from 4 10000000:01000000:1.0:1787384393.728470:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787384393.728492:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3952200/0x7ef423838fba287f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384393.728510:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f7c3952200/0x7ef423838fba287f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384393.728518:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f7c3952200/0x7ef423838fba287f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384393.728532:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4033b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203278592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787384393.728562:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384393.728594:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c356bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787384393.728641:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203278592 00000100:00100000:2.0:1787384393.728646:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203278592 00000100:00100000:2.0:1787384393.728677:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787384393.728684:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d945bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+21:6519:x1874208203278592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787384393.728692:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384393.728704:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8f58cd800/0x7ef423838fba2886 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba287f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384393.728725:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f58cd800/0x7ef423838fba2886 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba287f expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384393.728735:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8f58cd800/0x7ef423838fba2886 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba287f expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384393.728743:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cd800, rc 0) 00000100:00100000:2.0:1787384393.728806:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d945bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+22:6519:x1874208203278592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384393.728812:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1787384393.729005:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4033b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203278592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384393.729017:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f7c3952200/0x7ef423838fba287f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2886 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384393.729025:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f7c3952200/0x7ef423838fba287f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2886 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384393.729076:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee31f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203278720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384393.729108:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384393.729136:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7ea7600 going to sleep for 11 seconds 00000100:00100000:2.0:1787384393.729176:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203278720 00000100:00100000:2.0:1787384393.729180:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203278720 00000100:00100000:2.0:1787384393.729210:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1787384393.729217:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d945ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+22:6519:x1874208203278720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787384393.729305:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d945ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+22:6519:x1874208203278720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 89us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384393.729312:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787384393.729380:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee31f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203278720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787384393.729408:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4032a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203278848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787384393.729442:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384393.729465:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c356bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787384393.729515:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203278848 00000100:00100000:2.0:1787384393.729520:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203278848 00000100:00100000:2.0:1787384393.729551:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1787384393.729558:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+22:6519:x1874208203278848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787384393.729630:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+22:6519:x1874208203278848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384393.729636:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1787384393.729674:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4032a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203278848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787384393.729869:0:10430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10430:1874208203278976:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384393.729901:0:10430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384393.729920:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203278976 00000100:00100000:2.0:1787384393.729924:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203278976 00000100:00100000:2.0:1787384393.729941:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787384393.729947:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+22:10430:x1874208203278976:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384393.730017:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+22:10430:x1874208203278976:12345-0@lo:502:llog_process_th.0 Request processed in 69us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384393.730029:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787384393.730055:0:10430:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c35206c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384393.730067:0:10430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10430:1874208203278976:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787384393.730088:0:10430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787384393.730096:0:10430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384393.730098:0:10430:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787384393.730103:0:10430:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f8f5669000 00000020:00000080:2.0:1787384393.730105:0:10430:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787384393.730166:0:10430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10430:1874208203279104:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384393.730197:0:10430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384393.730215:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203279104 00000100:00100000:2.0:1787384393.730218:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203279104 00000100:00100000:2.0:1787384393.730236:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787384393.730242:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+22:10430:x1874208203279104:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384393.730297:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+22:10430:x1874208203279104:12345-0@lo:502:llog_process_th.0 Request processed in 55us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384393.730304:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787384393.730331:0:10430:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c35206c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384393.730344:0:10430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10430:1874208203279104:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787384393.730363:0:10430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384393.730367:0:10430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384393.730369:0:10430:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787384393.730372:0:10430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787384393.730414:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787384393.730428:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787384393.730434:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3952200/0x7ef423838fba287f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2886 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384393.730449:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f7c3952200/0x7ef423838fba287f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2886 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384393.730458:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787384393.730460:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98f8f5698000 from 4 10000000:01000000:2.0:1787384393.730463:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787384393.730481:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc800/0x7ef423838fba288d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384393.730489:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc800/0x7ef423838fba288d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384393.730497:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc800/0x7ef423838fba288d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384393.730509:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203279232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787384393.730536:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384393.730548:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c35206c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384393.730558:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203279232 00000100:00100000:2.0:1787384393.730560:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203279232 00000100:00100000:2.0:1787384393.730574:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1787384393.730579:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+22:6519:x1874208203279232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787384393.730586:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384393.730596:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8f58cc000/0x7ef423838fba2894 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba288d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384393.730613:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f58cc000/0x7ef423838fba2894 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba288d expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384393.730633:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8f58cc000/0x7ef423838fba2894 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba288d expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384393.730641:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cc000, rc 0) 00000100:00100000:2.0:1787384393.730667:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+23:6519:x1874208203279232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384393.730674:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1787384393.730699:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203279232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787384393.730710:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc800/0x7ef423838fba288d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2894 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384393.730718:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc800/0x7ef423838fba288d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2894 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384393.730754:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203279360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787384393.730799:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384393.730812:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c35206c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384393.730822:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203279360 00000100:00100000:2.0:1787384393.730826:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203279360 00000100:00100000:2.0:1787384393.730842:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787384393.730848:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+23:6519:x1874208203279360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787384393.730919:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+23:6519:x1874208203279360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 71us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384393.730924:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787384393.730948:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203279360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787384393.730999:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203279488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787384393.731032:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384393.731044:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c35206c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384393.731055:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203279488 00000100:00100000:2.0:1787384393.731058:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203279488 00000100:00100000:2.0:1787384393.731075:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787384393.731081:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+23:6519:x1874208203279488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787384393.731140:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+23:6519:x1874208203279488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 58us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384393.731146:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787384393.731182:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203279488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787384393.745546:0:10431:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4033480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10431:1874208203279616:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787384393.745625:0:10431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384393.745670:0:10431:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c356bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787384393.747677:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203279616 00000100:00100000:3.0:1787384393.747691:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203279616 00000100:00100000:3.0:1787384393.747749:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787384393.747759:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+23:10431:x1874208203279616:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787384393.747928:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+23:10431:x1874208203279616:12345-0@lo:502:llog_process_th.0 Request processed in 169us (2301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384393.747935:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787384393.748053:0:10431:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4033480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10431:1874208203279616:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787384393.748087:0:10431:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787384393.748098:0:10431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384393.748101:0:10431:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787384393.748108:0:10431:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f8f5698000 00000020:00000080:1.0:1787384393.748111:0:10431:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787384393.748332:0:10431:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4033480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10431:1874208203279744:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787384393.748378:0:10431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384393.748410:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203279744 00000100:00100000:1.0:1787384393.748414:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203279744 00000100:00100000:1.0:1787384393.748441:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787384393.748448:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+23:10431:x1874208203279744:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787384393.748599:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+23:10431:x1874208203279744:12345-0@lo:502:llog_process_th.0 Request processed in 151us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384393.748605:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787384393.748644:0:10431:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c356bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787384393.748658:0:10431:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4033480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10431:1874208203279744:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787384393.748677:0:10431:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384393.748686:0:10431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384393.748687:0:10431:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787384393.748691:0:10431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787384393.752643:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787384393.752674:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787384393.752684:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc800/0x7ef423838fba288d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2894 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384393.752698:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc800/0x7ef423838fba288d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2894 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384393.752707:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787384393.752710:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98f8c896e000 from 4 10000000:01000000:2.0:1787384393.752712:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787384393.752744:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cce00/0x7ef423838fba289b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384393.752753:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8f58cce00/0x7ef423838fba289b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384393.752774:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8f58cce00/0x7ef423838fba289b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384393.752821:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203279872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787384393.752878:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384393.752912:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c35206c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384393.753141:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203279872 00000100:00100000:3.0:1787384393.753148:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203279872 00000100:00100000:3.0:1787384393.753191:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787384393.753199:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+23:6519:x1874208203279872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384393.753211:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384393.753222:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c2090200/0x7ef423838fba28a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba289b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384393.753244:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c2090200/0x7ef423838fba28a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba289b expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384393.753254:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c2090200/0x7ef423838fba28a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba289b expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384393.753262:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2090200, rc 0) 00000100:00100000:3.0:1787384393.753304:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+24:6519:x1874208203279872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384393.753310:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787384393.753443:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203279872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787384393.753457:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8f58cce00/0x7ef423838fba289b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba28a2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384393.753465:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8f58cce00/0x7ef423838fba289b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba28a2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384393.754668:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203280000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787384393.754715:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384393.754747:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c35206c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384393.754854:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203280000 00000100:00100000:1.0:1787384393.754860:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203280000 00000100:00100000:1.0:1787384393.754896:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787384393.754905:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:6519:x1874208203280000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787384393.755038:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:6519:x1874208203280000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384393.755045:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787384393.755661:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203280000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787384393.755699:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203280128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787384393.755742:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384393.755772:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c35206c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384393.755883:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203280128 00000100:00100000:1.0:1787384393.755889:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203280128 00000100:00100000:1.0:1787384393.755925:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787384393.755932:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+24:6519:x1874208203280128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787384393.756024:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+24:6519:x1874208203280128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384393.756031:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787384393.756454:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203280128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787384393.766345:0:10434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10434:1874208203280256:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384393.766426:0:10434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384393.766461:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203280256 00000100:00100000:2.0:1787384393.766474:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203280256 00000100:00100000:2.0:1787384393.766525:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787384393.766534:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+24:10434:x1874208203280256:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384393.766639:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+24:10434:x1874208203280256:12345-0@lo:502:llog_process_th.0 Request processed in 105us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384393.766647:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787384393.766691:0:10434:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c35209c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384393.766711:0:10434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10434:1874208203280256:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787384393.766737:0:10434:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787384393.766746:0:10434:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384393.766748:0:10434:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787384393.766754:0:10434:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f8c896e000 00000020:00000080:2.0:1787384393.766757:0:10434:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787384393.767200:0:10434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10434:1874208203280384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384393.767240:0:10434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384393.767264:0:10434:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3520f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787384393.771170:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203280384 00000100:00100000:2.0:1787384393.771357:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203280384 00000100:00100000:2.0:1787384393.771420:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787384393.771429:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:10434:x1874208203280384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384393.771606:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:10434:x1874208203280384:12345-0@lo:502:llog_process_th.0 Request processed in 177us (4363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384393.771617:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787384393.771682:0:10434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:10434:1874208203280384:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787384393.771713:0:10434:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384393.771721:0:10434:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384393.771729:0:10434:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787384393.771733:0:10434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787384393.771816:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787384393.772086:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787384393.772101:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cce00/0x7ef423838fba289b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba28a2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384393.772170:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8f58cce00/0x7ef423838fba289b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba28a2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384394.146214:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384394.146304:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182245760 00000100:00100000:2.0:1787384394.146313:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182245760 00000100:00100000:2.0:1787384394.146371:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 269 00000100:00100000:2.0:1787384394.146380:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+9:6186:x1874208182245760:12345-192.168.203.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787384394.146397:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384394.146414:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8f58cda00/0x7ef423838fba28a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce362f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384394.146441:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f58cda00/0x7ef423838fba28a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce362f expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384394.146453:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8f58cda00/0x7ef423838fba28a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce362f expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384394.146462:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cda00, rc 0) 00000100:00100000:2.0:1787384394.146518:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+10:6186:x1874208182245760:12345-192.168.203.45@tcp:101:ll_cfg_requeue.0 Request processed in 138us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384394.146524:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 269 00000100:00100000:2.0:1787384394.151651:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384394.151728:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182245888 00000100:00100000:3.0:1787384394.151737:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182245888 00000100:00100000:3.0:1787384394.151805:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 270 00000100:00100000:3.0:1787384394.151816:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+10:6186:x1874208182245888:12345-192.168.203.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384394.151985:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+10:6186:x1874208182245888:12345-192.168.203.45@tcp:501:ll_cfg_requeue.0 Request processed in 171us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384394.151994:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 270 00000100:00100000:1.0:1787384394.164081:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384394.164167:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182246016 00000100:00100000:3.0:1787384394.164177:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182246016 00000100:00100000:3.0:1787384394.164235:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 271 00000100:00100000:3.0:1787384394.164245:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+10:6186:x1874208182246016:12345-192.168.203.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384394.164378:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+10:6186:x1874208182246016:12345-192.168.203.45@tcp:503:ll_cfg_requeue.0 Request processed in 134us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384394.164385:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 271 00000100:00100000:1.0:1787384394.167892:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4033480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203280512:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787384394.167974:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384394.168056:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203280512 00000100:00100000:1.0:1787384394.168063:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203280512 00000100:00100000:1.0:1787384394.168111:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787384394.168119:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203280512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787384394.168140:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787384394.168181:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203280512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384394.168198:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1787384394.168240:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4033480 x1874208203280512/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384394.168257:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4033480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203280512:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787384394.180971:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384394.185332:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182246144 00000100:00100000:3.0:1787384394.185346:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182246144 00000100:00100000:3.0:1787384394.185408:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 272 00000100:00100000:3.0:1787384394.185416:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+10:6724:x1874208182246144:12345-192.168.203.45@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787384394.185561:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+10:6724:x1874208182246144:12345-192.168.203.45@tcp:502:llog_process_th.0 Request processed in 144us (4596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384394.185568:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 272 00000100:00100000:3.0:1787384394.195385:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384394.195422:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182246272 00000100:00100000:3.0:1787384394.195431:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182246272 00000100:00100000:3.0:1787384394.195474:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 273 00000100:00100000:3.0:1787384394.195482:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+10:6724:x1874208182246272:12345-192.168.203.45@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787384394.195618:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+10:6724:x1874208182246272:12345-192.168.203.45@tcp:502:llog_process_th.0 Request processed in 135us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384394.195626:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 273 00010000:00010000:0.0:1787384394.679425:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384395.704215:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787384395.704239:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4033480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203280640:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787384395.704314:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384395.704430:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203280640 00000100:00100000:1.0:1787384395.704438:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203280640 00000100:00100000:1.0:1787384395.704489:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787384395.704498:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee31c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203280640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787384395.704531:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787384395.704584:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee31c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203280640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384395.704591:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787384395.704634:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4033480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203280640:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787384395.711799:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384396.131111:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384396.131152:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384396.131183:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384396.131211:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384396.131228:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384396.131287:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182246400 00000100:00100000:3.0:1787384396.131296:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182246400 00000100:00100000:3.0:1787384396.131346:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 274 00000100:00100000:3.0:1787384396.131354:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+10:2416:x1874208182246400:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384396.131418:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+10:2416:x1874208182246400:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 64us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384396.131424:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 274 00000100:00100000:2.0:1787384396.131894:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182246656 00000100:00100000:2.0:1787384396.131900:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182246656 00000100:00100000:2.0:1787384396.131957:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182246528 00000100:00100000:2.0:1787384396.131961:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182246528 00000100:00100000:2.0:1787384396.131984:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 71 00000100:00100000:2.0:1787384396.131992:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2416:x1874208182246656:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384396.132035:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2416:x1874208182246656:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 44us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384396.132043:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 71 00000100:00100000:2.0:1787384396.132055:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 72 00000100:00080000:3.0:1787384396.132177:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787384396.132182:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787384396.132206:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182246912 00000100:00100000:3.0:1787384396.132210:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182246912 00000100:00100000:3.0:1787384396.132239:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182246784 00000100:00100000:3.0:1787384396.132242:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182246784 00000100:00100000:3.0:1787384396.132263:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 24 00000100:00100000:3.0:1787384396.132269:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4031f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2416:x1874208182246912:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384396.132298:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4031f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2416:x1874208182246912:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 29us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384396.132305:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 24 00000100:00100000:3.0:1787384396.132319:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 25 00000100:00100000:3.0:1787384396.132325:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4031880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2416:x1874208182246784:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384396.132362:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4031880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2416:x1874208182246784:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 37us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384396.132370:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 25 00000100:00080000:3.0:1787384396.132388:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787384396.132391:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787384396.132448:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4032300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2416:x1874208182246528:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384396.132477:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4032300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2416:x1874208182246528:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 33us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384396.132484:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 72 00000100:00100000:0.0:1787384396.215071:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787384396.215093:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee31f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203280768:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787384396.215161:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384396.215323:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203280768 00000100:00100000:3.0:1787384396.215332:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203280768 00000100:00100000:3.0:1787384396.215383:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787384396.215393:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203280768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787384396.215425:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787384396.215469:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203280768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384396.215476:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787384396.215932:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee31f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203280768:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787384396.727069:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384397.751202:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384398.272841:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787384398.272863:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee31c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203280896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787384398.272943:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384398.273003:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787384398.273013:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203281024:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787384398.273038:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384398.273072:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203280896 00000100:00100000:2.0:1787384398.273079:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203280896 00000100:00100000:2.0:1787384398.273125:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203281024 00000100:00100000:2.0:1787384398.273129:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203281024 00000100:00100000:2.0:1787384398.273150:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787384398.273159:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203280896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787384398.273187:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384398.273246:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203280896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384398.273254:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787384398.273271:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787384398.273277:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203281024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787384398.273286:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384398.273313:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203281024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384398.273319:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1787384398.273337:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787384398.273364:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee31c380 x1874208203280896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384398.273382:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee31c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203280896:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1787384398.273746:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3a6c000 x1874208203281024/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384398.273759:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203281024:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787384398.777185:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384398.777538:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4032d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203281536:0@lo:400:kworker.0 00000100:00100000:1.0:1787384398.777604:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384398.777660:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874208203282048:0@lo:400:kworker.0 00000100:00100000:1.0:1787384398.777681:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384398.777709:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787384398.777716:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4030380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203281152:0@lo:400:kworker.0 00000100:00100000:1.0:1787384398.777753:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384398.777800:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4032a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203281664:0@lo:400:kworker.0 00000100:00100000:1.0:1787384398.777826:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384398.777844:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203282176:0@lo:400:kworker.0 00000100:00100000:1.0:1787384398.777865:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384398.777891:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203281536 00000100:00100000:1.0:1787384398.777898:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203281536 00000100:00100000:1.0:1787384398.777949:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203282048 00000100:00100000:1.0:1787384398.777952:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203282048 00000100:00100000:1.0:1787384398.777975:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203282176 00000100:00100000:1.0:1787384398.777977:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203282176 00000100:00100000:1.0:1787384398.777993:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787384398.778000:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203281536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384398.778048:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203281536:12345-0@lo:400:kworker.0 Request processed in 48us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384398.778055:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787384398.778072:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787384398.778077:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874208203282048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384398.778104:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874208203282048:12345-0@lo:400:kworker.0 Request processed in 27us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384398.778110:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787384398.778121:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787384398.778127:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874208203282176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384398.778154:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874208203282176:12345-0@lo:400:kworker.0 Request processed in 27us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384398.778160:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787384398.778190:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203281664 00000100:00100000:1.0:1787384398.778193:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203281664 00000100:00100000:1.0:1787384398.778217:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787384398.778223:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203281664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384398.778255:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203281664:12345-0@lo:400:kworker.0 Request processed in 32us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384398.778260:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787384398.778301:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4032a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203281664:0@lo:400:kworker.0 00010000:00080000:1.0:1787384398.778313:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4183480 x1874208203282176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384398.778323:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203282176:0@lo:400:kworker.0 00000100:00100000:1.0:1787384398.778333:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4032d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203281536:0@lo:400:kworker.0 00000100:00100000:1.0:1787384398.778341:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874208203282048:0@lo:400:kworker.0 00000100:00100000:0.0:1787384398.778601:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4030700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203281408:0@lo:400:kworker.0 00000100:00100000:0.0:1787384398.778633:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384398.778659:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874208203281920:0@lo:400:kworker.0 00000100:00100000:0.0:1787384398.778681:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384398.778697:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203282432:0@lo:400:kworker.0 00000100:00100000:0.0:1787384398.778721:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384398.778740:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787384398.778747:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874208203281280:0@lo:400:kworker.0 00000100:00100000:0.0:1787384398.778767:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384398.778801:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4033b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874208203281792:0@lo:400:kworker.0 00000100:00100000:0.0:1787384398.778822:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384398.778838:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203282304:0@lo:400:kworker.0 00000100:00100000:0.0:1787384398.778858:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384398.778892:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203282432 00000100:00100000:0.0:1787384398.778896:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203282432 00000100:00100000:0.0:1787384398.778933:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203282304 00000100:00100000:0.0:1787384398.778937:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203282304 00000100:00100000:0.0:1787384398.778958:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787384398.778964:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203282432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384398.779000:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203282432:12345-0@lo:400:kworker.0 Request processed in 36us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384398.779007:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787384398.779020:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787384398.779027:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee255880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203282304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384398.779054:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee255880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203282304:12345-0@lo:400:kworker.0 Request processed in 28us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384398.779060:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1787384398.779094:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4180700 x1874208203282304/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384398.779104:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203282304:0@lo:400:kworker.0 00010000:00080000:0.0:1787384398.779114:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4182680 x1874208203282432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384398.779122:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203282432:0@lo:400:kworker.0 00000100:00100000:0.0:1787384398.779143:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203281920 00000100:00100000:0.0:1787384398.779147:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203281920 00000100:00100000:0.0:1787384398.779166:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203281280 00000100:00100000:0.0:1787384398.779168:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203281280 00000100:00100000:0.0:1787384398.779180:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203281792 00000100:00100000:0.0:1787384398.779183:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203281792 00000100:00100000:0.0:1787384398.779195:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787384398.779207:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874208203281920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384398.779242:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874208203281920:12345-0@lo:400:kworker.0 Request processed in 35us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384398.779248:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787384398.779260:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787384398.779266:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874208203281280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384398.779291:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874208203281280:12345-0@lo:400:kworker.0 Request processed in 26us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384398.779296:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787384398.779307:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787384398.779312:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874208203281792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384398.779336:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874208203281792:12345-0@lo:400:kworker.0 Request processed in 24us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384398.779342:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787384398.779367:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874208203281280:0@lo:400:kworker.0 00000100:00100000:0.0:1787384398.779377:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4033b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874208203281792:0@lo:400:kworker.0 00010000:00080000:0.0:1787384398.779386:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4181880 x1874208203281920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384398.779470:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874208203281920:0@lo:400:kworker.0 00000100:00100000:0.0:1787384398.779536:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203281152 00000100:00100000:0.0:1787384398.779540:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203281152 00000100:00100000:0.0:1787384398.779565:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1787384398.779572:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3651:x1874208203281152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384398.779604:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3651:x1874208203281152:12345-0@lo:400:kworker.0 Request processed in 32us (1850us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384398.779617:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1787384398.779798:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203281408 00000100:00100000:1.0:1787384398.779803:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203281408 00000100:00100000:1.0:1787384398.779838:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787384398.779845:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203281408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384398.779886:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203281408:12345-0@lo:400:kworker.0 Request processed in 42us (1253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384398.779893:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787384398.779928:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4030700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203281408:0@lo:400:kworker.0 00000100:00100000:1.0:1787384398.779954:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4030380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203281152:0@lo:400:kworker.0 00000100:00080000:2.0:1787384398.780631:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787384398.780638:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787384398.780640:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787384398.780724:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787384398.780736:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203282560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384398.780773:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384398.780862:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203282560 00000100:00100000:2.0:1787384398.780868:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203282560 00000100:00100000:2.0:1787384398.780907:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787384398.780925:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203282560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787384398.780949:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384398.780989:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203282560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384398.781005:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1787384398.781037:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee254a80 x1874208203282560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384398.781050:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203282560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787384399.299844:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203282688:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787384399.299911:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384399.300002:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203282688 00000100:00100000:2.0:1787384399.300010:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203282688 00000100:00100000:2.0:1787384399.300060:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787384399.300070:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203282688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787384399.300091:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384399.300134:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203282688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384399.300141:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1787384399.300196:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee255180 x1874208203282688/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384399.300214:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203282688:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787384399.799528:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787384400.019226:0:10697:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg345-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:1.0:1787384400.822995:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203282816:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787384400.823112:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384400.823225:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203282816 00000100:00100000:1.0:1787384400.823235:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203282816 00000100:00100000:1.0:1787384400.823287:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787384400.823306:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203282816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787384400.823351:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787384400.823407:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203282816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384400.823415:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787384400.823481:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203282816:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787384400.825318:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384401.252172:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384401.252220:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384401.252258:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384401.252290:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384401.252306:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182247040 00000100:00100000:3.0:1787384401.252316:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384401.252318:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182247040 00000100:00100000:3.0:1787384401.252342:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182247424 00000100:00100000:3.0:1787384401.252345:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182247424 00000100:00100000:1.0:1787384401.252377:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 276 00000100:00100000:3.0:1787384401.252385:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182247552 00000100:00100000:3.0:1787384401.252387:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182247552 00000100:00100000:1.0:1787384401.252388:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+10:2416:x1874208182247040:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384401.252406:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 28 00000100:00100000:3.0:1787384401.252412:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee31e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2416:x1874208182247424:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384401.255873:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182247168 00000100:00100000:0.0:1787384401.255894:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182247168 00000100:00100000:0.0:1787384401.255984:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182247296 00000100:00100000:0.0:1787384401.255988:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182247296 00000100:00100000:0.0:1787384401.256024:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 79 00000100:00100000:0.0:1787384401.256038:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee31e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2416:x1874208182247168:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384401.256253:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+10:2416:x1874208182247040:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 3863us (3990us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384401.256267:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 276 00000100:00100000:3.0:1787384401.258709:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 80 00000100:00100000:3.0:1787384401.258744:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee31f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2416:x1874208182247296:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384401.258876:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee31f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2416:x1874208182247296:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 140us (6584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384401.260088:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 80 00000100:00100000:3.0:1787384401.260149:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 29 00000100:00100000:3.0:1787384401.260164:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee31fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2416:x1874208182247552:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384401.260234:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee31fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2416:x1874208182247552:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 76us (7917us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384401.260241:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 29 00000100:00080000:3.0:1787384401.260264:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787384401.260270:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787384401.260273:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787384401.260277:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787384401.260299:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee31e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2416:x1874208182247424:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 7887us (8079us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384401.260307:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 28 00000100:00100000:1.0:1787384401.264889:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee31e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2416:x1874208182247168:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 8836us (12715us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384401.264919:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 79 00000100:00100000:3.0:1787384401.338256:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384401.338284:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee31f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203282944:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787384401.338369:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384401.338437:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203282944 00000100:00100000:3.0:1787384401.338445:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203282944 00000100:00100000:3.0:1787384401.338499:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787384401.338510:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee31c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203282944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787384401.338556:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787384401.338618:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee31c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203282944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384401.338636:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787384401.339444:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee31f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203282944:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787384401.847021:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384402.883495:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384403.388951:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee31f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203283072:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787384403.389065:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384403.390016:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203283200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787384403.390203:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384403.390267:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203283072 00000100:00100000:3.0:1787384403.390277:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203283072 00000100:00100000:3.0:1787384403.390351:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203283200 00000100:00100000:3.0:1787384403.390355:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203283200 00000100:00100000:3.0:1787384403.390381:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787384403.390392:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203283072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787384403.390433:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787384403.395308:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203283072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4903us (6229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384403.395327:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787384403.395374:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787384403.395392:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee31f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203283200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787384403.395424:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787384403.395526:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee31f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203283200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (5324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384403.395533:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1787384403.395564:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787384403.395763:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4180380 x1874208203283200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384403.395823:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203283200:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1787384403.397140:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee31f480 x1874208203283072/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384403.397169:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee31f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203283072:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787384403.895069:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203283584:0@lo:400:kworker.0 00000100:00100000:1.0:1787384403.895167:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384403.895238:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874208203284096:0@lo:400:kworker.0 00000100:00100000:1.0:1787384403.895265:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384403.895287:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203284608:0@lo:400:kworker.0 00000100:00100000:1.0:1787384403.895314:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384403.895348:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787384403.895354:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203283712:0@lo:400:kworker.0 00000100:00100000:1.0:1787384403.895377:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384403.895394:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874208203284224:0@lo:400:kworker.0 00000100:00100000:1.0:1787384403.895415:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384403.895455:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203283584 00000100:00100000:1.0:1787384403.895464:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203283584 00000100:00100000:1.0:1787384403.895525:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787384403.895534:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203283584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384403.895600:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203283584:12345-0@lo:400:kworker.0 Request processed in 66us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384403.895608:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787384403.895636:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203284096 00000100:00100000:1.0:1787384403.895639:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203284096 00000100:00100000:1.0:1787384403.895676:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203283712 00000100:00100000:1.0:1787384403.895679:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203283712 00000100:00100000:1.0:1787384403.895691:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203284224 00000100:00100000:1.0:1787384403.895693:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203284224 00000100:00100000:1.0:1787384403.895722:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787384403.895729:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874208203284096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384403.895773:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874208203284096:12345-0@lo:400:kworker.0 Request processed in 46us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384403.895802:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787384403.895816:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787384403.895821:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4030700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203283712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384403.895847:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4030700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203283712:12345-0@lo:400:kworker.0 Request processed in 27us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384403.895852:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787384403.895862:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787384403.895867:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4033b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874208203284224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384403.895903:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4033b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874208203284224:12345-0@lo:400:kworker.0 Request processed in 36us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384403.895909:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787384403.895928:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203284608 00000100:00100000:1.0:1787384403.895931:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203284608 00000100:00100000:1.0:1787384403.895959:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787384403.895964:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4030380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203284608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384403.895994:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4030380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203284608:12345-0@lo:400:kworker.0 Request processed in 30us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384403.896000:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1787384403.896028:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787384403.896033:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787384403.896035:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787384403.896079:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203283712:0@lo:400:kworker.0 00000100:00100000:1.0:1787384403.896091:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874208203284224:0@lo:400:kworker.0 00000100:00100000:1.0:1787384403.896111:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203283584:0@lo:400:kworker.0 00010000:00080000:1.0:1787384403.896122:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4180a80 x1874208203284096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384403.896132:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874208203284096:0@lo:400:kworker.0 00010000:00080000:1.0:1787384403.896140:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4181880 x1874208203284608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384403.896148:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203284608:0@lo:400:kworker.0 00000100:00100000:3.0:1787384403.896334:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874208203283456:0@lo:400:kworker.0 00000100:00100000:3.0:1787384403.896370:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384403.896399:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874208203283968:0@lo:400:kworker.0 00000100:00100000:3.0:1787384403.896421:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384403.896437:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203284480:0@lo:400:kworker.0 00000100:00100000:3.0:1787384403.896475:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384403.896503:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787384403.896510:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203283328:0@lo:400:kworker.0 00000100:00100000:3.0:1787384403.896539:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384403.896560:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203283840:0@lo:400:kworker.0 00000100:00100000:3.0:1787384403.896582:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384403.896600:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874208203284352:0@lo:400:kworker.0 00000100:00100000:3.0:1787384403.896625:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384403.896651:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203284480 00000100:00100000:3.0:1787384403.896656:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203284480 00000100:00100000:3.0:1787384403.896692:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787384403.896698:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203284480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384403.896751:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203284480:12345-0@lo:400:kworker.0 Request processed in 53us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384403.896758:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787384403.896798:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203283840 00000100:00100000:3.0:1787384403.896802:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203283840 00000100:00100000:3.0:1787384403.896824:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787384403.896830:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203283840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384403.896865:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203283840:12345-0@lo:400:kworker.0 Request processed in 34us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384403.896871:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787384403.896915:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203283840:0@lo:400:kworker.0 00010000:00080000:3.0:1787384403.896926:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4182d80 x1874208203284480/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384403.896936:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203284480:0@lo:400:kworker.0 00000100:00100000:0.0:1787384403.897165:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203283328 00000100:00100000:0.0:1787384403.897171:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203283328 00000100:00100000:0.0:1787384403.897205:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1787384403.897213:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3654:x1874208203283328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384403.897256:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3654:x1874208203283328:12345-0@lo:400:kworker.0 Request processed in 44us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384403.897262:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1787384403.897352:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203283328:0@lo:400:kworker.0 00010000:00010000:1.0:1787384403.897445:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384403.897459:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203283456 00000100:00100000:1.0:1787384403.897463:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203283456 00000100:00100000:1.0:1787384403.897499:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203283968 00000100:00100000:1.0:1787384403.897502:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203283968 00000100:00100000:1.0:1787384403.897518:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203284352 00000100:00100000:1.0:1787384403.897521:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203284352 00000100:00100000:1.0:1787384403.897538:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787384403.897545:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee31f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874208203283456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384403.897591:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee31f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874208203283456:12345-0@lo:400:kworker.0 Request processed in 46us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384403.897597:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787384403.897612:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787384403.897618:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874208203283968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384403.897646:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874208203283968:12345-0@lo:400:kworker.0 Request processed in 29us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384403.897651:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787384403.897662:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787384403.897676:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874208203284352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384403.897721:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874208203284352:12345-0@lo:400:kworker.0 Request processed in 46us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384403.897726:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1787384403.897747:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787384403.897750:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787384403.897753:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787384403.897794:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4181c00 x1874208203284352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384403.897804:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874208203284352:0@lo:400:kworker.0 00000100:00100000:1.0:1787384403.897814:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874208203283456:0@lo:400:kworker.0 00000100:00100000:1.0:1787384403.897823:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874208203283968:0@lo:400:kworker.0 00000100:00100000:1.0:1787384403.900351:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203284736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787384403.900442:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384403.900620:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203284736 00000100:00100000:0.0:1787384403.900632:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203284736 00000100:00100000:0.0:1787384403.900698:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787384403.900708:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4030000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203284736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787384403.900742:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787384403.900822:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4030000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203284736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384403.900830:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1787384403.901114:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee254e00 x1874208203284736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384403.901136:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203284736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787384404.409847:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787384404.409888:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203284864:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787384404.409994:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384404.410654:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203284864 00000100:00100000:0.0:1787384404.410666:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203284864 00000100:00100000:0.0:1787384404.410738:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787384404.410749:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7deb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203284864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787384404.410796:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787384404.410862:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7deb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203284864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384404.410870:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1787384404.411020:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f9148000 x1874208203284864/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384420 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384404.411042:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203284864:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787384404.921111:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787384405.732217:0:10942:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg345-server.virtnet: executing yml_node 00000100:00100000:1.0:1787384405.945298:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203284992:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787384405.945380:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384405.945474:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203284992 00000100:00100000:1.0:1787384405.945482:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203284992 00000100:00100000:1.0:1787384405.945533:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787384405.945542:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4032d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203284992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787384405.945580:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787384405.945643:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4032d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203284992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384405.945650:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787384405.945722:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203284992:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787384405.947526:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384406.386861:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384406.386919:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384406.386962:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182248064 00000100:00100000:2.0:1787384406.386974:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384406.386980:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182248064 00000100:00100000:2.0:1787384406.387013:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384406.387059:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182248192 00000100:00100000:1.0:1787384406.387065:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182248192 00000100:00100000:2.0:1787384406.387072:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384406.387104:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 18 00000100:00100000:2.0:1787384406.387115:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182247936 00000100:00100000:1.0:1787384406.387117:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2412:x1874208182248064:12345-192.168.203.45@tcp:9:kworker.0 00000100:00100000:2.0:1787384406.387140:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182247936 00000100:00100000:2.0:1787384406.387197:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182247808 00000100:00100000:2.0:1787384406.387201:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182247808 00000100:00100000:2.0:1787384406.387230:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 87 00000100:00100000:2.0:1787384406.387240:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2413:x1874208182247936:12345-192.168.203.45@tcp:400:kworker.0 00000020:00000080:1.0:1787384406.387257:0:8435:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba27bb 00000100:00080000:1.0:1787384406.387273:0:8435:0:(import.c:65:import_set_state_nolock()) ffff98f7c3513800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787384406.387343:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2413:x1874208182247936:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 102us (329us total) trans 0 rc 0/0 00000001:00000004:1.0:1787384406.387344:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1787384406.387362:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 87 00000100:00100000:2.0:1787384406.387386:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 88 00000100:00100000:2.0:1787384406.387393:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2413:x1874208182247808:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384406.387431:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2413:x1874208182247808:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 37us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384406.387438:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 88 00000100:00100000:3.0:1787384406.387589:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 19 00000100:00100000:3.0:1787384406.387602:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2412:x1874208182248192:12345-192.168.203.45@tcp:9:kworker.0 00000020:00000080:3.0:1787384406.387623:0:8438:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba27c2 00000100:00080000:3.0:1787384406.387631:0:8438:0:(import.c:65:import_set_state_nolock()) ffff98f8f7d8d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787384406.387663:0:8438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1787384406.387764:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+2:2412:x1874208182248064:12345-192.168.203.45@tcp:9:kworker.0 Request processed in 650us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384406.387772:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 18 00000100:00100000:1.0:1787384406.387820:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182247680 00000100:00100000:1.0:1787384406.387826:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182247680 00000100:00100000:1.0:1787384406.387951:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 278 00000100:00100000:1.0:1787384406.387963:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+10:2413:x1874208182247680:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384406.388104:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+10:2413:x1874208182247680:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 143us (1133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384406.388111:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 278 00000100:00080000:1.0:1787384406.388143:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787384406.388148:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787384406.388251:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+2:2412:x1874208182248192:12345-192.168.203.45@tcp:9:kworker.0 Request processed in 651us (1330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384406.388258:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 19 00010000:00010000:3.0:1787384406.388314:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787384406.388342:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787384406.388353:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787384406.388361:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384406.456101:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4032a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203285120:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787384406.456204:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384406.456307:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203285120 00000100:00100000:1.0:1787384406.456317:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203285120 00000100:00100000:1.0:1787384406.456374:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787384406.456385:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203285120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787384406.456432:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787384406.456487:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203285120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384406.456496:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787384406.456561:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4032a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203285120:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787384406.967144:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384407.991340:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384408.503328:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787384408.503361:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203285248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787384408.503458:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384408.504066:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203285248 00000100:00100000:1.0:1787384408.504077:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203285248 00000100:00100000:1.0:1787384408.504152:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787384408.504164:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203285248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787384408.504206:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787384408.504288:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203285248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384408.504296:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787384408.504321:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787384408.504332:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203285376:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787384408.504364:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384408.504400:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203285376 00000100:00100000:1.0:1787384408.504404:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203285376 00000100:00100000:1.0:1787384408.504443:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787384408.504448:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203285376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787384408.504460:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787384408.504817:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203285376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384408.504826:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1787384408.504881:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7de8700 x1874208203285376/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384408.504904:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203285376:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787384408.505058:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787384408.505371:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4182300 x1874208203285248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384408.505389:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203285248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787384409.015107:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787384409.015139:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203285504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787384409.015237:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384409.015567:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874208203286016:0@lo:400:kworker.0 00000100:00100000:3.0:1787384409.015606:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384409.015685:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203286528:0@lo:400:kworker.0 00000100:00100000:3.0:1787384409.015729:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787384409.015853:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384409.015875:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203286016 00000100:00100000:2.0:1787384409.015883:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203286016 00000100:00100000:2.0:1787384409.015944:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787384409.015955:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874208203286016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384409.016017:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874208203286016:12345-0@lo:400:kworker.0 Request processed in 63us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384409.016026:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787384409.016056:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7de8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874208203285760:0@lo:400:kworker.0 00000100:00100000:2.0:1787384409.016084:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384409.016147:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203285632:0@lo:400:kworker.0 00000100:00100000:0.0:1787384409.016190:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384409.019998:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203286528 00000100:00100000:1.0:1787384409.020018:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203286528 00000100:00100000:1.0:1787384409.020092:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787384409.020104:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd626050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203286528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384409.020209:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd626050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203286528:12345-0@lo:400:kworker.0 Request processed in 107us (4478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384409.020217:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787384409.020422:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203285504 00000100:00100000:1.0:1787384409.020427:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203285504 00000100:00100000:1.0:1787384409.020465:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787384409.020472:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203285504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787384409.020509:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787384409.020546:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203285504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (5310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384409.020573:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787384409.020597:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203285888:0@lo:400:kworker.0 00000100:00100000:1.0:1787384409.020638:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384409.020676:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203285888 00000100:00100000:1.0:1787384409.020680:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203285888 00000100:00100000:1.0:1787384409.020722:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787384409.020729:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203285888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384409.020763:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203285888:12345-0@lo:400:kworker.0 Request processed in 35us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384409.020769:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787384409.020841:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203285888:0@lo:400:kworker.0 00000100:00100000:1.0:1787384409.020859:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203286400:0@lo:400:kworker.0 00000100:00100000:1.0:1787384409.020888:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384409.020912:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874208203286912:0@lo:400:kworker.0 00000100:00100000:1.0:1787384409.020935:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787384409.020963:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4180380 x1874208203285504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384425 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384409.020980:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203285504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787384409.021037:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203285632 00000100:00100000:1.0:1787384409.021041:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203285632 00000100:00100000:1.0:1787384409.021067:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1787384409.021072:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3651:x1874208203285632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384409.021108:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3651:x1874208203285632:12345-0@lo:400:kworker.0 Request processed in 36us (4917us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384409.021125:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1787384409.021181:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203285760 00000100:00100000:1.0:1787384409.021185:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203285760 00000100:00100000:1.0:1787384409.021211:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203286400 00000100:00100000:1.0:1787384409.021213:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203286400 00000100:00100000:1.0:1787384409.021227:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203286912 00000100:00100000:1.0:1787384409.021230:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203286912 00000100:00100000:1.0:1787384409.021248:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787384409.021254:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874208203285760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384409.021289:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874208203285760:12345-0@lo:400:kworker.0 Request processed in 35us (5205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384409.021295:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787384409.021306:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787384409.021312:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203286400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384409.021342:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203286400:12345-0@lo:400:kworker.0 Request processed in 31us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384409.021347:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787384409.021357:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787384409.021362:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874208203286912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384409.021386:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874208203286912:12345-0@lo:400:kworker.0 Request processed in 24us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384409.021391:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:1.0:1787384409.021558:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7dbdc00 x1874208203286400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384409.021569:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203286400:0@lo:400:kworker.0 00010000:00080000:1.0:1787384409.021580:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7dbf480 x1874208203286912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384409.021598:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874208203286912:0@lo:400:kworker.0 00000100:00080000:1.0:1787384409.021680:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787384409.021688:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787384409.030187:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7de8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874208203285760:0@lo:400:kworker.0 00000100:00100000:2.0:1787384409.030210:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874208203286272:0@lo:400:kworker.0 00000100:00100000:2.0:1787384409.030341:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384409.030395:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874208203286784:0@lo:400:kworker.0 00000100:00100000:2.0:1787384409.030420:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384409.030505:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203286272 00000100:00100000:2.0:1787384409.030513:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203286272 00000100:00100000:2.0:1787384409.030579:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203286784 00000100:00100000:2.0:1787384409.030582:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203286784 00000100:00100000:2.0:1787384409.030614:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787384409.030623:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874208203286272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384409.030700:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874208203286272:12345-0@lo:400:kworker.0 Request processed in 77us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384409.030721:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787384409.030740:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787384409.030747:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874208203286784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384409.030774:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874208203286784:12345-0@lo:400:kworker.0 Request processed in 28us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384409.030803:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:2.0:1787384409.030826:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384409.030863:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874208203286272:0@lo:400:kworker.0 00000100:00100000:2.0:1787384409.030874:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874208203286784:0@lo:400:kworker.0 00000100:00100000:0.0:1787384409.041933:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203285632:0@lo:400:kworker.0 00000100:00100000:0.0:1787384409.041956:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203286144:0@lo:400:kworker.0 00000100:00100000:0.0:1787384409.042062:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384409.042112:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203286656:0@lo:400:kworker.0 00000100:00100000:0.0:1787384409.042143:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384409.042177:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203287168:0@lo:400:kworker.0 00000100:00100000:0.0:1787384409.042202:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384409.042292:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203286656 00000100:00100000:0.0:1787384409.042301:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203286656 00000100:00100000:0.0:1787384409.042360:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203287168 00000100:00100000:0.0:1787384409.042364:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203287168 00000100:00100000:0.0:1787384409.042394:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787384409.042403:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203286656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384409.042467:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203286656:12345-0@lo:400:kworker.0 Request processed in 64us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384409.042474:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787384409.042491:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787384409.042510:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203287168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384409.042538:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203287168:12345-0@lo:400:kworker.0 Request processed in 30us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384409.042544:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1787384409.042587:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7dbd880 x1874208203286656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384409.042601:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203286656:0@lo:400:kworker.0 00010000:00080000:0.0:1787384409.042611:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7dbe680 x1874208203287168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384409.042637:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203287168:0@lo:400:kworker.0 00000100:00100000:1.0:1787384409.042812:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203286144 00000100:00100000:1.0:1787384409.042818:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203286144 00000100:00100000:1.0:1787384409.042865:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787384409.042874:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203286144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384409.042922:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203286144:12345-0@lo:400:kworker.0 Request processed in 50us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384409.042929:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787384409.043774:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203286144:0@lo:400:kworker.0 00010000:00080000:3.0:1787384409.046749:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7dbed80 x1874208203286528/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384409.046772:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203286528:0@lo:400:kworker.0 00000100:00100000:2.0:1787384409.048157:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203287040:0@lo:400:kworker.0 00000100:00100000:2.0:1787384409.048272:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384409.048419:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874208203286016:0@lo:400:kworker.0 00000100:00100000:0.0:1787384409.057023:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203287040 00000100:00100000:0.0:1787384409.057047:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203287040 00000100:00100000:0.0:1787384409.057169:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787384409.057182:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203287040:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787384409.057657:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787384409.059155:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203287040:12345-0@lo:400:kworker.0 Request processed in 1967us (10873us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384409.059173:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1787384409.061432:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7dbc700 x1874208203287040/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384409.061487:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203287040:0@lo:400:kworker.0 00000100:00100000:0.0:1787384409.527907:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787384409.527942:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203287296:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787384409.528038:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384409.528638:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203287296 00000100:00100000:1.0:1787384409.528650:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203287296 00000100:00100000:1.0:1787384409.528730:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787384409.528741:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee255880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203287296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787384409.528773:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787384409.528885:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee255880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203287296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 145us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384409.528893:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1787384409.529102:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7dbf800 x1874208203287296/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384425 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384409.529125:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203287296:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787384410.043135:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787384410.667942:0:11125:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.113 00010000:00010000:2.0:1787384411.065279:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384411.066023:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203287424:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787384411.066132:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384411.066295:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203287424 00000100:00100000:3.0:1787384411.066305:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203287424 00000100:00100000:3.0:1787384411.066370:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787384411.066381:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203287424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787384411.066422:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787384411.066473:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203287424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384411.066480:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787384411.066590:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203287424:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787384411.495299:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384411.495344:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384411.495372:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384411.495388:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182248320 00000100:00100000:1.0:1787384411.495399:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182248320 00000100:00100000:0.0:1787384411.495402:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182248576 00000100:00100000:0.0:1787384411.495408:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182248576 00000100:00100000:1.0:1787384411.495450:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 280 00000100:00100000:0.0:1787384411.495457:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182248448 00000100:00100000:1.0:1787384411.495463:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+10:2416:x1874208182248320:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384411.495463:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182248448 00000100:00100000:0.0:1787384411.495490:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 95 00000100:00100000:0.0:1787384411.495499:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4106680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2416:x1874208182248576:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384411.495540:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+10:2416:x1874208182248320:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 79us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384411.495542:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4106680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2416:x1874208182248576:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 41us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384411.495559:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 280 00000100:00100000:0.0:1787384411.495560:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 95 00000100:00100000:0.0:1787384411.495585:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 96 00000100:00100000:0.0:1787384411.495592:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4105500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2416:x1874208182248448:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384411.495619:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4105500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2416:x1874208182248448:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 27us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384411.495624:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 96 00000100:00080000:0.0:1787384411.495644:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787384411.495648:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787384411.575368:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203287552:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787384411.575457:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384411.575652:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203287552 00000100:00100000:1.0:1787384411.575660:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203287552 00000100:00100000:1.0:1787384411.575713:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787384411.575722:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203287552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787384411.575756:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787384411.575846:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203287552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384411.575853:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787384411.575995:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203287552:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787384412.086972:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787384412.091985:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 55e96ad5-fd9d-44d4-856e-5db0c40b1329 00000020:00000080:0.0:1787384412.091998:0:8432:0:(genops.c:906:class_export_put()) final put ffff98f7c3510000/55e96ad5-fd9d-44d4-856e-5db0c40b1329 00000001:00100000:1.0:1787384412.092066:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 55e96ad5-fd9d-44d4-856e-5db0c40b1329 00000020:00000080:1.0:1787384412.092071:0:9517:0:(genops.c:906:class_export_put()) final put ffff98f8f7d8e800/55e96ad5-fd9d-44d4-856e-5db0c40b1329 00000020:00000080:3.0:1787384412.101455:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c3510000/55e96ad5-fd9d-44d4-856e-5db0c40b1329 for lustre-OST0000 00000020:00000080:3.0:1787384412.112134:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f7d8e800/55e96ad5-fd9d-44d4-856e-5db0c40b1329 for lustre-OST0001 00000020:00000080:3.0:1787384412.112183:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f7c3513800 for lustre-OST0000 00000020:00000080:3.0:1787384412.112190:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8f7d8d800 for lustre-OST0001 00010000:00010000:1.0:1787384413.111385:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384413.622998:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787384413.623023:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203287680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787384413.623100:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787384413.623114:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203287808:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787384413.623156:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384413.623221:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203287680 00000100:00100000:0.0:1787384413.623228:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203287680 00000100:00100000:0.0:1787384413.623283:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787384413.623292:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203287680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787384413.623322:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787384413.623360:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203287680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384413.623366:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1787384413.623385:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787384413.623638:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384413.623754:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203287808 00000100:00100000:0.0:1787384413.623759:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203287808 00010000:00080000:1.0:1787384413.623770:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4183100 x1874208203287680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384413.623822:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203287680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787384413.623831:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787384413.623840:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203287808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787384413.623862:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787384413.623911:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203287808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384413.623935:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1787384413.624579:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787384413.625440:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7dbc000 x1874208203287808/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384413.625461:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203287808:0@lo:13:osp-pre-0-1.0 00000001:02000400:3.0:1787384413.786261:0:11223:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.113 00010000:00010000:0.0:1787384414.135114:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384414.135227:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4107800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203287936:0@lo:400:kworker.0 00000100:00100000:3.0:1787384414.135301:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384414.135354:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4107100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203288448:0@lo:400:kworker.0 00000100:00100000:3.0:1787384414.135381:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384414.135413:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4104a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203288960:0@lo:400:kworker.0 00000100:00100000:3.0:1787384414.135451:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384414.135469:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4105880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203289472:0@lo:400:kworker.0 00000100:00100000:3.0:1787384414.135490:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384414.135513:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787384414.135518:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4107b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203288064:0@lo:400:kworker.0 00000100:00100000:3.0:1787384414.135540:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384414.135558:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4106a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203288576:0@lo:400:kworker.0 00000100:00100000:3.0:1787384414.135579:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384414.135596:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203289088:0@lo:400:kworker.0 00000100:00100000:3.0:1787384414.135618:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384414.135650:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203288448 00000100:00100000:3.0:1787384414.135657:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203288448 00000100:00100000:3.0:1787384414.135694:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787384414.135702:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203288448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384414.135752:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203288448:12345-0@lo:400:kworker.0 Request processed in 50us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384414.135759:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787384414.135804:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203288960 00000100:00100000:3.0:1787384414.135808:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203288960 00000100:00100000:3.0:1787384414.135842:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203289472 00000100:00100000:3.0:1787384414.135845:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203289472 00000100:00100000:3.0:1787384414.135867:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787384414.135874:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203288960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384414.135904:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203288960:12345-0@lo:400:kworker.0 Request processed in 30us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384414.135910:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787384414.135928:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787384414.135934:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203289472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384414.135963:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203289472:12345-0@lo:400:kworker.0 Request processed in 29us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384414.135968:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787384414.135987:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203288064 00000100:00100000:3.0:1787384414.135990:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203288064 00000100:00100000:3.0:1787384414.136025:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203288576 00000100:00100000:3.0:1787384414.136028:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203288576 00000100:00100000:3.0:1787384414.136040:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203289088 00000100:00100000:3.0:1787384414.136042:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203289088 00000100:00100000:3.0:1787384414.136054:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787384414.136060:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203288064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384414.136088:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203288064:12345-0@lo:400:kworker.0 Request processed in 28us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384414.136095:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787384414.136105:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787384414.136111:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203288576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384414.136133:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203288576:12345-0@lo:400:kworker.0 Request processed in 22us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384414.136138:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787384414.136147:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787384414.136152:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874208203289088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384414.136175:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874208203289088:12345-0@lo:400:kworker.0 Request processed in 22us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384414.136180:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:3.0:1787384414.136204:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787384414.136214:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787384414.136247:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4107b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203288064:0@lo:400:kworker.0 00000100:00100000:3.0:1787384414.136257:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4106a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203288576:0@lo:400:kworker.0 00000100:00100000:3.0:1787384414.136265:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203289088:0@lo:400:kworker.0 00000100:00100000:3.0:1787384414.136274:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4107100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203288448:0@lo:400:kworker.0 00010000:00080000:3.0:1787384414.136284:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4104a80 x1874208203288960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384414.136295:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4104a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203288960:0@lo:400:kworker.0 00010000:00080000:3.0:1787384414.136305:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4105880 x1874208203289472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384414.136313:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4105880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203289472:0@lo:400:kworker.0 00000100:00100000:0.0:1787384414.136467:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203287936 00000100:00100000:0.0:1787384414.136472:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203287936 00000100:00100000:0.0:1787384414.136511:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1787384414.136517:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3653:x1874208203287936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384414.136553:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3653:x1874208203287936:12345-0@lo:400:kworker.0 Request processed in 36us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384414.136560:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1787384414.136688:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4104000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203288192:0@lo:400:kworker.0 00000100:00100000:1.0:1787384414.136728:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384414.136752:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4105f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874208203288704:0@lo:400:kworker.0 00000100:00100000:1.0:1787384414.136773:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384414.136820:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4105c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203289216:0@lo:400:kworker.0 00000100:00100000:1.0:1787384414.136842:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384414.136862:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787384414.136869:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4106300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203288320:0@lo:400:kworker.0 00000100:00100000:1.0:1787384414.136889:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384414.136905:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4105180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203288832:0@lo:400:kworker.0 00000100:00100000:1.0:1787384414.136925:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384414.136943:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4106d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203289344:0@lo:400:kworker.0 00000100:00100000:1.0:1787384414.136962:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384414.136991:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203288192 00000100:00100000:1.0:1787384414.140491:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203288192 00000100:00100000:1.0:1787384414.140569:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787384414.140579:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203288192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384414.140677:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203288192:12345-0@lo:400:kworker.0 Request processed in 99us (3947us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384414.140684:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787384414.140710:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203288832 00000100:00100000:1.0:1787384414.140718:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203288832 00000100:00100000:1.0:1787384414.140743:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203289344 00000100:00100000:1.0:1787384414.140745:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203289344 00000100:00100000:1.0:1787384414.140769:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787384414.140795:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203288832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384414.140844:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203288832:12345-0@lo:400:kworker.0 Request processed in 69us (3917us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384414.140861:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787384414.140873:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787384414.140879:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203289344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384414.140908:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203289344:12345-0@lo:400:kworker.0 Request processed in 30us (3946us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384414.140914:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787384414.140952:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203288704 00000100:00100000:1.0:1787384414.140956:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203288704 00000100:00100000:1.0:1787384414.140981:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203289216 00000100:00100000:1.0:1787384414.140985:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203289216 00000100:00100000:3.0:1787384414.141188:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4104380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203289600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787384414.141231:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384414.141273:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203289600 00000100:00100000:3.0:1787384414.141278:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203289600 00000100:00100000:3.0:1787384414.141306:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787384414.141313:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203289600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787384414.141336:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787384414.141375:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203289600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384414.141381:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1787384414.141420:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4104380 x1874208203289600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384430 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384414.141452:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4104380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203289600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787384414.141486:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4107800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203287936:0@lo:400:kworker.0 00000100:00100000:1.0:1787384414.141744:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203288320 00000100:00100000:1.0:1787384414.141749:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203288320 00000100:00100000:1.0:1787384414.141773:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787384414.141819:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874208203288704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384414.141861:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874208203288704:12345-0@lo:400:kworker.0 Request processed in 54us (5086us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384414.141867:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787384414.141879:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787384414.141885:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874208203289216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384414.141914:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874208203289216:12345-0@lo:400:kworker.0 Request processed in 29us (5070us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384414.141920:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787384414.141931:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787384414.141937:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203288320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384414.141967:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203288320:12345-0@lo:400:kworker.0 Request processed in 30us (5076us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384414.141984:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1787384414.147177:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787384414.147188:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787384414.147300:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4106300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203288320:0@lo:400:kworker.0 00010000:00080000:1.0:1787384414.147319:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4105180 x1874208203288832/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384414.147330:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4105180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203288832:0@lo:400:kworker.0 00010000:00080000:1.0:1787384414.147341:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4106d80 x1874208203289344/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384414.147348:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4106d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203289344:0@lo:400:kworker.0 00000100:00100000:1.0:1787384414.147433:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4104000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203288192:0@lo:400:kworker.0 00010000:00080000:1.0:1787384414.147446:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4105f80 x1874208203288704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384414.147454:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4105f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874208203288704:0@lo:400:kworker.0 00010000:00080000:1.0:1787384414.147464:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4105c00 x1874208203289216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384414.147473:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4105c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203289216:0@lo:400:kworker.0 00000100:00100000:3.0:1787384414.647002:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203289728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787384414.647098:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384414.647188:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203289728 00000100:00100000:3.0:1787384414.647197:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203289728 00000100:00100000:3.0:1787384414.647252:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787384414.647262:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203289728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787384414.647294:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787384414.647341:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203289728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384414.647348:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1787384414.647400:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7dbf800 x1874208203289728/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384430 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384414.647436:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203289728:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787384415.162005:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384416.183252:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203289856:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787384416.183355:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384416.183500:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203289856 00000100:00100000:3.0:1787384416.183510:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203289856 00000100:00100000:3.0:1787384416.183573:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787384416.183590:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203289856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787384416.183642:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00010000:00010000:1.0:1787384416.184293:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384416.184471:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203289856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 886us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384416.184480:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787384416.184635:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203289856:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787384416.610372:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384416.610419:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384416.610453:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384416.610519:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182248960 00000100:00100000:1.0:1787384416.610527:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182248704 00000100:00100000:3.0:1787384416.610537:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182248960 00000100:00100000:1.0:1787384416.610539:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182248704 00000100:00100000:1.0:1787384416.610610:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 282 00000100:00100000:1.0:1787384416.610626:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+10:2414:x1874208182248704:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384416.610643:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182248832 00000100:00100000:3.0:1787384416.610650:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182248832 00000100:00100000:1.0:1787384416.610719:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+10:2414:x1874208182248704:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 97us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384416.610727:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 282 00000100:00080000:2.0:1787384416.610827:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787384416.610834:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787384416.611235:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 103 00000100:00100000:3.0:1787384416.611256:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2414:x1874208182248960:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384416.611357:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2414:x1874208182248960:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 109us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384416.616665:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 104 00000100:00100000:1.0:1787384416.616688:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2414:x1874208182248832:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384416.617458:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 103 00000100:00100000:1.0:1787384416.620633:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2414:x1874208182248832:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 3944us (10167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384416.620647:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 104 00000100:00100000:3.0:1787384416.695065:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787384416.695098:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203289984:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787384416.695200:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384416.695305:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203289984 00000100:00100000:3.0:1787384416.695315:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203289984 00000100:00100000:3.0:1787384416.695377:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787384416.695387:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203289984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787384416.695429:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787384416.695481:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203289984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384416.695489:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787384416.695546:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203289984:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1787384416.929646:0:11320:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.113 00010000:00010000:2.0:1787384417.208579:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384418.231156:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384418.744623:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787384418.744655:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203290112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787384418.744739:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384418.744973:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203290112 00000100:00100000:3.0:1787384418.744982:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203290112 00000100:00100000:0.0:1787384418.745057:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203290240:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787384418.745089:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384418.745122:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203290240 00000100:00100000:3.0:1787384418.745127:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203290240 00000100:00100000:3.0:1787384418.745148:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787384418.745158:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203290112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787384418.745202:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787384418.745251:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203290112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384418.745259:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787384418.745278:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787384418.745285:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4107480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203290240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787384418.745294:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787384418.745316:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4107480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203290240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 31us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384418.745322:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1787384418.745351:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787384418.748858:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3a6f480 x1874208203290112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384418.748895:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203290112:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1787384418.756363:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7dbed80 x1874208203290240/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384418.756396:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203290240:0@lo:13:osp-pre-0-1.0 00000001:02000400:3.0:1787384418.779295:0:11368:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Aug 22 03:40:16 EDT 2026 00010000:00010000:1.0:1787384419.255518:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384419.256342:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203290496:0@lo:400:kworker.0 00000100:00100000:3.0:1787384419.256439:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384419.256516:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203291008:0@lo:400:kworker.0 00000100:00100000:3.0:1787384419.256545:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384419.256574:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7de3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203291520:0@lo:400:kworker.0 00000100:00100000:1.0:1787384419.256759:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203290752:0@lo:400:kworker.0 00000100:00100000:1.0:1787384419.257246:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384419.257326:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7de0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203291264:0@lo:400:kworker.0 00000100:00100000:1.0:1787384419.257367:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384419.257401:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7de1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203291776:0@lo:400:kworker.0 00000100:00100000:0.0:1787384419.257414:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203290496 00000100:00100000:0.0:1787384419.257426:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203290496 00000100:00100000:1.0:1787384419.257436:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384419.257500:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203291008 00000100:00100000:0.0:1787384419.257505:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203291008 00000100:00100000:0.0:1787384419.257533:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203290752 00000100:00100000:0.0:1787384419.257537:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203290752 00000100:00100000:0.0:1787384419.257554:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787384419.257563:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203290496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384419.257645:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203290496:12345-0@lo:400:kworker.0 Request processed in 81us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384419.257654:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787384419.257671:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787384419.257698:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203291008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384419.257730:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203291008:12345-0@lo:400:kworker.0 Request processed in 33us (1191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384419.257741:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787384419.257753:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787384419.257759:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203290752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384419.258917:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1787384419.258935:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203290368:0@lo:400:kworker.0 00000100:00100000:2.0:1787384419.261480:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203290624:0@lo:400:kworker.0 00000100:00100000:3.0:1787384419.264554:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384419.264669:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4105c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203292032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787384419.264766:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384419.264854:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203290496:0@lo:400:kworker.0 00000100:00100000:3.0:1787384419.264871:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203291008:0@lo:400:kworker.0 00000100:00100000:3.0:1787384419.264924:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203291520 00000100:00100000:3.0:1787384419.265495:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203291520 00000100:00100000:3.0:1787384419.265558:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787384419.265754:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874208203291520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384419.265893:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874208203291520:12345-0@lo:400:kworker.0 Request processed in 144us (1350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384419.265903:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787384419.266027:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203292032 00000100:00100000:3.0:1787384419.266033:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203292032 00000100:00100000:3.0:1787384419.266070:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787384419.266078:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203292032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787384419.266109:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787384419.266222:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203292032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 144us (1454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384419.266229:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1787384419.266343:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4105c00 x1874208203292032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384435 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384419.266365:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4105c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203292032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787384419.266380:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7de3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203291520:0@lo:400:kworker.0 00000100:00100000:3.0:1787384419.266873:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203291264 00000100:00100000:3.0:1787384419.266880:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203291264 00000100:00100000:1.0:1787384419.266897:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384419.266919:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203291776 00000100:00100000:3.0:1787384419.266924:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203291776 00000100:00100000:1.0:1787384419.266974:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203290880:0@lo:400:kworker.0 00000100:00100000:3.0:1787384419.267028:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787384419.267037:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9149c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203291264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384419.267089:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9149c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203291264:12345-0@lo:400:kworker.0 Request processed in 53us (9726us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384419.267112:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787384419.267124:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787384419.267129:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203291776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384419.267221:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203291776:12345-0@lo:400:kworker.0 Request processed in 91us (9791us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384419.267228:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787384419.267396:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203290368 00000100:00100000:3.0:1787384419.267401:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203290368 00000100:00100000:1.0:1787384419.267676:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384419.267719:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1787384419.267726:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7de2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203291392:0@lo:400:kworker.0 00000100:00100000:3.0:1787384419.267737:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3651:x1874208203290368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384419.267836:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3651:x1874208203290368:12345-0@lo:400:kworker.0 Request processed in 105us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384419.267843:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1787384419.267892:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787384419.267927:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787384419.267929:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7de1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203291904:0@lo:400:kworker.0 00000100:00100000:1.0:1787384419.267976:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787384419.268300:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787384419.268346:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203290880 00000100:00100000:3.0:1787384419.268354:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203290880 00000100:00100000:3.0:1787384419.268397:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787384419.268404:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203290880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384419.268527:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203290880:12345-0@lo:400:kworker.0 Request processed in 122us (1499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384419.268534:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:1.0:1787384419.268753:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7de0000 x1874208203291264/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384419.268764:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203291392 00000100:00100000:3.0:1787384419.268771:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203291392 00000100:00100000:3.0:1787384419.268831:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203291904 00000100:00100000:3.0:1787384419.268835:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203291904 00000100:00100000:3.0:1787384419.268853:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787384419.268873:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203291392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384419.268910:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203291392:12345-0@lo:400:kworker.0 Request processed in 38us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384419.268917:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787384419.268941:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7de0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203291264:0@lo:400:kworker.0 00010000:00080000:1.0:1787384419.268967:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7de1f80 x1874208203291776/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384419.268975:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7de1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203291776:0@lo:400:kworker.0 00000100:00100000:1.0:1787384419.269003:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203290368:0@lo:400:kworker.0 00000100:00100000:1.0:1787384419.269014:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203290880:0@lo:400:kworker.0 00000100:00100000:3.0:1787384419.269055:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787384419.269066:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203291904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384419.269107:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203291904:12345-0@lo:400:kworker.0 Request processed in 43us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384419.269112:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1787384419.269566:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7de2300 x1874208203291392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384419.269582:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7de2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203291392:0@lo:400:kworker.0 00010000:00080000:1.0:1787384419.269666:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7de1180 x1874208203291904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384419.269675:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7de1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203291904:0@lo:400:kworker.0 00000100:00100000:0.0:1787384419.270932:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203290752:12345-0@lo:400:kworker.0 Request processed in 13160us (13675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384419.270952:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787384419.271178:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203290752:0@lo:400:kworker.0 00000100:00100000:2.0:1787384419.275859:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384419.275930:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7de3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874208203291136:0@lo:400:kworker.0 00000100:00100000:2.0:1787384419.275982:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384419.276008:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874208203291648:0@lo:400:kworker.0 00000100:00100000:2.0:1787384419.276030:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384419.276102:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203291136 00000100:00100000:3.0:1787384419.276113:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203291136 00000100:00100000:3.0:1787384419.276182:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203291648 00000100:00100000:3.0:1787384419.276185:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203291648 00000100:00100000:3.0:1787384419.276213:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787384419.276223:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874208203291136:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787384419.276235:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787384419.276277:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787384419.276288:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874208203291648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384419.276312:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874208203291136:12345-0@lo:400:kworker.0 Request processed in 87us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384419.276322:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787384419.276331:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874208203291648:12345-0@lo:400:kworker.0 Request processed in 46us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384419.276340:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:3.0:1787384419.276387:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7de3b80 x1874208203291136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384419.276403:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7de3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874208203291136:0@lo:400:kworker.0 00010000:00080000:3.0:1787384419.276413:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7de2a00 x1874208203291648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384419.276421:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874208203291648:0@lo:400:kworker.0 00000100:00100000:0.0:1787384419.276658:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203290624 00000100:00100000:0.0:1787384419.276664:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203290624 00000100:00100000:0.0:1787384419.276706:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787384419.276713:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203290624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384419.276753:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203290624:12345-0@lo:400:kworker.0 Request processed in 41us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384419.276759:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787384419.277242:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203290624:0@lo:400:kworker.0 00000100:00100000:3.0:1787384419.776072:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4105f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203292160:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787384419.776147:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384419.778500:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203292160 00000100:00100000:1.0:1787384419.778513:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203292160 00000100:00100000:1.0:1787384419.778575:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787384419.778584:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203292160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787384419.778609:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787384419.783923:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203292160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5330us (7766us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384419.783950:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1787384419.784337:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4105f80 x1874208203292160/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384435 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384419.784361:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4105f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203292160:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787384420.278962:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384421.303714:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4104000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203292288:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787384421.303899:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384421.304129:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203292288 00000100:00100000:0.0:1787384421.304138:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203292288 00000100:00100000:0.0:1787384421.304193:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787384421.304202:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee117800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203292288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787384421.304237:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787384421.304283:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee117800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203292288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384421.304290:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:3.0:1787384421.304908:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384421.305183:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4104000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203292288:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787384421.730711:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384421.730753:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384421.730816:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384421.730843:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182249344 00000100:00100000:2.0:1787384421.730851:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182249344 00000100:00100000:2.0:1787384421.730923:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182249216 00000100:00100000:2.0:1787384421.730926:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182249216 00000100:00100000:2.0:1787384421.731061:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 111 00000100:00100000:2.0:1787384421.731072:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee114700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2413:x1874208182249344:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384421.731147:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee114700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2413:x1874208182249344:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 77us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384421.731155:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 111 00000100:00100000:2.0:1787384421.731173:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 112 00000100:00100000:2.0:1787384421.731193:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2413:x1874208182249216:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384421.731221:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2413:x1874208182249216:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 28us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384421.731227:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 112 00000100:00080000:2.0:1787384421.731248:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787384421.731252:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787384421.731797:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182249088 00000100:00100000:3.0:1787384421.731804:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182249088 00000100:00100000:3.0:1787384421.731841:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 284 00000100:00100000:3.0:1787384421.731848:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+10:2413:x1874208182249088:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384421.731880:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+10:2413:x1874208182249088:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 33us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384421.731898:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 284 00000100:00100000:2.0:1787384421.821997:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787384421.822025:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7de3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203292416:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787384421.822095:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384421.822167:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203292416 00000100:00100000:2.0:1787384421.822175:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203292416 00000100:00100000:2.0:1787384421.822218:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787384421.822227:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd75a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203292416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787384421.822259:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787384421.822302:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd75a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203292416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384421.822308:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787384421.822351:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7de3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203292416:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787384422.331764:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384423.352251:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384423.863529:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4106d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203292544:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787384423.863720:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384423.863800:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203292544 00000100:00100000:0.0:1787384423.863807:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203292544 00000100:00100000:2.0:1787384423.863814:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787384423.863822:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd75aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203292672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787384423.863880:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787384423.863890:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd75a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203292544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787384423.863918:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787384423.863971:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd75a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203292544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384423.863978:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1787384423.864191:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787384423.864918:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787384423.865104:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4106d80 x1874208203292544/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384439 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384423.865124:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4106d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203292544:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787384423.867358:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203292672 00000100:00100000:0.0:1787384423.867370:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203292672 00000100:00100000:0.0:1787384423.867510:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787384423.867520:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd758000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203292672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787384423.867556:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787384423.867628:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd758000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203292672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (3080us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384423.867635:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1787384423.867679:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8fd75aa00 x1874208203292672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384439 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384423.867696:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd75aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203292672:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787384423.868518:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787384424.376263:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3adbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874208203293184:0@lo:400:kworker.0 00000100:00100000:2.0:1787384424.376340:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384424.376405:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ad9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203293696:0@lo:400:kworker.0 00000100:00100000:2.0:1787384424.376451:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384424.376475:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3559180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203294208:0@lo:400:kworker.0 00000100:00100000:2.0:1787384424.376498:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384424.376539:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787384424.376547:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3adb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203293056:0@lo:400:kworker.0 00000100:00100000:2.0:1787384424.376585:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384424.376606:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874208203293568:0@lo:400:kworker.0 00000100:00100000:2.0:1787384424.376628:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384424.376643:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c355aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874208203294080:0@lo:400:kworker.0 00000100:00100000:2.0:1787384424.376663:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384424.376693:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203293184 00000100:00100000:2.0:1787384424.376701:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203293184 00000100:00100000:2.0:1787384424.376758:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203293568 00000100:00100000:2.0:1787384424.376762:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203293568 00000100:00100000:2.0:1787384424.376811:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203294080 00000100:00100000:2.0:1787384424.376815:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203294080 00000100:00100000:2.0:1787384424.376833:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787384424.376840:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3559f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874208203293184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384424.376891:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3559f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874208203293184:12345-0@lo:400:kworker.0 Request processed in 50us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384424.376899:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787384424.376915:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787384424.376921:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874208203293568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384424.376959:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874208203293568:12345-0@lo:400:kworker.0 Request processed in 38us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384424.376966:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787384424.376978:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787384424.376983:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874208203294080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384424.377009:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874208203294080:12345-0@lo:400:kworker.0 Request processed in 26us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384424.377014:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787384424.377031:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203293056 00000100:00100000:2.0:1787384424.377035:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203293056 00000100:00100000:2.0:1787384424.377056:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787384424.377062:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203293056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384424.377092:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203293056:12345-0@lo:400:kworker.0 Request processed in 31us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384424.377098:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787384424.377139:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3adb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203293056:0@lo:400:kworker.0 00010000:00080000:2.0:1787384424.377153:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3ada680 x1874208203293568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384424.377163:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874208203293568:0@lo:400:kworker.0 00010000:00080000:2.0:1787384424.377172:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c355aa00 x1874208203294080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384424.377181:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c355aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874208203294080:0@lo:400:kworker.0 00000100:00100000:2.0:1787384424.377190:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3adbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874208203293184:0@lo:400:kworker.0 00000100:00100000:3.0:1787384424.379951:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd75bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203292800:0@lo:400:kworker.0 00000100:00100000:3.0:1787384424.380034:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384424.380079:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203293312:0@lo:400:kworker.0 00000100:00100000:3.0:1787384424.380107:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384424.380130:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c355b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203293824:0@lo:400:kworker.0 00000100:00100000:3.0:1787384424.380150:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384424.380167:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c355b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203294336:0@lo:400:kworker.0 00000100:00100000:3.0:1787384424.380186:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384424.380208:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787384424.380214:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd75aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203292928:0@lo:400:kworker.0 00000100:00100000:3.0:1787384424.380239:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384424.380257:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ad8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203293440:0@lo:400:kworker.0 00000100:00100000:3.0:1787384424.380276:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384424.380370:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3559880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874208203293952:0@lo:400:kworker.0 00000100:00100000:3.0:1787384424.380391:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384424.380416:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203293696 00000100:00100000:3.0:1787384424.380423:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203293696 00000100:00100000:3.0:1787384424.380502:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203294208 00000100:00100000:3.0:1787384424.380506:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203294208 00000100:00100000:3.0:1787384424.380519:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203293824 00000100:00100000:3.0:1787384424.380521:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203293824 00000100:00100000:3.0:1787384424.380529:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203294336 00000100:00100000:3.0:1787384424.380530:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203294336 00000100:00100000:3.0:1787384424.380542:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787384424.380548:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203293696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384424.380602:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203293696:12345-0@lo:400:kworker.0 Request processed in 53us (4151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384424.380609:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787384424.380624:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787384424.380630:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203294208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384424.380662:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203294208:12345-0@lo:400:kworker.0 Request processed in 32us (4163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384424.380668:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787384424.380679:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787384424.380684:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203293824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384424.380714:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203293824:12345-0@lo:400:kworker.0 Request processed in 29us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384424.380720:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787384424.380730:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787384424.380736:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203294336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384424.380807:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203294336:12345-0@lo:400:kworker.0 Request processed in 71us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384424.380813:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787384424.380838:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203292800 00000100:00100000:3.0:1787384424.380841:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203292800 00000100:00100000:3.0:1787384424.380865:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1787384424.380870:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3651:x1874208203292800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384424.380899:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3651:x1874208203292800:12345-0@lo:400:kworker.0 Request processed in 28us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384424.380904:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1787384424.380931:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203293312 00000100:00100000:3.0:1787384424.380934:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203293312 00000100:00100000:3.0:1787384424.380956:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787384424.380961:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203293312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384424.380990:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203293312:12345-0@lo:400:kworker.0 Request processed in 29us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384424.380995:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787384424.381029:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd75bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203292800:0@lo:400:kworker.0 00000100:00100000:3.0:1787384424.381041:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203293312:0@lo:400:kworker.0 00010000:00080000:3.0:1787384424.381052:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c355b480 x1874208203293824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384424.381062:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c355b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203293824:0@lo:400:kworker.0 00010000:00080000:3.0:1787384424.381070:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c355b800 x1874208203294336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384424.381088:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c355b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203294336:0@lo:400:kworker.0 00000100:00100000:3.0:1787384424.381130:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203292928 00000100:00100000:3.0:1787384424.381134:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203292928 00000100:00100000:3.0:1787384424.381153:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203293440 00000100:00100000:3.0:1787384424.381155:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203293440 00000100:00100000:3.0:1787384424.381164:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203293952 00000100:00100000:3.0:1787384424.381166:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203293952 00000100:00100000:3.0:1787384424.381177:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787384424.381182:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203292928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384424.381219:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203292928:12345-0@lo:400:kworker.0 Request processed in 36us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384424.381225:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787384424.381235:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787384424.381240:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203293440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384424.381266:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203293440:12345-0@lo:400:kworker.0 Request processed in 26us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384424.381271:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787384424.382991:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4105180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203294464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384424.383052:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384424.383104:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203294464 00000100:00100000:0.0:1787384424.383110:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203294464 00000100:00100000:0.0:1787384424.383161:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787384424.383171:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4106300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203294464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787384424.383196:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787384424.383235:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4106300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203294464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384424.383256:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1787384424.383309:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4105180 x1874208203294464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384440 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384424.383327:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4105180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203294464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384424.383381:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787384424.383390:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874208203293952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384424.383423:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874208203293952:12345-0@lo:400:kworker.0 Request processed in 35us (3030us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384424.383428:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:0.0:1787384424.383457:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787384424.383462:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787384424.383464:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787384424.384054:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd75aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203292928:0@lo:400:kworker.0 00000100:00100000:3.0:1787384424.384070:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ad8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203293440:0@lo:400:kworker.0 00000100:00100000:3.0:1787384424.384080:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3559880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874208203293952:0@lo:400:kworker.0 00010000:00080000:3.0:1787384424.384128:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3ad9180 x1874208203293696/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384424.384137:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ad9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203293696:0@lo:400:kworker.0 00010000:00080000:3.0:1787384424.384154:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3559180 x1874208203294208/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384424.384172:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3559180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203294208:0@lo:400:kworker.0 00010000:00010000:1.0:1787384424.384722:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384424.887595:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4105180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203294592:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787384424.887669:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384424.887956:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203294592 00000100:00100000:3.0:1787384424.887964:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203294592 00000100:00100000:3.0:1787384424.888008:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787384424.888026:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee28b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203294592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787384424.888053:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787384424.891555:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee28b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203294592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3522us (3877us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384424.891569:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1787384424.893568:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4105180 x1874208203294592/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384440 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384424.893593:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4105180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203294592:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787384425.400821:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384426.423016:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384426.423025:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384426.423047:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7de1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203294720:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787384426.423148:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384426.423357:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203294720 00000100:00100000:0.0:1787384426.423365:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203294720 00000100:00100000:0.0:1787384426.423410:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787384426.423419:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203294720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787384426.424217:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787384426.424356:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203294720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 937us (1207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384426.424365:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787384426.424437:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7de1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203294720:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787384426.850075:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384426.850122:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384426.850144:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384426.850319:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182249472 00000100:00100000:0.0:1787384426.850329:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182249472 00000100:00100000:0.0:1787384426.850374:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 286 00000100:00100000:0.0:1787384426.850383:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+10:2415:x1874208182249472:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384426.850477:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+10:2415:x1874208182249472:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 94us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384426.850486:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 286 00000100:00100000:0.0:1787384426.850521:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182249728 00000100:00100000:0.0:1787384426.850525:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182249728 00000100:00100000:0.0:1787384426.850557:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182249600 00000100:00100000:0.0:1787384426.850561:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182249600 00000100:00100000:0.0:1787384426.850580:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 119 00000100:00100000:0.0:1787384426.850587:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2415:x1874208182249728:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384426.850618:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2415:x1874208182249728:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 32us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384426.850625:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 119 00000100:00100000:0.0:1787384426.850637:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 120 00000100:00100000:0.0:1787384426.850643:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2415:x1874208182249600:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384426.850667:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2415:x1874208182249600:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 25us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384426.850673:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 120 00000100:00080000:0.0:1787384426.850700:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787384426.850704:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787384426.940934:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7de1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203294848:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787384426.941071:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384426.941161:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203294848 00000100:00100000:3.0:1787384426.941169:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203294848 00000100:00100000:3.0:1787384426.941217:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787384426.941225:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4107800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203294848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787384426.941256:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787384426.941309:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4107800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203294848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384426.941316:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787384426.941423:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7de1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203294848:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787384427.450580:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384428.474558:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384428.984397:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787384428.984424:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203294976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787384428.984483:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384428.984538:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203294976 00000100:00100000:2.0:1787384428.984545:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203294976 00000100:00100000:2.0:1787384428.984598:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787384428.984607:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203294976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787384428.984634:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384428.984676:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203294976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384428.984683:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1787384428.985121:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787384428.985154:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c2a02a00 x1874208203294976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384444 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384428.985175:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203294976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787384428.985528:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7de2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203295104:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787384428.985567:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384428.986101:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203295104 00000100:00100000:3.0:1787384428.986107:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203295104 00000100:00100000:3.0:1787384428.986161:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787384428.986170:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee28bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203295104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787384428.986186:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787384428.986226:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee28bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203295104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384428.986233:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1787384428.986366:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7de2300 x1874208203295104/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384444 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384428.986382:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7de2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203295104:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787384428.986812:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787384429.496092:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384429.496224:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4104380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203295232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787384429.496298:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384429.497141:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203295232 00000100:00100000:0.0:1787384429.497150:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203295232 00000100:00100000:0.0:1787384429.497216:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787384429.497228:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203295232:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787384429.497260:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1787384429.497275:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787384429.497344:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203295232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384429.497352:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1787384429.497443:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4104380 x1874208203295232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384445 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384429.497463:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4104380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203295232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384429.504544:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7de0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203295360:0@lo:400:kworker.0 00000100:00100000:0.0:1787384429.504625:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384429.504694:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd75bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203295872:0@lo:400:kworker.0 00000100:00100000:0.0:1787384429.504732:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384429.504759:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787384429.504766:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7de2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203295488:0@lo:400:kworker.0 00000100:00100000:0.0:1787384429.504821:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384429.505280:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203296000:0@lo:400:kworker.0 00000100:00100000:0.0:1787384429.505310:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384429.505345:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203295872 00000100:00100000:0.0:1787384429.505352:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203295872 00000100:00100000:0.0:1787384429.505393:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787384429.505401:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4105880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203295872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384429.505461:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4105880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203295872:12345-0@lo:400:kworker.0 Request processed in 59us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384429.505468:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787384429.505489:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203295488 00000100:00100000:0.0:1787384429.505493:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203295488 00000100:00100000:0.0:1787384429.505516:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203296000 00000100:00100000:0.0:1787384429.505519:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203296000 00000100:00100000:0.0:1787384429.505543:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787384429.505548:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4104a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203295488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384429.505600:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4104a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203295488:12345-0@lo:400:kworker.0 Request processed in 52us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384429.505606:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787384429.505617:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787384429.505621:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4107100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203296000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384429.505645:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4107100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203296000:12345-0@lo:400:kworker.0 Request processed in 23us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384429.505650:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:1.0:1787384429.506645:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384429.506666:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd75aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874208203295744:0@lo:400:kworker.0 00000100:00100000:1.0:1787384429.506736:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384429.506801:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787384429.506810:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7de1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203295616:0@lo:400:kworker.0 00000100:00100000:1.0:1787384429.506967:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384429.507121:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203295616 00000100:00100000:1.0:1787384429.507128:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203295616 00000100:00100000:1.0:1787384429.507165:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787384429.507173:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203295616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384429.507221:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203295616:12345-0@lo:400:kworker.0 Request processed in 49us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384429.507228:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787384429.507251:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203295744 00000100:00100000:1.0:1787384429.507254:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203295744 00000100:00100000:1.0:1787384429.507277:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787384429.507283:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874208203295744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384429.507311:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874208203295744:12345-0@lo:400:kworker.0 Request processed in 28us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384429.507317:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787384429.507354:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7de1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203295616:0@lo:400:kworker.0 00000100:00100000:1.0:1787384429.507366:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd75aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874208203295744:0@lo:400:kworker.0 00000100:00100000:3.0:1787384429.507828:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203295360 00000100:00100000:3.0:1787384429.507844:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203295360 00000100:00100000:3.0:1787384429.507878:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1787384429.507886:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3651:x1874208203295360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384429.507927:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3651:x1874208203295360:12345-0@lo:400:kworker.0 Request processed in 43us (3307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384429.507934:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1787384429.508209:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203296128:0@lo:400:kworker.0 00000100:00100000:3.0:1787384429.508242:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384429.508293:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384429.508299:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203296256:0@lo:400:kworker.0 00000100:00100000:3.0:1787384429.508322:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384429.508657:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7de2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203295488:0@lo:400:kworker.0 00000100:00100000:0.0:1787384429.509823:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203296000:0@lo:400:kworker.0 00000100:00100000:0.0:1787384429.510168:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7de0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203295360:0@lo:400:kworker.0 00000100:00100000:0.0:1787384429.510181:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd75bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203295872:0@lo:400:kworker.0 00000100:00100000:0.0:1787384429.510218:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203296384:0@lo:400:kworker.0 00000100:00100000:0.0:1787384429.510272:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384429.510308:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787384429.510315:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203296512:0@lo:400:kworker.0 00000100:00100000:0.0:1787384429.510339:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384429.510999:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203296128 00000100:00100000:3.0:1787384429.511170:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203296256 00000100:00100000:3.0:1787384429.511175:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203296256 00000100:00100000:3.0:1787384429.511228:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203296384 00000100:00100000:3.0:1787384429.511232:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203296384 00000100:00100000:3.0:1787384429.511267:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787384429.511276:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874208203296256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384429.511342:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874208203296256:12345-0@lo:400:kworker.0 Request processed in 67us (3018us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384429.511349:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787384429.511368:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787384429.511374:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4104e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874208203296384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384429.511408:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4104e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874208203296384:12345-0@lo:400:kworker.0 Request processed in 33us (1135us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384429.511414:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787384429.511432:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203296512 00000100:00100000:3.0:1787384429.511435:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203296512 00000100:00100000:3.0:1787384429.511461:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787384429.511467:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4106a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203296512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384429.511497:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4106a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203296512:12345-0@lo:400:kworker.0 Request processed in 30us (1157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384429.511503:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787384429.511549:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203296256:0@lo:400:kworker.0 00010000:00080000:3.0:1787384429.511594:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c422d180 x1874208203296512/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384429.511604:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203296512:0@lo:400:kworker.0 00010000:00080000:3.0:1787384429.511615:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7dbc380 x1874208203296384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384429.511622:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203296384:0@lo:400:kworker.0 00000100:00100000:1.0:1787384429.511900:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203296128 00000100:00100000:1.0:1787384429.511935:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787384429.511942:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203296128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384429.511987:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203296128:12345-0@lo:400:kworker.0 Request processed in 45us (3744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384429.512005:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00010000:00080000:1.0:1787384429.513317:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7dbdc00 x1874208203296128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384429.513329:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203296128:0@lo:400:kworker.0 00000100:00080000:0.0:1787384429.513761:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787384429.513768:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787384429.513771:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384430.007480:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787384430.007507:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4107b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203296640:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787384430.007576:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384430.007760:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203296640 00000100:00100000:3.0:1787384430.007768:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203296640 00000100:00100000:3.0:1787384430.007857:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787384430.007868:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203296640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787384430.007890:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787384430.007934:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203296640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384430.007942:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1787384430.008080:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4107b80 x1874208203296640/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384430.008100:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4107b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203296640:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787384430.519167:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384431.543744:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787384431.543769:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203296768:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787384431.543879:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787384431.544595:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384431.545281:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203296768 00000100:00100000:3.0:1787384431.545293:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203296768 00000100:00100000:3.0:1787384431.545366:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787384431.545377:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee146d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203296768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787384431.545418:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787384431.545506:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee146d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203296768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (1627us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384431.545513:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787384431.546859:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203296768:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787384431.969927:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384431.969965:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384431.970001:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384431.970100:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182250112 00000100:00100000:2.0:1787384431.970109:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182250112 00000100:00080000:0.0:1787384431.970200:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787384431.970240:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182249984 00000100:00100000:2.0:1787384431.970244:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182249984 00000100:00100000:3.0:1787384431.970328:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182249856 00000100:00100000:3.0:1787384431.970333:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182249856 00000100:00100000:3.0:1787384431.970361:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 288 00000100:00100000:3.0:1787384431.970369:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+10:2416:x1874208182249856:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384431.970428:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+10:2416:x1874208182249856:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 60us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384431.970435:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 288 00000100:00100000:1.0:1787384431.971860:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 127 00000100:00080000:1.0:1787384431.972006:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787384431.972154:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4107b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2416:x1874208182250112:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384431.972268:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4107b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2416:x1874208182250112:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 397us (2301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384431.972288:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 127 00000100:00100000:3.0:1787384431.972311:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 128 00000100:00100000:3.0:1787384431.972318:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4104380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2416:x1874208182249984:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384431.972343:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4104380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2416:x1874208182249984:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 26us (2342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384431.972349:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 128 00000100:00100000:1.0:1787384432.057804:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787384432.062699:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203296896:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787384432.062933:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384432.063147:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203296896 00000100:00100000:0.0:1787384432.063154:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203296896 00000100:00100000:0.0:1787384432.063232:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787384432.063240:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee146680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203296896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787384432.063273:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787384432.063321:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee146680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203296896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384432.063327:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787384432.063394:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203296896:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787384432.567295:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384433.591477:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384434.103370:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee147480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203297024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787384434.103469:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384434.105820:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203297024 00000100:00100000:2.0:1787384434.105833:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203297024 00000100:00100000:2.0:1787384434.105894:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787384434.105904:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203297024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787384434.105932:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384434.106002:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203297024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (2534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384434.106009:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1787384434.106228:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787384434.106315:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee147480 x1874208203297024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384450 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384434.106332:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee147480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203297024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787384434.107950:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787384434.109482:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203297152:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787384434.109551:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384434.109895:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203297152 00000100:00100000:3.0:1787384434.109904:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203297152 00000100:00100000:3.0:1787384434.109961:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787384434.109970:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203297152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787384434.109995:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787384434.110045:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203297152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384434.110052:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1787384434.110093:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c422ce00 x1874208203297152/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384450 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384434.110111:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203297152:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787384434.110999:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787384434.618287:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4105f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874208203297664:0@lo:400:kworker.0 00000100:00100000:0.0:1787384434.618387:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384434.618464:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203298176:0@lo:400:kworker.0 00000100:00100000:0.0:1787384434.618489:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384434.618525:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787384434.618531:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4105180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203297280:0@lo:400:kworker.0 00000100:00100000:0.0:1787384434.618563:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384434.618583:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4105c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203297792:0@lo:400:kworker.0 00000100:00100000:0.0:1787384434.618615:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384434.618632:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874208203298304:0@lo:400:kworker.0 00000100:00100000:0.0:1787384434.618654:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384434.618695:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203297664 00000100:00100000:0.0:1787384434.618704:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203297664 00000100:00100000:0.0:1787384434.618764:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203298176 00000100:00100000:0.0:1787384434.618767:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203298176 00000100:00100000:3.0:1787384434.618971:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203298304 00000100:00100000:3.0:1787384434.618976:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203298304 00000100:00100000:0.0:1787384434.619039:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787384434.619048:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874208203297664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384434.619129:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874208203297664:12345-0@lo:400:kworker.0 Request processed in 80us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384434.619137:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787384434.619157:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787384434.619165:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874208203298176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384434.619194:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874208203298176:12345-0@lo:400:kworker.0 Request processed in 31us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384434.619200:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787384434.619252:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4105f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874208203297664:0@lo:400:kworker.0 00000100:00100000:0.0:1787384434.619265:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203298176:0@lo:400:kworker.0 00010000:00010000:1.0:1787384434.619470:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384434.619495:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4106d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203297408:0@lo:400:kworker.0 00000100:00100000:1.0:1787384434.619535:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384434.619568:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203297920:0@lo:400:kworker.0 00000100:00100000:1.0:1787384434.619592:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384434.619610:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203298432:0@lo:400:kworker.0 00000100:00100000:1.0:1787384434.619638:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384434.619665:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787384434.619682:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4104000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203297536:0@lo:400:kworker.0 00000100:00100000:1.0:1787384434.619707:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384434.619725:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874208203298048:0@lo:400:kworker.0 00000100:00100000:1.0:1787384434.619750:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384434.619766:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203298560:0@lo:400:kworker.0 00000100:00100000:1.0:1787384434.619818:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384434.619852:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203297280 00000100:00100000:1.0:1787384434.619858:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203297280 00000100:00100000:1.0:1787384434.619894:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1787384434.619901:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3653:x1874208203297280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384434.619949:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3653:x1874208203297280:12345-0@lo:400:kworker.0 Request processed in 48us (1385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384434.619955:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1787384434.619985:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203297792 00000100:00100000:1.0:1787384434.619988:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203297792 00000100:00100000:1.0:1787384434.620009:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203297536 00000100:00100000:1.0:1787384434.620011:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203297536 00000100:00100000:1.0:1787384434.620022:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787384434.620027:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc25f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203297792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384434.620067:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc25f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203297792:12345-0@lo:400:kworker.0 Request processed in 40us (1452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384434.620073:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787384434.620356:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787384434.620362:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203297536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384434.620398:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203297536:12345-0@lo:400:kworker.0 Request processed in 36us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384434.620404:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787384434.620562:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203297408 00000100:00100000:0.0:1787384434.620566:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203297408 00000100:00100000:0.0:1787384434.620587:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203297920 00000100:00100000:0.0:1787384434.620590:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203297920 00000100:00100000:3.0:1787384434.622022:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203298048 00000100:00100000:3.0:1787384434.622036:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203298048 00000100:00100000:3.0:1787384434.622069:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787384434.622078:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd75bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203297408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384434.622186:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd75bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203297408:12345-0@lo:400:kworker.0 Request processed in 107us (2649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384434.622208:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787384434.622228:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787384434.622234:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874208203298304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384434.622271:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874208203298304:12345-0@lo:400:kworker.0 Request processed in 37us (3616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384434.622276:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787384434.622290:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787384434.622295:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874208203298048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384434.622322:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874208203298048:12345-0@lo:400:kworker.0 Request processed in 27us (2572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384434.622328:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787384434.622360:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203298432 00000100:00100000:3.0:1787384434.622365:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203298432 00000100:00100000:3.0:1787384434.622488:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203298560 00000100:00100000:3.0:1787384434.622493:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203298560 00000100:00100000:3.0:1787384434.622517:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787384434.622523:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203298432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384434.622560:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203298432:12345-0@lo:400:kworker.0 Request processed in 37us (2921us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384434.622566:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787384434.622578:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787384434.622583:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203298560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384434.622611:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203298560:12345-0@lo:400:kworker.0 Request processed in 29us (2793us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384434.622617:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787384434.622659:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787384434.622685:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203298688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787384434.622733:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384434.622931:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203298688 00000100:00100000:3.0:1787384434.622936:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203298688 00000100:00100000:3.0:1787384434.622967:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787384434.622974:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203298688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787384434.623001:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787384434.623038:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203298688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384434.623044:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:3.0:1787384434.623086:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c35d9c00 x1874208203298688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384450 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384434.623107:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203298688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787384434.623194:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4105180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203297280:0@lo:400:kworker.0 00000100:00100000:3.0:1787384434.623208:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4105c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203297792:0@lo:400:kworker.0 00010000:00080000:3.0:1787384434.623223:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7dbf480 x1874208203298304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384434.623232:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874208203298304:0@lo:400:kworker.0 00000100:00080000:1.0:1787384434.623755:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787384434.623765:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787384434.623768:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384434.623833:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4104000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203297536:0@lo:400:kworker.0 00010000:00080000:1.0:1787384434.623849:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7dbc380 x1874208203298048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384434.623859:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874208203298048:0@lo:400:kworker.0 00010000:00080000:1.0:1787384434.623870:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c35d9f80 x1874208203298560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384434.623878:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203298560:0@lo:400:kworker.0 00000100:00100000:1.0:1787384434.623892:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4106d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203297408:0@lo:400:kworker.0 00010000:00080000:1.0:1787384434.623905:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c35daa00 x1874208203298432/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384434.623912:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203298432:0@lo:400:kworker.0 00000100:00080000:1.0:1787384434.624232:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384434.624302:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787384434.624313:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd75aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203297920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384434.624529:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd75aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203297920:12345-0@lo:400:kworker.0 Request processed in 218us (4934us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384434.624537:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787384434.628101:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203297920:0@lo:400:kworker.0 00000001:02000400:0.0:1787384434.890618:0:11998:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 03:40:32 (1787384432) === 00000100:00100000:2.0:1787384435.142872:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203298816:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787384435.142964:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384435.143047:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203298816 00000100:00100000:2.0:1787384435.143056:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203298816 00000100:00100000:2.0:1787384435.143185:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787384435.143194:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203298816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787384435.143287:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384435.143339:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203298816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 145us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384435.143347:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1787384435.143396:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c2a01180 x1874208203298816/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384451 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384435.143416:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203298816:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787384435.259193:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384435.259605:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182250240 00000100:00100000:3.0:1787384435.259618:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182250240 00000100:00100000:3.0:1787384435.259692:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 290 00000100:00100000:3.0:1787384435.259702:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+10:8732:x1874208182250240:12345-192.168.203.45@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787384435.259722:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384435.259760:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c2090000/0x7ef423838fba28b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3636 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384435.259837:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c2090000/0x7ef423838fba28b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3636 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384435.259850:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c2090000/0x7ef423838fba28b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3636 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384435.259860:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2090000, rc 0) 00000100:00100000:3.0:1787384435.259929:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+11:8732:x1874208182250240:12345-192.168.203.45@tcp:101:mount.lustre.0 Request processed in 228us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384435.259936:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 290 00000100:00100000:1.0:1787384435.263534:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384435.263773:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182250368 00000100:00100000:3.0:1787384435.263823:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182250368 00000100:00100000:3.0:1787384435.263893:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 291 00000100:00100000:3.0:1787384435.263904:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cacee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+11:8732:x1874208182250368:12345-192.168.203.45@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787384435.264128:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cacee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+11:8732:x1874208182250368:12345-192.168.203.45@tcp:501:mount.lustre.0 Request processed in 224us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384435.264137:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 291 00000100:00100000:0.0:1787384435.272123:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384435.272685:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182250496 00000100:00100000:1.0:1787384435.272701:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182250496 00000100:00100000:1.0:1787384435.272836:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 292 00000100:00100000:1.0:1787384435.272848:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cacecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+11:8732:x1874208182250496:12345-192.168.203.45@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787384435.273105:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cacecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+11:8732:x1874208182250496:12345-192.168.203.45@tcp:503:mount.lustre.0 Request processed in 259us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384435.273115:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 292 00000100:00100000:1.0:1787384435.277437:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384435.278155:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182250624 00000100:00100000:0.0:1787384435.278169:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182250624 00000100:00100000:0.0:1787384435.278297:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 293 00000100:00100000:0.0:1787384435.278309:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cacec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+11:8736:x1874208182250624:12345-192.168.203.45@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787384435.278970:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cacec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+11:8736:x1874208182250624:12345-192.168.203.45@tcp:502:llog_process_th.0 Request processed in 661us (1543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384435.278981:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 293 00000100:00100000:2.0:1787384435.314931:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384435.315225:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182250752 00000100:00100000:1.0:1787384435.315239:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182250752 00000100:00100000:1.0:1787384435.315322:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 294 00000100:00100000:1.0:1787384435.315334:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+11:8736:x1874208182250752:12345-192.168.203.45@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787384435.315688:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+11:8736:x1874208182250752:12345-192.168.203.45@tcp:502:llog_process_th.0 Request processed in 355us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384435.315698:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 294 00000100:00100000:3.0:1787384435.322456:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384435.322857:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182250880 00000100:00100000:0.0:1787384435.322871:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182250880 00000100:00100000:0.0:1787384435.322949:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 295 00000100:00100000:0.0:1787384435.322962:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+11:8736:x1874208182250880:12345-192.168.203.45@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787384435.323181:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+11:8736:x1874208182250880:12345-192.168.203.45@tcp:502:llog_process_th.0 Request processed in 220us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384435.323191:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 295 00000100:00100000:0.0:1787384435.331856:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384435.332592:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182251008 00000100:00100000:3.0:1787384435.332607:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182251008 00000100:00100000:3.0:1787384435.332700:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 296 00000100:00100000:3.0:1787384435.332712:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+11:8732:x1874208182251008:12345-192.168.203.45@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787384435.332735:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384435.332760:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c2090600/0x7ef423838fba28b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3667 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384435.333034:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c2090600/0x7ef423838fba28b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3667 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384435.333048:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c2090600/0x7ef423838fba28b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3667 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384435.333059:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2090600, rc 0) 00000100:00100000:3.0:1787384435.333137:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+12:8732:x1874208182251008:12345-192.168.203.45@tcp:101:mount.lustre.0 Request processed in 428us (1296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384435.333145:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 296 00000100:00100000:2.0:1787384435.339201:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384435.339407:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182251136 00000100:00100000:1.0:1787384435.339422:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182251136 00000100:00100000:1.0:1787384435.339498:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 297 00000100:00100000:1.0:1787384435.339512:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+12:8732:x1874208182251136:12345-192.168.203.45@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787384435.340001:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787384435.340040:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787384435.340045:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787384435.340049:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787384435.340053:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787384435.340055:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1787384435.344431:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+12:8732:x1874208182251136:12345-192.168.203.45@tcp:256:mount.lustre.0 Request processed in 4907us (5229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384435.344449:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 297 00000100:00100000:0.0:1787384435.350556:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384435.350870:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182251264 00000100:00100000:3.0:1787384435.350882:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182251264 00000100:00100000:3.0:1787384435.350955:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 298 00000100:00100000:3.0:1787384435.350965:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+12:8732:x1874208182251264:12345-192.168.203.45@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787384435.350985:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384435.351008:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c2090400/0x7ef423838fba28be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce366e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384435.351042:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c2090400/0x7ef423838fba28be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce366e expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384435.351054:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c2090400/0x7ef423838fba28be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce366e expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384435.351066:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2090400, rc 0) 00000100:00100000:3.0:1787384435.352156:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+13:8732:x1874208182251264:12345-192.168.203.45@tcp:101:mount.lustre.0 Request processed in 1180us (1603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384435.352193:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 298 00000100:00100000:1.0:1787384435.359051:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384435.361962:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182251392 00000100:00100000:2.0:1787384435.361985:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182251392 00000100:00100000:2.0:1787384435.362217:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 299 00000100:00100000:2.0:1787384435.362230:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+13:8732:x1874208182251392:12345-192.168.203.45@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787384435.362449:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+13:8732:x1874208182251392:12345-192.168.203.45@tcp:501:mount.lustre.0 Request processed in 220us (3414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384435.362458:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 299 00000100:00100000:1.0:1787384435.368548:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384435.368685:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182251520 00000100:00100000:0.0:1787384435.368698:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182251520 00000100:00100000:0.0:1787384435.368826:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 300 00000100:00100000:0.0:1787384435.368841:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+13:8732:x1874208182251520:12345-192.168.203.45@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787384435.369076:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+13:8732:x1874208182251520:12345-192.168.203.45@tcp:503:mount.lustre.0 Request processed in 237us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384435.369088:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 300 00000100:00100000:0.0:1787384435.372475:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384435.373008:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182251648 00000100:00100000:3.0:1787384435.373024:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182251648 00000100:00100000:3.0:1787384435.373149:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 301 00000100:00100000:3.0:1787384435.373160:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+13:8740:x1874208182251648:12345-192.168.203.45@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787384435.373359:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+13:8740:x1874208182251648:12345-192.168.203.45@tcp:502:llog_process_th.0 Request processed in 201us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384435.373369:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 301 00000100:00100000:1.0:1787384435.385538:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384435.385659:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182251776 00000100:00100000:2.0:1787384435.385681:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182251776 00000100:00100000:2.0:1787384435.385758:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 302 00000100:00100000:2.0:1787384435.385770:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+13:8740:x1874208182251776:12345-192.168.203.45@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787384435.386018:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+13:8740:x1874208182251776:12345-192.168.203.45@tcp:502:llog_process_th.0 Request processed in 250us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384435.386028:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 302 00000100:00100000:1.0:1787384435.394652:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384435.394705:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384435.394736:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384435.394809:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384435.397798:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182251904 00000100:00100000:0.0:1787384435.397821:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182251904 00000100:00100000:0.0:1787384435.397872:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182252160 00000100:00100000:0.0:1787384435.397875:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182252160 00000100:00100000:0.0:1787384435.397884:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182252544 00000100:00100000:0.0:1787384435.397887:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182252544 00000100:00100000:0.0:1787384435.397950:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182252672 00000100:00100000:0.0:1787384435.397954:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182252672 00000100:00100000:0.0:1787384435.397981:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 135 00000100:00100000:0.0:1787384435.397993:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2414:x1874208182252544:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384435.399632:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 16 00000100:00100000:2.0:1787384435.399646:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2412:x1874208182251904:12345-192.168.203.45@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787384435.399704:0:6523:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 25b82c0d-eb27-4f09-8c2a-c4cdc695d620@192.168.203.45@tcp t0 exp 0000000000000000 cur 330 last 0 00000020:00000080:2.0:1787384435.399744:0:6523:0:(genops.c:1406:class_connect()) connect: client 25b82c0d-eb27-4f09-8c2a-c4cdc695d620, cookie 0x7ef423838fba28c5 00000004:00100000:2.0:1787384435.399771:0:6523:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:2.0:1787384435.399962:0:6523:0:(import.c:65:import_set_state_nolock()) ffff98f8ee315000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787384435.400036:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+6:2412:x1874208182251904:12345-192.168.203.45@tcp:38:mount.lustre.0 Request processed in 390us (5394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384435.400044:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 16 00000100:00100000:2.0:1787384435.400069:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 136 00000100:00100000:2.0:1787384435.400078:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2414:x1874208182252672:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384435.400123:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2414:x1874208182252672:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 47us (5346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384435.400261:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2414:x1874208182252544:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 2262us (5515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384435.400275:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 135 00000100:00100000:0.0:1787384435.400310:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 17 00000100:00100000:0.0:1787384435.400317:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2412:x1874208182252160:12345-192.168.203.45@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787384435.400343:0:6522:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 25b82c0d-eb27-4f09-8c2a-c4cdc695d620@192.168.203.45@tcp t0 exp 0000000000000000 cur 330 last 0 00000100:00100000:2.0:1787384435.400371:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 136 00000020:00000080:0.0:1787384435.400382:0:6522:0:(genops.c:1406:class_connect()) connect: client 25b82c0d-eb27-4f09-8c2a-c4cdc695d620, cookie 0x7ef423838fba28cc 00000004:00100000:0.0:1787384435.400415:0:6522:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:0.0:1787384435.400544:0:6522:0:(import.c:65:import_set_state_nolock()) ffff98f8ee358000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1787384435.401749:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787384435.401758:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787384435.403260:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+6:2412:x1874208182252160:12345-192.168.203.45@tcp:38:mount.lustre.0 Request processed in 2925us (8537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384435.403278:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 17 00000100:00100000:1.0:1787384435.406745:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384435.406961:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182252032 00000100:00100000:2.0:1787384435.406972:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182252032 00000100:00100000:2.0:1787384435.407049:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 18 00000100:00100000:2.0:1787384435.407060:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+6:0:x1874208182252032:12345-192.168.203.45@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787384435.407111:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787384435.407223:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+6:0:x1874208182252032:12345-192.168.203.45@tcp:41:mount.lustre.0 Request processed in 164us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384435.407231:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 18 00000100:00080000:1.0:1787384435.409264:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384435.413680:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384435.413776:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182252416 00000100:00100000:3.0:1787384435.413825:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182252416 00000100:00100000:3.0:1787384435.413873:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 19 00000100:00100000:3.0:1787384435.413884:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7deb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+6:8732:x1874208182252416:12345-192.168.203.45@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787384435.413916:0:8195:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787384435.413989:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7deb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+6:8732:x1874208182252416:12345-192.168.203.45@tcp:41:mount.lustre.0 Request processed in 105us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384435.413997:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 19 00000100:00100000:0.0:1787384435.427969:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384435.428057:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384435.428282:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182252288 00000100:00100000:3.0:1787384435.428291:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182252288 00000100:00100000:3.0:1787384435.428350:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182252800 00000100:00100000:3.0:1787384435.428352:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182252800 00000100:00100000:3.0:1787384435.428372:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 20 00000100:00100000:3.0:1787384435.428380:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+6:0:x1874208182252288:12345-192.168.203.45@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787384435.428414:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787384435.428484:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+6:0:x1874208182252288:12345-192.168.203.45@tcp:41:mount.lustre.0 Request processed in 104us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384435.428506:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 20 00000100:00100000:3.0:1787384435.428523:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 21 00000100:00100000:3.0:1787384435.428528:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+6:8732:x1874208182252800:12345-192.168.203.45@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787384435.428553:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+6:8732:x1874208182252800:12345-192.168.203.45@tcp:40:mount.lustre.0 Request processed in 25us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384435.428559:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 21 00000100:00080000:1.0:1787384435.429295:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787384435.431118:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384435.431154:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384435.431182:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384435.431309:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182252928 00000100:00100000:0.0:1787384435.431318:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182252928 00000100:00100000:0.0:1787384435.431354:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182253056 00000100:00100000:0.0:1787384435.431356:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182253056 00000100:00100000:0.0:1787384435.431370:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 20 00000100:00100000:0.0:1787384435.431377:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2412:x1874208182252928:12345-192.168.203.45@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787384435.431407:0:8438:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 25b82c0d-eb27-4f09-8c2a-c4cdc695d620@192.168.203.45@tcp t0 exp 0000000000000000 cur 330 last 0 00000020:00000080:0.0:1787384435.431435:0:8438:0:(genops.c:1406:class_connect()) connect: client 25b82c0d-eb27-4f09-8c2a-c4cdc695d620, cookie 0x7ef423838fba28d3 00002000:00100000:0.0:1787384435.431446:0:8438:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 25b82c0d-eb27-4f09-8c2a-c4cdc695d620/ffff98f8ee35c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113671 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787384435.431456:0:8438:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:0.0:1787384435.431536:0:8438:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787384435.431562:0:8438:0:(import.c:65:import_set_state_nolock()) ffff98f8ee358800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787384435.431628:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+6:2412:x1874208182252928:12345-192.168.203.45@tcp:8:mount.lustre.0 Request processed in 249us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384435.431635:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 20 00000100:00100000:0.0:1787384435.431649:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 21 00000100:00100000:0.0:1787384435.431653:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2412:x1874208182253056:12345-192.168.203.45@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787384435.431678:0:8438:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 25b82c0d-eb27-4f09-8c2a-c4cdc695d620@192.168.203.45@tcp t0 exp 0000000000000000 cur 330 last 0 00000020:00000080:0.0:1787384435.431766:0:8438:0:(genops.c:1406:class_connect()) connect: client 25b82c0d-eb27-4f09-8c2a-c4cdc695d620, cookie 0x7ef423838fba28da 00002000:00100000:0.0:1787384435.431772:0:8438:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 25b82c0d-eb27-4f09-8c2a-c4cdc695d620/ffff98f8ee359000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113671 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787384435.431861:0:8438:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:0.0:1787384435.431899:0:8438:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787384435.431916:0:8438:0:(import.c:65:import_set_state_nolock()) ffff98f8efb59800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787384435.431941:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+6:2412:x1874208182253056:12345-192.168.203.45@tcp:8:mount.lustre.0 Request processed in 286us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384435.431947:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 21 00000100:00100000:3.0:1787384435.432598:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182253184 00000100:00100000:3.0:1787384435.432605:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182253184 00000100:00100000:3.0:1787384435.432703:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 5 00000100:00100000:3.0:1787384435.432713:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+6:8732:x1874208182253184:12345-192.168.203.45@tcp:900:mount.lustre.0 00000100:00100000:3.0:1787384435.432764:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+6:8732:x1874208182253184:12345-192.168.203.45@tcp:900:mount.lustre.0 Request processed in 52us (1655us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384435.432771:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 5 00000100:00100000:1.0:1787384435.445335:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384435.445437:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182253312 00000100:00100000:0.0:1787384435.445446:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182253312 00000100:00100000:0.0:1787384435.445508:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 1 00000100:00100000:0.0:1787384435.445519:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+6:8732:x1874208182253312:12345-192.168.203.45@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787384435.445647:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787384435.445755:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+6:8732:x1874208182253312:12345-192.168.203.45@tcp:33:mount.lustre.0 Request processed in 237us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384435.445762:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 1 00010000:00010000:0.0:1787384435.638945:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384436.664086:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384436.664178:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787384436.664200:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203298944:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787384436.664263:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384436.664316:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203298944 00000100:00100000:3.0:1787384436.664323:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203298944 00000100:00100000:3.0:1787384436.664366:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787384436.664374:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203298944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787384436.664407:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787384436.664447:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203298944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384436.664454:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787384436.664515:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203298944:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787384437.178992:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787384437.179017:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203299072:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787384437.179084:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384437.179696:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203299072 00000100:00100000:3.0:1787384437.179706:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203299072 00000100:00100000:3.0:1787384437.179762:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787384437.179772:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203299072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787384437.179840:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787384437.179894:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203299072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384437.179901:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787384437.180246:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203299072:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787384437.688692:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384438.711873:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384439.223490:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787384439.226729:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203299328:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787384439.226838:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384439.226895:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203299200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787384439.226915:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384439.227357:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203299328 00000100:00100000:2.0:1787384439.227364:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203299328 00000100:00100000:2.0:1787384439.227420:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203299200 00000100:00100000:2.0:1787384439.227424:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203299200 00000100:00100000:2.0:1787384439.227441:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787384439.227450:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203299328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787384439.227478:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384439.227536:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203299328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384439.227543:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787384439.227558:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787384439.227565:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203299200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787384439.227574:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384439.227597:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203299200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 32us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384439.227602:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1787384439.227715:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f54f8000 x1874208203299328/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384439.227736:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203299328:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1787384439.227747:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f54fbb80 x1874208203299200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384439.227757:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203299200:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787384439.227903:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787384439.737512:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384439.737975:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203299712:0@lo:400:kworker.0 00000100:00100000:1.0:1787384439.738040:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384439.738116:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203300224:0@lo:400:kworker.0 00000100:00100000:1.0:1787384439.738141:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384439.738161:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203300736:0@lo:400:kworker.0 00000100:00100000:1.0:1787384439.738181:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384439.738210:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787384439.738217:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874208203299840:0@lo:400:kworker.0 00000100:00100000:1.0:1787384439.738238:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384439.738252:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203300352:0@lo:400:kworker.0 00000100:00100000:1.0:1787384439.738271:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384439.738297:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203300736 00000100:00100000:1.0:1787384439.738305:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203300736 00000100:00100000:1.0:1787384439.738354:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787384439.738365:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203300736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384439.738415:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203300736:12345-0@lo:400:kworker.0 Request processed in 53us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384439.738422:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1787384439.738476:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c2a00000 x1874208203300736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384439.738489:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203300736:0@lo:400:kworker.0 00000100:00100000:3.0:1787384439.738647:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874208203299584:0@lo:400:kworker.0 00000100:00100000:3.0:1787384439.738678:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384439.738694:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874208203300096:0@lo:400:kworker.0 00000100:00100000:3.0:1787384439.738713:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384439.738725:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203300608:0@lo:400:kworker.0 00000100:00100000:3.0:1787384439.738741:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384439.738764:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787384439.738770:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203299456:0@lo:400:kworker.0 00000100:00100000:3.0:1787384439.738816:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384439.738846:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203299968:0@lo:400:kworker.0 00000100:00100000:3.0:1787384439.738868:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384439.738884:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874208203300480:0@lo:400:kworker.0 00000100:00100000:3.0:1787384439.738903:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384439.738923:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203300224 00000100:00100000:3.0:1787384439.738926:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203300224 00000100:00100000:3.0:1787384439.738950:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203299840 00000100:00100000:3.0:1787384439.738953:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203299840 00000100:00100000:3.0:1787384439.738964:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203300352 00000100:00100000:3.0:1787384439.738966:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203300352 00000100:00100000:3.0:1787384439.738975:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203299584 00000100:00100000:3.0:1787384439.738977:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203299584 00000100:00100000:3.0:1787384439.738985:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203300096 00000100:00100000:3.0:1787384439.738987:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203300096 00000100:00100000:3.0:1787384439.738996:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203300480 00000100:00100000:3.0:1787384439.738998:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203300480 00000100:00100000:3.0:1787384439.739009:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787384439.739015:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203300224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384439.739049:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203300224:12345-0@lo:400:kworker.0 Request processed in 34us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384439.739054:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787384439.739066:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787384439.739071:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874208203299840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384439.739092:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874208203299840:12345-0@lo:400:kworker.0 Request processed in 21us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384439.739097:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787384439.739106:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787384439.739111:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874208203300352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384439.739144:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874208203300352:12345-0@lo:400:kworker.0 Request processed in 32us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384439.739149:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787384439.739158:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787384439.739163:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874208203299584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384439.739189:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874208203299584:12345-0@lo:400:kworker.0 Request processed in 26us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384439.739195:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787384439.739205:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787384439.739210:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874208203300096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384439.739234:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874208203300096:12345-0@lo:400:kworker.0 Request processed in 24us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384439.739239:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787384439.739249:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787384439.739254:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874208203300480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384439.739278:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874208203300480:12345-0@lo:400:kworker.0 Request processed in 25us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384439.739283:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787384439.739301:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203300608 00000100:00100000:3.0:1787384439.739304:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203300608 00000100:00100000:3.0:1787384439.739325:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787384439.739331:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203300608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384439.739361:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203300608:12345-0@lo:400:kworker.0 Request processed in 30us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384439.739366:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787384439.739589:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203299712 00000100:00100000:2.0:1787384439.739595:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203299712 00000100:00100000:2.0:1787384439.739623:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203299968 00000100:00100000:2.0:1787384439.739625:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203299968 00000100:00100000:2.0:1787384439.739651:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787384439.739658:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203299712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384439.739694:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203299712:12345-0@lo:400:kworker.0 Request processed in 36us (1654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384439.739700:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787384439.739711:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787384439.739717:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203299968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384439.739745:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203299968:12345-0@lo:400:kworker.0 Request processed in 27us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384439.739751:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787384439.739848:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203299968:0@lo:400:kworker.0 00010000:00080000:2.0:1787384439.739861:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c2a02680 x1874208203300480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384439.739871:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874208203300480:0@lo:400:kworker.0 00000100:00100000:2.0:1787384439.739882:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874208203299584:0@lo:400:kworker.0 00000100:00100000:2.0:1787384439.739891:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874208203300096:0@lo:400:kworker.0 00010000:00080000:2.0:1787384439.739901:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c2a01500 x1874208203300608/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384439.739909:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203300608:0@lo:400:kworker.0 00000100:00100000:1.0:1787384439.740153:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874208203299840:0@lo:400:kworker.0 00000100:00100000:1.0:1787384439.740164:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203300352:0@lo:400:kworker.0 00000100:00100000:1.0:1787384439.740174:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203299712:0@lo:400:kworker.0 00010000:00080000:1.0:1787384439.740186:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c2a03480 x1874208203300224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384439.740219:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203300224:0@lo:400:kworker.0 00000100:00100000:1.0:1787384439.740235:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787384439.740242:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203300864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787384439.740275:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384439.740349:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203300864 00000100:00100000:3.0:1787384439.740353:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203300864 00000100:00100000:3.0:1787384439.740388:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787384439.740395:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203300864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787384439.740416:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787384439.740446:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203300864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384439.740452:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787384439.740532:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203299456 00000100:00100000:0.0:1787384439.740537:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203299456 00000100:00100000:0.0:1787384439.740569:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1787384439.740575:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3652:x1874208203299456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384439.740608:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3652:x1874208203299456:12345-0@lo:400:kworker.0 Request processed in 34us (1793us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384439.740614:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00080000:0.0:1787384439.740648:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787384439.740653:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787384439.740655:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787384439.740718:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f54f9880 x1874208203300864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384439.740730:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203300864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787384439.740939:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203299456:0@lo:400:kworker.0 00000100:00100000:1.0:1787384440.254996:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203300992:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787384440.255067:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384440.255247:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203300992 00000100:00100000:3.0:1787384440.255255:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203300992 00000100:00100000:3.0:1787384440.255307:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787384440.255316:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203300992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787384440.255349:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787384440.255402:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203300992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384440.255408:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:0.0:1787384440.255584:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c35d8700 x1874208203300992/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384456 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384440.255603:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203300992:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787384440.680022:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384440.680108:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384440.680131:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384440.680156:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384440.680175:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384440.680192:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384440.680215:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384440.680239:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182253696 00000100:00100000:1.0:1787384440.680247:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182253696 00000100:00100000:1.0:1787384440.680292:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182253952 00000100:00100000:1.0:1787384440.680295:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182253952 00000100:00100000:1.0:1787384440.680315:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182253568 00000100:00100000:1.0:1787384440.680318:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182253568 00000100:00100000:1.0:1787384440.680331:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182253824 00000100:00100000:1.0:1787384440.680334:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182253824 00000100:00100000:1.0:1787384440.680349:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 143 00000100:00100000:1.0:1787384440.680357:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2415:x1874208182253696:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384440.680401:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 144 00000100:00100000:3.0:1787384440.680415:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+6:2415:x1874208182253952:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384440.680439:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2415:x1874208182253696:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 80us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384440.680449:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 143 00000100:00100000:3.0:1787384440.680455:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+6:2415:x1874208182253952:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 42us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384440.680464:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 144 00000100:00100000:1.0:1787384440.680474:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 145 00000100:00100000:1.0:1787384440.680484:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee28ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2415:x1874208182253568:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384440.680489:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 146 00000100:00100000:3.0:1787384440.680499:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+6:2415:x1874208182253824:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384440.680517:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee28ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2415:x1874208182253568:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 34us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384440.680524:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 145 00000100:00100000:3.0:1787384440.680535:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+6:2415:x1874208182253824:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 35us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384440.680543:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 146 00000100:00100000:1.0:1787384440.680549:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182254208 00000100:00100000:1.0:1787384440.680554:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182254208 00000100:00100000:1.0:1787384440.680584:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182254080 00000100:00100000:1.0:1787384440.680588:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182254080 00000100:00100000:3.0:1787384440.680594:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 53 00000100:00100000:3.0:1787384440.680605:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+6:2415:x1874208182254208:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384440.680616:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 54 00000100:00100000:1.0:1787384440.680626:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+6:2415:x1874208182254080:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384440.680650:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+6:2415:x1874208182254208:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 47us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384440.680657:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 53 00000100:00100000:1.0:1787384440.680673:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+6:2415:x1874208182254080:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 47us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384440.680681:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 54 00000100:00080000:1.0:1787384440.680706:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787384440.680710:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787384440.680712:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787384440.680715:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787384440.681160:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182253440 00000100:00100000:0.0:1787384440.681166:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182253440 00000100:00100000:0.0:1787384440.681492:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 304 00000100:00100000:0.0:1787384440.681502:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+13:2415:x1874208182253440:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384440.681606:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+13:2415:x1874208182253440:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 105us (1591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384440.681614:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 304 00010000:00010000:0.0:1787384440.763884:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787384440.764933:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 25b82c0d-eb27-4f09-8c2a-c4cdc695d620 00000001:00100000:2.0:1787384440.768416:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 25b82c0d-eb27-4f09-8c2a-c4cdc695d620 00000001:00100000:1.0:1787384440.771592:0:6501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 25b82c0d-eb27-4f09-8c2a-c4cdc695d620 00000001:00100000:1.0:1787384440.772343:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 25b82c0d-eb27-4f09-8c2a-c4cdc695d620 00000001:02000400:3.0:1787384440.794468:0:12191:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg345-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:3.0:1787384441.784036:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203301120:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787384441.784105:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384441.784222:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203301120 00000100:00100000:2.0:1787384441.784229:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203301120 00000100:00100000:2.0:1787384441.784277:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787384441.784286:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203301120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787384441.784318:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787384441.784367:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203301120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384441.784373:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787384441.784419:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203301120:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787384441.784583:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384442.296403:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787384442.296426:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203301248:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787384442.296492:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384442.296548:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203301248 00000100:00100000:3.0:1787384442.296556:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203301248 00000100:00100000:3.0:1787384442.296599:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787384442.296608:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203301248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787384442.296651:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787384442.296699:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203301248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384442.296705:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787384442.296751:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203301248:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787384442.807068:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384443.833524:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384444.344367:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203301376:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787384444.344443:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384444.344521:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203301376 00000100:00100000:3.0:1787384444.344528:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203301376 00000100:00100000:3.0:1787384444.344575:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787384444.344593:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203301376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787384444.344629:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787384444.344672:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203301376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384444.344679:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:3.0:1787384444.344716:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c422fb80 x1874208203301376/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384460 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384444.344743:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203301376:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787384444.349087:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203301504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787384444.349230:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384444.349310:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203301504 00000100:00100000:2.0:1787384444.349319:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203301504 00000100:00100000:2.0:1787384444.349374:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787384444.349384:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203301504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787384444.349408:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1787384444.350689:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787384444.356388:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203301504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6996us (7149us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384444.356403:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:0.0:1787384444.359261:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f914aa00 x1874208203301504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384460 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384444.359286:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203301504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787384444.855843:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203301632:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787384444.855859:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384444.855913:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384444.856120:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203301760:0@lo:400:kworker.0 00000100:00100000:3.0:1787384444.856153:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384444.856177:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203302272:0@lo:400:kworker.0 00000100:00100000:3.0:1787384444.856199:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384444.856215:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4183b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874208203302784:0@lo:400:kworker.0 00000100:00100000:3.0:1787384444.856236:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384444.856255:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787384444.856263:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203301888:0@lo:400:kworker.0 00000100:00100000:0.0:1787384444.856279:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203301632 00000100:00100000:3.0:1787384444.856286:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384444.856301:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203302400:0@lo:400:kworker.0 00000100:00100000:3.0:1787384444.856321:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384444.856336:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203302912:0@lo:400:kworker.0 00000100:00100000:0.0:1787384444.856351:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203301632 00000100:00100000:3.0:1787384444.856359:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384444.856392:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203301760 00000100:00100000:3.0:1787384444.856396:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203301760 00000100:00100000:3.0:1787384444.856428:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1787384444.856436:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3653:x1874208203301760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384444.856480:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787384444.856491:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee531c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203301632:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787384444.856503:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3653:x1874208203301760:12345-0@lo:400:kworker.0 Request processed in 64us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384444.856510:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1787384444.856542:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203302272 00000100:00100000:3.0:1787384444.856545:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203302272 00000100:00100000:3.0:1787384444.856568:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787384444.856576:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203302272:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1787384444.856582:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787384444.856625:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203302272:12345-0@lo:400:kworker.0 Request processed in 50us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384444.856633:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787384444.856645:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee531c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203301632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384444.856653:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787384444.856655:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203302784 00000100:00100000:3.0:1787384444.856660:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203302784 00000100:00100000:3.0:1787384444.856689:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203301888 00000100:00100000:3.0:1787384444.856692:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203301888 00000100:00100000:3.0:1787384444.856705:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203302400 00000100:00100000:3.0:1787384444.856708:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203302400 00000100:00100000:3.0:1787384444.856721:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787384444.856727:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874208203302784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384444.856756:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874208203302784:12345-0@lo:400:kworker.0 Request processed in 29us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384444.856761:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787384444.856772:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787384444.856795:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203301888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384444.856827:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203301888:12345-0@lo:400:kworker.0 Request processed in 49us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384444.856833:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787384444.856851:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787384444.856868:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203302400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384444.856907:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203302400:12345-0@lo:400:kworker.0 Request processed in 41us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384444.856913:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787384444.856944:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203302912 00000100:00100000:3.0:1787384444.856949:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203302912 00000100:00100000:3.0:1787384444.856976:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787384444.856982:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203302912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384444.857011:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203302912:12345-0@lo:400:kworker.0 Request processed in 29us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384444.857017:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787384444.857043:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203302016:0@lo:400:kworker.0 00000100:00100000:3.0:1787384444.857067:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384444.857084:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874208203302528:0@lo:400:kworker.0 00000100:00100000:3.0:1787384444.857104:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384444.857120:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787384444.857126:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203302144:0@lo:400:kworker.0 00000100:00100000:3.0:1787384444.857147:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384444.857161:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874208203302656:0@lo:400:kworker.0 00000100:00100000:3.0:1787384444.857180:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384444.857201:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203302016 00000100:00100000:3.0:1787384444.857205:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203302016 00000100:00100000:3.0:1787384444.857226:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787384444.857232:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203302016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384444.857270:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203302016:12345-0@lo:400:kworker.0 Request processed in 38us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384444.857286:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787384444.857305:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203302528 00000100:00100000:3.0:1787384444.857308:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203302528 00000100:00100000:3.0:1787384444.857327:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203302144 00000100:00100000:3.0:1787384444.857330:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203302144 00000100:00100000:3.0:1787384444.857339:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203302656 00000100:00100000:3.0:1787384444.857341:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203302656 00000100:00100000:3.0:1787384444.857358:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787384444.857365:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874208203302528:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787384444.857384:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787384444.857390:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787384444.857393:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787384444.857402:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874208203302528:12345-0@lo:400:kworker.0 Request processed in 37us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384444.857408:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787384444.857420:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787384444.857424:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203302144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384444.857444:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203302144:12345-0@lo:400:kworker.0 Request processed in 20us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384444.857449:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787384444.857457:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787384444.857461:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874208203302656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384444.857481:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874208203302656:12345-0@lo:400:kworker.0 Request processed in 19us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384444.857487:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00010000:00080000:3.0:1787384444.857531:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c35da680 x1874208203301632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384460 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384444.857548:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203301632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787384444.857578:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203302144:0@lo:400:kworker.0 00000100:00100000:3.0:1787384444.857597:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874208203302656:0@lo:400:kworker.0 00000100:00100000:3.0:1787384444.857620:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203302016:0@lo:400:kworker.0 00010000:00080000:3.0:1787384444.857629:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c422ca80 x1874208203302528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384444.857637:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874208203302528:0@lo:400:kworker.0 00000100:00100000:3.0:1787384444.857667:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203301888:0@lo:400:kworker.0 00000100:00100000:3.0:1787384444.857677:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203302400:0@lo:400:kworker.0 00010000:00080000:3.0:1787384444.857686:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4183480 x1874208203302912/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384444.857694:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203302912:0@lo:400:kworker.0 00000100:00100000:3.0:1787384444.857703:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203301760:0@lo:400:kworker.0 00000100:00100000:3.0:1787384444.857711:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203302272:0@lo:400:kworker.0 00010000:00080000:3.0:1787384444.857721:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4183b80 x1874208203302784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384444.857729:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4183b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874208203302784:0@lo:400:kworker.0 00000100:00100000:2.0:1787384445.370762:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787384445.370802:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203303040:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787384445.370867:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384445.370928:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203303040 00000100:00100000:2.0:1787384445.370936:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203303040 00000100:00100000:2.0:1787384445.370982:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787384445.370999:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203303040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787384445.371021:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384445.371063:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203303040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384445.371070:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:2.0:1787384445.371110:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c2a01180 x1874208203303040/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384461 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384445.371127:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203303040:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787384445.795181:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384445.795239:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384445.795267:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384445.795294:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384445.795312:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384445.795327:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384445.795347:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384445.795373:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182254592 00000100:00100000:1.0:1787384445.795382:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182254592 00000100:00100000:1.0:1787384445.795440:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182254848 00000100:00100000:1.0:1787384445.795443:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182254848 00000100:00100000:3.0:1787384445.795667:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182254464 00000100:00100000:3.0:1787384445.795672:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182254464 00000100:00100000:1.0:1787384445.795713:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182254720 00000100:00100000:1.0:1787384445.795726:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182254720 00000100:00100000:2.0:1787384445.795737:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182254336 00000100:00100000:2.0:1787384445.795741:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182254336 00000100:00100000:2.0:1787384445.795771:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 306 00000100:00100000:2.0:1787384445.795818:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+13:2414:x1874208182254336:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384445.795832:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182255104 00000100:00100000:0.0:1787384445.795836:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182255104 00000100:00100000:0.0:1787384445.795869:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182254976 00000100:00100000:0.0:1787384445.795872:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182254976 00000100:00100000:0.0:1787384445.795892:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 56 00000100:00100000:0.0:1787384445.795899:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9149880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182255104:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384445.795931:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9149880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182255104:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 32us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384445.795938:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 56 00000100:00100000:0.0:1787384445.795954:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 57 00000100:00100000:0.0:1787384445.795960:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182254976:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384445.795982:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182254976:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 23us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384445.795988:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 57 00000100:00080000:0.0:1787384445.796014:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787384445.796018:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787384445.796020:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787384445.796022:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787384445.796219:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+13:2414:x1874208182254336:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 103us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384445.796227:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 306 00000100:00100000:3.0:1787384445.798112:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 153 00000100:00100000:3.0:1787384445.798192:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2414:x1874208182254592:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384445.798269:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2414:x1874208182254592:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 147us (3029us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384445.798292:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 153 00000100:00100000:3.0:1787384445.798310:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 154 00000100:00100000:3.0:1787384445.798317:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182254848:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384445.798347:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182254848:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 30us (3079us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384445.798353:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 154 00000100:00100000:3.0:1787384445.798364:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 155 00000100:00100000:3.0:1787384445.798371:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2414:x1874208182254464:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384445.798395:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2414:x1874208182254464:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 24us (3082us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384445.798400:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 155 00000100:00100000:1.0:1787384445.798895:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 156 00000100:00100000:1.0:1787384445.798906:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182254720:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384445.798938:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182254720:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 35us (3609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384445.798944:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 156 00010000:00010000:3.0:1787384445.880055:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384446.903400:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384446.906886:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203303168:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787384446.906954:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384446.909923:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203303168 00000100:00100000:1.0:1787384446.909947:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203303168 00000100:00100000:1.0:1787384446.910007:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787384446.910017:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203303168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787384446.910057:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787384446.913992:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203303168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3966us (7027us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384446.914007:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787384446.917102:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203303168:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787384447.415088:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203303296:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787384447.415169:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384447.415369:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203303296 00000100:00100000:3.0:1787384447.415407:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203303296 00000100:00100000:3.0:1787384447.415459:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787384447.415468:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203303296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787384447.415502:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787384447.415546:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203303296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384447.415554:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787384447.416864:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203303296:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787384447.926947:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787384448.720202:0:12508:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787384448.720407:0:12508:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787384448.950985:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384449.463117:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787384449.463141:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203303424:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787384449.463207:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384449.463362:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203303424 00000100:00100000:3.0:1787384449.463371:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203303424 00000100:00100000:3.0:1787384449.463448:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787384449.463456:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203303424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787384449.463496:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787384449.463543:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203303424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384449.463806:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1787384449.464119:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787384449.464155:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8fc1b7800 x1874208203303424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384449.464191:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203303424:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787384449.464378:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787384449.464390:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203303552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787384449.464429:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384449.464494:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203303552 00000100:00100000:1.0:1787384449.464499:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203303552 00000100:00100000:1.0:1787384449.464560:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787384449.464581:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203303552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787384449.464597:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787384449.464635:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203303552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384449.464642:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1787384449.464811:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787384449.464846:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee256680 x1874208203303552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384449.464859:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203303552:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787384449.975250:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384449.976322:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203304064:0@lo:400:kworker.0 00000100:00100000:3.0:1787384449.976397:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384449.976449:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203304576:0@lo:400:kworker.0 00000100:00100000:3.0:1787384449.976476:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384449.976498:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203305088:0@lo:400:kworker.0 00000100:00100000:3.0:1787384449.976518:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384449.976539:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1787384449.976546:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203303680:0@lo:400:kworker.0 00000100:00100000:3.0:1787384449.976584:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384449.976603:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203304192:0@lo:400:kworker.0 00000100:00100000:3.0:1787384449.976647:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384449.976661:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203304704:0@lo:400:kworker.0 00000100:00100000:3.0:1787384449.976678:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384449.976689:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee117100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203305216:0@lo:400:kworker.0 00000100:00100000:3.0:1787384449.976704:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384449.976769:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203303936:0@lo:400:kworker.0 00000100:00100000:1.0:1787384449.976823:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384449.976842:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874208203304448:0@lo:400:kworker.0 00000100:00100000:1.0:1787384449.976861:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384449.976878:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874208203304960:0@lo:400:kworker.0 00000100:00100000:1.0:1787384449.976896:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384449.976913:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787384449.976919:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874208203303808:0@lo:400:kworker.0 00000100:00100000:1.0:1787384449.976950:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384449.976967:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874208203304320:0@lo:400:kworker.0 00000100:00100000:1.0:1787384449.976984:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384449.976993:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874208203304832:0@lo:400:kworker.0 00000100:00100000:1.0:1787384449.977010:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384449.977033:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203304064 00000100:00100000:1.0:1787384449.977039:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203304064 00000100:00100000:1.0:1787384449.977072:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203304448 00000100:00100000:1.0:1787384449.977075:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203304448 00000100:00100000:1.0:1787384449.977095:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203304960 00000100:00100000:1.0:1787384449.977098:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203304960 00000100:00100000:1.0:1787384449.977110:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203303808 00000100:00100000:1.0:1787384449.977112:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203303808 00000100:00100000:1.0:1787384449.977138:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203304320 00000100:00100000:1.0:1787384449.977141:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203304320 00000100:00100000:1.0:1787384449.977153:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203304832 00000100:00100000:1.0:1787384449.977155:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203304832 00000100:00100000:1.0:1787384449.977169:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787384449.977176:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee116a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203304064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384449.977227:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee116a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203304064:12345-0@lo:400:kworker.0 Request processed in 50us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384449.977233:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787384449.977251:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787384449.977257:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874208203304448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384449.977285:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874208203304448:12345-0@lo:400:kworker.0 Request processed in 27us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384449.977290:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787384449.977301:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787384449.977306:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874208203304960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384449.977329:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874208203304960:12345-0@lo:400:kworker.0 Request processed in 24us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384449.977334:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787384449.977346:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787384449.977352:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874208203303808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384449.977373:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874208203303808:12345-0@lo:400:kworker.0 Request processed in 21us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384449.977378:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787384449.977388:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787384449.977394:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874208203304320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384449.977428:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874208203304320:12345-0@lo:400:kworker.0 Request processed in 35us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384449.977434:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787384449.977444:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787384449.977451:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874208203304832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384449.977475:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874208203304832:12345-0@lo:400:kworker.0 Request processed in 25us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384449.977480:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787384449.977497:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203304192 00000100:00100000:1.0:1787384449.977501:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203304192 00000100:00100000:1.0:1787384449.977521:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203303936 00000100:00100000:1.0:1787384449.977523:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203303936 00000100:00100000:1.0:1787384449.977534:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787384449.977539:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203304192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384449.977581:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203304192:12345-0@lo:400:kworker.0 Request processed in 42us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384449.977587:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787384449.977598:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787384449.977603:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203303936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384449.977626:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203303936:12345-0@lo:400:kworker.0 Request processed in 24us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384449.977631:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1787384449.977653:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787384449.977657:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787384449.977687:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874208203303808:0@lo:400:kworker.0 00000100:00100000:1.0:1787384449.977698:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874208203304320:0@lo:400:kworker.0 00000100:00100000:1.0:1787384449.977717:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874208203304832:0@lo:400:kworker.0 00000100:00100000:1.0:1787384449.977726:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203303936:0@lo:400:kworker.0 00010000:00080000:1.0:1787384449.977736:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3a6f100 x1874208203304448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384449.977746:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874208203304448:0@lo:400:kworker.0 00010000:00080000:1.0:1787384449.977755:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3a6ca80 x1874208203304960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384449.977763:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874208203304960:0@lo:400:kworker.0 00000100:00100000:1.0:1787384449.977844:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203304192:0@lo:400:kworker.0 00000100:00100000:1.0:1787384449.977855:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203304064:0@lo:400:kworker.0 00000100:00100000:0.0:1787384449.978501:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203305344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384449.978542:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384449.978594:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203304576 00000100:00100000:0.0:1787384449.978599:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203304576 00000100:00100000:0.0:1787384449.978623:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203305088 00000100:00100000:0.0:1787384449.978626:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203305088 00000100:00100000:0.0:1787384449.978646:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203304704 00000100:00100000:0.0:1787384449.978648:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203304704 00000100:00100000:0.0:1787384449.978660:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203305216 00000100:00100000:0.0:1787384449.978662:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203305216 00000100:00100000:0.0:1787384449.978674:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787384449.978680:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee117480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203304576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384449.978718:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee117480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203304576:12345-0@lo:400:kworker.0 Request processed in 38us (2241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384449.978724:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787384449.978736:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787384449.978741:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee114a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203305088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384449.978807:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee114a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203305088:12345-0@lo:400:kworker.0 Request processed in 66us (2288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384449.978813:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787384449.978823:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787384449.978828:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee116300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203304704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384449.978864:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee116300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203304704:12345-0@lo:400:kworker.0 Request processed in 23us (2172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384449.978869:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787384449.978878:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787384449.978884:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee117b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203305216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384449.978908:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee117b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203305216:12345-0@lo:400:kworker.0 Request processed in 25us (2204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384449.978913:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787384449.978943:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203303680 00000100:00100000:0.0:1787384449.978946:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203303680 00000100:00100000:0.0:1787384449.978971:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1787384449.978977:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3651:x1874208203303680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384449.979005:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3651:x1874208203303680:12345-0@lo:400:kworker.0 Request processed in 28us (2420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384449.979010:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1787384449.979038:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203305344 00000100:00100000:0.0:1787384449.979042:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203305344 00000100:00100000:0.0:1787384449.979065:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787384449.979071:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203305344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787384449.979093:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787384449.979125:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203305344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384449.979138:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1787384449.979159:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787384449.979183:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c35d9500 x1874208203305344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384449.979199:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203305344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384449.979223:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203303680:0@lo:400:kworker.0 00010000:00080000:0.0:1787384449.979234:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3a6c700 x1874208203304704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384449.979243:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203304704:0@lo:400:kworker.0 00010000:00080000:0.0:1787384449.979251:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee117100 x1874208203305216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384449.979258:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee117100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203305216:0@lo:400:kworker.0 00010000:00080000:0.0:1787384449.979267:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3a6c000 x1874208203304576/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384449.979274:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203304576:0@lo:400:kworker.0 00010000:00080000:0.0:1787384449.979283:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3a6f480 x1874208203305088/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384449.979296:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203305088:0@lo:400:kworker.0 00000100:00100000:3.0:1787384450.488076:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384450.488109:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203305472:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787384450.488202:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384450.488377:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203305472 00000100:00100000:2.0:1787384450.488387:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203305472 00000100:00100000:2.0:1787384450.488455:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787384450.488467:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee115f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203305472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787384450.488510:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384450.488576:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee115f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203305472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384450.488584:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:3.0:1787384450.488883:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c2a00380 x1874208203305472/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384466 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384450.489511:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203305472:0@lo:13:osp-pre-1-1.0 00000020:00000004:2.0:1787384450.832357:0:12606:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787384450.833203:0:12606:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787384450.923166:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384450.923213:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384450.923245:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384450.923280:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384450.923304:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384450.923325:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384450.923353:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384450.923388:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182255360 00000100:00100000:3.0:1787384450.923401:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182255360 00000100:00100000:3.0:1787384450.923467:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182255616 00000100:00100000:3.0:1787384450.923471:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182255616 00000100:00100000:3.0:1787384450.923486:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182255488 00000100:00100000:3.0:1787384450.923488:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182255488 00000100:00100000:3.0:1787384450.923499:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182255744 00000100:00100000:3.0:1787384450.923502:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182255744 00000100:00100000:3.0:1787384450.923520:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 163 00000100:00100000:3.0:1787384450.923531:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee117800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2414:x1874208182255360:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384450.923897:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee117800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2414:x1874208182255360:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 365us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384450.923908:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 163 00000100:00100000:3.0:1787384450.923935:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 164 00000100:00100000:3.0:1787384450.923942:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182255616:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384450.923970:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182255616:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 28us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384450.923977:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 164 00000100:00100000:3.0:1787384450.924008:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 165 00000100:00100000:3.0:1787384450.924014:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd75a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2414:x1874208182255488:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384450.924042:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd75a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2414:x1874208182255488:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 29us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384450.924049:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 165 00000100:00100000:3.0:1787384450.924060:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 166 00000100:00100000:3.0:1787384450.924066:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd758000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182255744:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384450.924091:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd758000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182255744:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 26us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384450.924098:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 166 00000100:00100000:3.0:1787384450.924121:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182255872 00000100:00080000:0.0:1787384450.924250:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787384450.924257:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787384450.928944:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182255872 00000100:00100000:3.0:1787384450.929033:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182256000 00000100:00100000:3.0:1787384450.929036:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182256000 00000100:00100000:3.0:1787384450.929075:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 62 00000100:00100000:3.0:1787384450.929087:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd75b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182255872:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384450.930324:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd75b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182255872:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 1231us (7068us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384450.930339:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 62 00000100:00100000:3.0:1787384450.930378:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 63 00000100:00100000:3.0:1787384450.930390:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd759500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182256000:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384450.930425:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd759500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182256000:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 39us (7072us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384450.930431:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 63 00000100:00100000:3.0:1787384450.930476:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182255232 00000100:00100000:3.0:1787384450.930481:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182255232 00000100:00100000:3.0:1787384450.930518:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 308 00000100:00100000:3.0:1787384450.930523:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+13:2414:x1874208182255232:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384450.930550:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+13:2414:x1874208182255232:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 27us (7270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384450.930556:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 308 00000100:00080000:0.0:1787384450.933984:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787384450.933998:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787384451.005710:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384452.024507:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384452.028252:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787384452.028277:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203305600:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787384452.028374:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384452.028546:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203305600 00000100:00100000:3.0:1787384452.028564:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203305600 00000100:00100000:3.0:1787384452.028620:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787384452.028630:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203305600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787384452.028664:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787384452.028736:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203305600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384452.028744:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787384452.028841:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203305600:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787384452.535245:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787384452.535275:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203305728:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787384452.535408:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384452.535489:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203305728 00000100:00100000:0.0:1787384452.535498:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203305728 00000100:00100000:0.0:1787384452.535562:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787384452.535571:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203305728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787384452.535606:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787384452.535655:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203305728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384452.535661:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787384452.535725:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203305728:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787384453.049159:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787384453.168352:0:12703:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787384453.172238:0:12703:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787384454.071331:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384454.583181:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787384454.583204:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd758e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203305856:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787384454.583265:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384454.583332:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203305856 00000100:00100000:3.0:1787384454.583341:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203305856 00000100:00100000:3.0:1787384454.583402:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787384454.583412:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd759c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203305856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787384454.583441:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787384454.583497:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd759c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203305856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384454.583512:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:3.0:1787384454.583571:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8fd758e00 x1874208203305856/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384470 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384454.583588:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd758e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203305856:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787384454.583726:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787384454.584009:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787384454.584022:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203305984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787384454.584058:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384454.584291:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203305984 00000100:00100000:1.0:1787384454.584297:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203305984 00000100:00100000:1.0:1787384454.584343:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787384454.584352:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203305984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787384454.584366:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787384454.584404:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203305984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384454.584411:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1787384454.584477:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787384454.584501:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee255500 x1874208203305984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384470 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384454.584517:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203305984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787384455.096948:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd75a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874208203306240:0@lo:400:kworker.0 00000100:00100000:1.0:1787384455.097150:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd758e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203306112:0@lo:400:kworker.0 00000100:00100000:1.0:1787384455.097222:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384455.097290:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203306624:0@lo:400:kworker.0 00000100:00100000:1.0:1787384455.097334:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384455.097357:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee145c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203307136:0@lo:400:kworker.0 00000100:00100000:1.0:1787384455.097384:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384455.097404:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee144700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203307648:0@lo:400:kworker.0 00000100:00100000:1.0:1787384455.097425:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384455.097473:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203306112 00000100:00100000:1.0:1787384455.097482:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203306112 00000100:00100000:1.0:1787384455.097546:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1787384455.097556:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3651:x1874208203306112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384455.097610:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3651:x1874208203306112:12345-0@lo:400:kworker.0 Request processed in 55us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384455.097618:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1787384455.097661:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203306624 00000100:00100000:1.0:1787384455.097665:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203306624 00000100:00100000:1.0:1787384455.097699:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787384455.097709:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203306624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384455.097756:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203306624:12345-0@lo:400:kworker.0 Request processed in 49us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384455.097763:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787384455.097833:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd758e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203306112:0@lo:400:kworker.0 00000100:00100000:1.0:1787384455.097849:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203306624:0@lo:400:kworker.0 00000100:00100000:1.0:1787384455.097887:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787384455.097895:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203307776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787384455.097933:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384455.097962:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203307776 00000100:00100000:1.0:1787384455.097966:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203307776 00000100:00100000:1.0:1787384455.098005:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787384455.098012:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203307776:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787384455.098681:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203307136 00000100:00100000:2.0:1787384455.098689:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203307136 00000100:00100000:2.0:1787384455.098721:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203307648 00000100:00100000:2.0:1787384455.098725:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203307648 00000100:00100000:2.0:1787384455.098753:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787384455.098763:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203307136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384455.098770:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787384455.098810:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3651:x1874208203307648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384455.098875:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3651:x1874208203307648:12345-0@lo:400:kworker.0 Request processed in 95us (1447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384455.098885:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203307136:12345-0@lo:400:kworker.0 Request processed in 122us (1498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384455.098895:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787384455.098952:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384455.098986:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7de1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874208203306752:0@lo:400:kworker.0 00000100:00100000:3.0:1787384455.099014:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384455.099052:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee145180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874208203307264:0@lo:400:kworker.0 00000100:00100000:3.0:1787384455.099073:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787384455.099116:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00000024:1.0:1787384455.101083:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787384455.101172:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203307776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3156us (3234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384455.101182:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1787384455.101555:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787384455.101694:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c35d8000 x1874208203307776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384471 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384455.101717:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203307776:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787384455.101733:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee145c00 x1874208203307136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384455.101741:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee145c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203307136:0@lo:400:kworker.0 00010000:00080000:1.0:1787384455.101751:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee144700 x1874208203307648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384455.101759:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee144700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203307648:0@lo:400:kworker.0 00000100:00100000:3.0:1787384455.103618:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203306240 00000100:00100000:3.0:1787384455.103679:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203306240 00000100:00100000:3.0:1787384455.103735:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203306752 00000100:00100000:3.0:1787384455.103738:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203306752 00000100:00100000:3.0:1787384455.103761:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203307264 00000100:00100000:3.0:1787384455.103764:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203307264 00000100:00100000:3.0:1787384455.103805:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787384455.103815:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874208203306240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384455.103908:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874208203306240:12345-0@lo:400:kworker.0 Request processed in 94us (4955us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384455.103915:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787384455.103934:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787384455.103939:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874208203306752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384455.103972:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874208203306752:12345-0@lo:400:kworker.0 Request processed in 33us (4956us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384455.103984:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787384455.103998:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787384455.104003:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee146d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874208203307264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384455.104049:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee146d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874208203307264:12345-0@lo:400:kworker.0 Request processed in 45us (4974us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384455.104055:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:3.0:1787384455.104082:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787384455.104116:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd75a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874208203306240:0@lo:400:kworker.0 00000100:00100000:3.0:1787384455.104129:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7de1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874208203306752:0@lo:400:kworker.0 00000100:00100000:3.0:1787384455.104140:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee145180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874208203307264:0@lo:400:kworker.0 00000100:00100000:3.0:1787384455.104211:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7de2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874208203306496:0@lo:400:kworker.0 00000100:00100000:3.0:1787384455.104262:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384455.104287:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7de3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203307008:0@lo:400:kworker.0 00000100:00100000:3.0:1787384455.104311:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384455.104330:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee147480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203307520:0@lo:400:kworker.0 00000100:00100000:3.0:1787384455.104351:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384455.104370:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787384455.104377:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203306368:0@lo:400:kworker.0 00000100:00100000:3.0:1787384455.104404:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384455.104425:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7de3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874208203306880:0@lo:400:kworker.0 00000100:00100000:3.0:1787384455.104446:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384455.104460:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee147800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874208203307392:0@lo:400:kworker.0 00000100:00100000:3.0:1787384455.104476:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384455.104504:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203307008 00000100:00100000:3.0:1787384455.104508:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203307008 00000100:00100000:2.0:1787384455.104807:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787384455.104876:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203307520 00000100:00100000:2.0:1787384455.104892:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203307520 00000100:00100000:2.0:1787384455.104923:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787384455.104931:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203307520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384455.104978:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203307520:12345-0@lo:400:kworker.0 Request processed in 47us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384455.104984:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787384455.105014:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203306368 00000100:00100000:2.0:1787384455.105018:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203306368 00000100:00100000:2.0:1787384455.105043:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787384455.105050:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee145c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203306368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384455.105085:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee145c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203306368:12345-0@lo:400:kworker.0 Request processed in 35us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384455.105099:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787384455.105125:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203306496 00000100:00100000:2.0:1787384455.105129:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203306496 00000100:00100000:2.0:1787384455.105152:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203306880 00000100:00100000:2.0:1787384455.105155:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203306880 00000100:00100000:2.0:1787384455.105171:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203307392 00000100:00100000:2.0:1787384455.105174:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203307392 00000100:00100000:2.0:1787384455.105189:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787384455.105196:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874208203306496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384455.105241:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874208203306496:12345-0@lo:400:kworker.0 Request processed in 45us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384455.105247:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787384455.105258:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787384455.105264:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874208203306880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384455.105290:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874208203306880:12345-0@lo:400:kworker.0 Request processed in 27us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384455.105296:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787384455.105320:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787384455.105327:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874208203307392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384455.105356:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874208203307392:12345-0@lo:400:kworker.0 Request processed in 31us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384455.105362:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:2.0:1787384455.105388:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787384455.105393:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787384455.105444:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203306368:0@lo:400:kworker.0 00010000:00080000:2.0:1787384455.105459:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7de3100 x1874208203306880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384455.105477:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7de3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874208203306880:0@lo:400:kworker.0 00010000:00080000:2.0:1787384455.105490:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee147800 x1874208203307392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384455.105498:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee147800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874208203307392:0@lo:400:kworker.0 00000100:00100000:2.0:1787384455.105507:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7de2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874208203306496:0@lo:400:kworker.0 00010000:00080000:2.0:1787384455.105516:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee147480 x1874208203307520/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384455.105523:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee147480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203307520:0@lo:400:kworker.0 00000100:00100000:3.0:1787384455.110175:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787384455.110196:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203307008:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1787384455.111272:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7de3800 x1874208203307008/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384455.111293:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7de3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203307008:0@lo:400:kworker.0 00000100:00100000:3.0:1787384455.112343:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203307008:12345-0@lo:400:kworker.0 Request processed in 1053us (6926us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384455.112357:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787384455.607557:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787384455.607630:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203307904:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787384455.607719:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384455.608283:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203307904 00000100:00100000:2.0:1787384455.608358:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203307904 00000100:00100000:2.0:1787384455.608423:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787384455.608433:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203307904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787384455.608520:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384455.608587:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203307904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 155us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384455.608595:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:2.0:1787384455.608640:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c2a00e00 x1874208203307904/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384471 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384455.609895:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203307904:0@lo:13:osp-pre-1-1.0 00000020:00000004:0.0:1787384455.720005:0:12801:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787384455.720616:0:12801:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787384456.050393:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384456.050447:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384456.050488:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384456.050510:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384456.050544:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384456.050614:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182256256 00000100:00100000:2.0:1787384456.050623:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182256256 00000100:00100000:2.0:1787384456.050679:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182256384 00000100:00100000:2.0:1787384456.050683:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182256384 00000100:00100000:2.0:1787384456.050696:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182256640 00000100:00100000:2.0:1787384456.050699:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182256640 00000100:00100000:2.0:1787384456.050711:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182256512 00000100:00100000:2.0:1787384456.050713:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182256512 00000100:00100000:2.0:1787384456.050729:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 173 00000100:00100000:2.0:1787384456.050738:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2415:x1874208182256256:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384456.050923:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182256128 00000100:00100000:1.0:1787384456.050928:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182256128 00000100:00100000:1.0:1787384456.050958:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 310 00000100:00100000:1.0:1787384456.050979:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+13:2416:x1874208182256128:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384456.051039:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+13:2416:x1874208182256128:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 60us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384456.051047:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 310 00000100:00100000:1.0:1787384456.051212:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 174 00000100:00100000:1.0:1787384456.051220:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2416:x1874208182256384:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384456.051253:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2416:x1874208182256384:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 34us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384456.051258:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 174 00000100:00100000:1.0:1787384456.051272:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 175 00000100:00100000:1.0:1787384456.051277:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2416:x1874208182256640:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384456.051298:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2416:x1874208182256640:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 21us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384456.051304:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 175 00000100:00100000:1.0:1787384456.051314:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 176 00000100:00100000:1.0:1787384456.051319:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2415:x1874208182256512:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384456.051341:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2415:x1874208182256512:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 22us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384456.051348:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 176 00000100:00080000:1.0:1787384456.051434:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787384456.051439:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384456.051758:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2415:x1874208182256256:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 1019us (1375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384456.051766:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 173 00000100:00100000:0.0:1787384456.058713:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384456.058753:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384456.058849:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182256768 00000100:00100000:1.0:1787384456.058859:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182256768 00000100:00100000:1.0:1787384456.058920:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182256896 00000100:00100000:1.0:1787384456.058929:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182256896 00000100:00100000:1.0:1787384456.058960:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 22 00000100:00100000:1.0:1787384456.058969:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2412:x1874208182256768:12345-192.168.203.45@tcp:9:kworker.0 00000020:00000080:1.0:1787384456.058999:0:8890:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba28d3 00000100:00080000:1.0:1787384456.059006:0:8890:0:(import.c:65:import_set_state_nolock()) ffff98f8ee358800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787384456.059049:0:8890:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1787384456.059212:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+2:2412:x1874208182256768:12345-192.168.203.45@tcp:9:kworker.0 Request processed in 243us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384456.059220:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 22 00000100:00100000:1.0:1787384456.059236:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 23 00000100:00100000:1.0:1787384456.059242:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2412:x1874208182256896:12345-192.168.203.45@tcp:9:kworker.0 00000020:00000080:1.0:1787384456.059253:0:8890:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba28da 00000100:00080000:1.0:1787384456.059259:0:8890:0:(import.c:65:import_set_state_nolock()) ffff98f8efb59800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787384456.059280:0:8890:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1787384456.059346:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+2:2412:x1874208182256896:12345-192.168.203.45@tcp:9:kworker.0 Request processed in 104us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384456.059352:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 23 00010000:00010000:1.0:1787384456.059373:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384456.060459:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787384456.060646:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787384456.060661:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787384456.122962:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384457.146459:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384457.146486:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203308032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787384457.146586:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384457.146667:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203308032 00000100:00100000:3.0:1787384457.146676:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203308032 00000100:00100000:3.0:1787384457.146729:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787384457.146738:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203308032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787384457.146796:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787384457.146939:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203308032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 200us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384457.146947:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787384457.147002:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203308032:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787384457.153370:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384457.658070:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787384457.658104:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203308160:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787384457.665419:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384457.665980:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203308160 00000100:00100000:1.0:1787384457.666000:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203308160 00000100:00100000:1.0:1787384457.666087:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787384457.666100:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203308160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787384457.666160:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787384457.666266:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203308160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 168us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384457.666275:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787384457.666366:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203308160:0@lo:41:osp-pre-0-1.0 00000020:00000004:2.0:1787384458.115080:0:12899:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787384458.115494:0:12899:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787384458.166897:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384459.192066:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384459.705066:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203308288:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787384459.705164:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384459.706667:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203308288 00000100:00100000:2.0:1787384459.706680:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203308288 00000100:00100000:2.0:1787384459.707333:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787384459.707350:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3b93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203308288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787384459.707388:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384459.707477:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3b93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203308288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 132us (2312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384459.707511:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1787384459.707541:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787384459.707593:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3b90380 x1874208203308288/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384475 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384459.707617:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203308288:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787384459.708857:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7de3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203308416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787384459.708917:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384459.708988:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203308416 00000100:00100000:2.0:1787384459.708996:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203308416 00000100:00100000:2.0:1787384459.709056:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787384459.709065:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203308416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787384459.709085:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384459.709123:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203308416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384459.709131:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1787384459.709152:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787384459.709209:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7de3800 x1874208203308416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384475 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384459.709226:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7de3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203308416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787384460.220010:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787384460.220033:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203308544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787384460.220101:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384460.220220:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203308544 00000100:00100000:0.0:1787384460.220229:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203308544 00000100:00100000:0.0:1787384460.220295:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787384460.220306:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203308544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787384460.220336:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787384460.220380:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203308544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384460.220388:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1787384460.220574:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787384460.220609:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c35d8000 x1874208203308544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384476 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384460.220656:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203308544:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787384460.221056:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384460.221359:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874208203309056:0@lo:400:kworker.0 00000100:00100000:1.0:1787384460.221405:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384460.221450:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203309568:0@lo:400:kworker.0 00000100:00100000:1.0:1787384460.221474:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384460.221509:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787384460.221515:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203308928:0@lo:400:kworker.0 00000100:00100000:1.0:1787384460.221540:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384460.221557:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4183b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874208203309440:0@lo:400:kworker.0 00000100:00100000:1.0:1787384460.221575:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384460.221599:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203309056 00000100:00100000:1.0:1787384460.221604:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203309056 00000100:00100000:1.0:1787384460.221765:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203309440 00000100:00100000:1.0:1787384460.221769:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203309440 00000100:00100000:1.0:1787384460.221824:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787384460.221832:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874208203309056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384460.221872:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874208203309056:12345-0@lo:400:kworker.0 Request processed in 40us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384460.221877:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787384460.221891:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787384460.221897:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874208203309440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384460.221920:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874208203309440:12345-0@lo:400:kworker.0 Request processed in 24us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384460.221925:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787384460.221940:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203309568 00000100:00100000:1.0:1787384460.221942:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203309568 00000100:00100000:1.0:1787384460.221963:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787384460.221978:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203309568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384460.222006:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203309568:12345-0@lo:400:kworker.0 Request processed in 30us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384460.222011:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:1.0:1787384460.222049:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4183b80 x1874208203309440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384460.222061:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4183b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874208203309440:0@lo:400:kworker.0 00000100:00100000:1.0:1787384460.222071:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874208203309056:0@lo:400:kworker.0 00010000:00080000:1.0:1787384460.222078:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4183480 x1874208203309568/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384460.222087:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203309568:0@lo:400:kworker.0 00000100:00100000:2.0:1787384460.222529:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874208203308800:0@lo:400:kworker.0 00000100:00100000:2.0:1787384460.222564:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384460.222589:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7deb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874208203309312:0@lo:400:kworker.0 00000100:00100000:2.0:1787384460.222610:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384460.222644:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787384460.222650:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203308672:0@lo:400:kworker.0 00000100:00100000:2.0:1787384460.222676:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384460.222698:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7de9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203309184:0@lo:400:kworker.0 00000100:00100000:2.0:1787384460.222721:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384460.222737:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203309696:0@lo:400:kworker.0 00000100:00100000:2.0:1787384460.222757:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384460.222808:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203308800 00000100:00100000:2.0:1787384460.222813:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203308800 00000100:00100000:2.0:1787384460.222840:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203309312 00000100:00100000:2.0:1787384460.222843:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203309312 00000100:00100000:2.0:1787384460.222861:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787384460.222868:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874208203308800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384460.222904:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874208203308800:12345-0@lo:400:kworker.0 Request processed in 36us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384460.222910:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787384460.222924:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787384460.222930:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874208203309312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384460.222952:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874208203309312:12345-0@lo:400:kworker.0 Request processed in 23us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384460.222967:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787384460.222985:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203308928 00000100:00100000:2.0:1787384460.222988:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203308928 00000100:00100000:2.0:1787384460.223008:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203309184 00000100:00100000:2.0:1787384460.223011:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203309184 00000100:00100000:2.0:1787384460.223023:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787384460.223029:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203308928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384460.223066:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203308928:12345-0@lo:400:kworker.0 Request processed in 37us (1525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384460.223072:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787384460.223083:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787384460.223088:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203309184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384460.223114:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203309184:12345-0@lo:400:kworker.0 Request processed in 26us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384460.223119:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787384460.223135:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203309696 00000100:00100000:2.0:1787384460.223138:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203309696 00000100:00100000:2.0:1787384460.223160:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787384460.223166:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203309696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384460.223192:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203309696:12345-0@lo:400:kworker.0 Request processed in 26us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384460.223198:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1787384460.223227:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787384460.223233:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787384460.223259:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7de9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203309184:0@lo:400:kworker.0 00010000:00080000:2.0:1787384460.223284:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4181c00 x1874208203309696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384460.223300:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203309696:0@lo:400:kworker.0 00000100:00100000:2.0:1787384460.223313:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874208203308800:0@lo:400:kworker.0 00000100:00100000:2.0:1787384460.223322:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7deb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874208203309312:0@lo:400:kworker.0 00000100:00100000:2.0:1787384460.223365:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203308928:0@lo:400:kworker.0 00000100:00100000:0.0:1787384460.224869:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874208203309952:0@lo:400:kworker.0 00000100:00100000:0.0:1787384460.224938:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384460.224975:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787384460.224982:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203310080:0@lo:400:kworker.0 00000100:00100000:0.0:1787384460.225008:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384460.225056:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203310080 00000100:00100000:0.0:1787384460.225063:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203310080 00000100:00100000:0.0:1787384460.225113:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787384460.225122:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203310080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384460.225170:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203310080:12345-0@lo:400:kworker.0 Request processed in 48us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384460.225177:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:0.0:1787384460.225215:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4181c00 x1874208203310080/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384460.225227:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203310080:0@lo:400:kworker.0 00000100:00100000:3.0:1787384460.225769:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787384460.225799:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874208203309824:0@lo:400:kworker.0 00000100:00100000:3.0:1787384460.225845:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384460.225897:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203308672 00000100:00100000:3.0:1787384460.225902:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203308672 00000100:00100000:3.0:1787384460.225938:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1787384460.225955:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3652:x1874208203308672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384460.225990:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3652:x1874208203308672:12345-0@lo:400:kworker.0 Request processed in 36us (3313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384460.225996:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00080000:2.0:1787384460.227199:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787384460.227236:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203309952 00000100:00100000:2.0:1787384460.227244:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203309952 00000100:00100000:2.0:1787384460.230683:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203309824 00000100:00100000:2.0:1787384460.230702:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203309824 00000100:00100000:2.0:1787384460.230739:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787384460.230751:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874208203309952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384460.230878:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874208203309952:12345-0@lo:400:kworker.0 Request processed in 129us (5939us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384460.230885:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787384460.230903:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787384460.230910:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874208203309824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384460.230948:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874208203309824:12345-0@lo:400:kworker.0 Request processed in 39us (5103us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384460.230953:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787384460.231021:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203308672:0@lo:400:kworker.0 00000100:00100000:3.0:1787384460.233916:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874208203309824:0@lo:400:kworker.0 00000100:00080000:0.0:1787384460.234254:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787384460.234261:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787384460.234300:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4180e00 x1874208203309952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384460.234313:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874208203309952:0@lo:400:kworker.0 00000100:00100000:2.0:1787384460.726917:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787384460.726941:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203310208:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787384460.727009:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384460.727078:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203310208 00000100:00100000:2.0:1787384460.727086:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203310208 00000100:00100000:2.0:1787384460.727129:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787384460.727138:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203310208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787384460.727161:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384460.727202:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203310208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384460.727225:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:2.0:1787384460.727265:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c2a02d80 x1874208203310208/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384476 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384460.727281:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203310208:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787384461.159357:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384461.159402:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384461.159438:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384461.159554:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182257024 00000100:00100000:1.0:1787384461.159565:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182257024 00000100:00100000:1.0:1787384461.159613:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 312 00000100:00100000:1.0:1787384461.159622:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+13:2414:x1874208182257024:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384461.159707:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+13:2414:x1874208182257024:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 85us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384461.159715:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 312 00000100:00100000:2.0:1787384461.160205:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384461.161917:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384461.165228:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182257152 00000100:00100000:0.0:1787384461.165243:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182257152 00000100:00100000:0.0:1787384461.165324:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182257408 00000100:00100000:0.0:1787384461.165328:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182257408 00000100:00100000:0.0:1787384461.165342:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182257280 00000100:00100000:0.0:1787384461.165344:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182257280 00000100:00100000:0.0:1787384461.165365:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 183 00000100:00100000:0.0:1787384461.165375:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2414:x1874208182257152:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384461.165459:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2414:x1874208182257152:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 85us (6055us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384461.165467:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 183 00000100:00100000:0.0:1787384461.165486:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 184 00000100:00100000:0.0:1787384461.165520:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7deb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2413:x1874208182257408:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384461.165556:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7deb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2413:x1874208182257408:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 38us (6117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384461.165563:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 184 00000100:00100000:0.0:1787384461.165576:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 185 00000100:00100000:0.0:1787384461.165582:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2413:x1874208182257280:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384461.165606:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2413:x1874208182257280:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 24us (5402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384461.165612:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 185 00000100:00080000:0.0:1787384461.165858:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787384461.165863:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787384461.166148:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182257536 00000100:00100000:0.0:1787384461.166154:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182257536 00000100:00100000:0.0:1787384461.166192:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 186 00000100:00100000:0.0:1787384461.166205:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee147480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2413:x1874208182257536:12345-192.168.203.45@tcp:400:kworker.0 00000100:00080000:1.0:1787384461.166235:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787384461.166246:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee147480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2413:x1874208182257536:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 46us (4337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384461.166254:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 186 00010000:00010000:0.0:1787384461.239039:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787384461.765951:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 25b82c0d-eb27-4f09-8c2a-c4cdc695d620 00000020:00000080:0.0:1787384461.765962:0:8432:0:(genops.c:906:class_export_put()) final put ffff98f8ee35c800/25b82c0d-eb27-4f09-8c2a-c4cdc695d620 00000020:00000080:1.0:1787384461.766103:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8ee35c800/25b82c0d-eb27-4f09-8c2a-c4cdc695d620 for lustre-OST0000 00000020:00000080:1.0:1787384461.766152:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8ee358800 for lustre-OST0000 00000001:00100000:2.0:1787384461.766320:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 25b82c0d-eb27-4f09-8c2a-c4cdc695d620 00000020:00000080:2.0:1787384461.766324:0:9517:0:(genops.c:906:class_export_put()) final put ffff98f8ee359000/25b82c0d-eb27-4f09-8c2a-c4cdc695d620 00000020:00000080:0.0:1787384461.766378:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8ee359000/25b82c0d-eb27-4f09-8c2a-c4cdc695d620 for lustre-OST0001 00000020:00000080:0.0:1787384461.766409:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8efb59800 for lustre-OST0001 00000100:00100000:1.0:1787384462.263671:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7de3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203310336:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787384462.263744:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787384462.266803:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384462.267942:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203310336 00000100:00100000:1.0:1787384462.267956:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203310336 00000100:00100000:1.0:1787384462.268054:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787384462.268064:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203310336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787384462.268105:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787384462.268187:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203310336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (4442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384462.268194:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787384462.268258:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7de3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203310336:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1787384462.319159:0:13044:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1787384462.776375:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203310464:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787384462.776493:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384462.776626:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203310464 00000100:00100000:3.0:1787384462.776637:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203310464 00000100:00100000:3.0:1787384462.776706:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787384462.776716:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203310464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787384462.776762:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787384462.789031:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203310464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 12297us (12520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384462.789051:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787384462.789307:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203310464:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787384463.290846:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384464.310933:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384464.825651:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203310592:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787384464.825805:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384464.825897:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203310592 00000100:00100000:3.0:1787384464.825906:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203310592 00000100:00100000:3.0:1787384464.825962:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787384464.825972:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203310592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787384464.826002:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787384464.826046:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203310592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384464.826054:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1787384464.826074:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787384464.826106:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3b90e00 x1874208203310592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384480 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384464.826135:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203310592:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787384464.836073:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787384464.836098:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203310720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787384464.836182:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384464.836244:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203310720 00000100:00100000:1.0:1787384464.836252:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203310720 00000100:00100000:1.0:1787384464.836309:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787384464.836318:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203310720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787384464.836341:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787384464.836383:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203310720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384464.836391:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1787384464.836412:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787384464.836440:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c35d9f80 x1874208203310720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384480 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384464.836487:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203310720:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787384465.337090:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384465.338749:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787384465.338775:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203310848:0@lo:400:kworker.0 00000100:00100000:3.0:1787384465.338874:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384465.338960:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203310976:0@lo:400:kworker.0 00000100:00100000:3.0:1787384465.338994:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384465.339052:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203311104:0@lo:400:kworker.0 00000100:00100000:3.0:1787384465.339080:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384465.339134:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203311232:0@lo:400:kworker.0 00000100:00100000:3.0:1787384465.339161:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384465.339195:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787384465.339201:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203311360:0@lo:400:kworker.0 00000100:00100000:3.0:1787384465.339220:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384465.339517:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203311104 00000100:00100000:3.0:1787384465.339525:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203311104 00000100:00100000:0.0:1787384465.339528:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203310848 00000100:00100000:0.0:1787384465.339542:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203310848 00000100:00100000:3.0:1787384465.339571:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203311360 00000100:00100000:3.0:1787384465.339576:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203311360 00000100:00100000:0.0:1787384465.339578:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1787384465.339595:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787384465.339602:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203311104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384465.339651:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203311104:12345-0@lo:400:kworker.0 Request processed in 49us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384465.339658:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787384465.339675:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787384465.339680:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203311360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384465.339771:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203311360:12345-0@lo:400:kworker.0 Request processed in 90us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384465.339798:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787384465.339819:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203311488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787384465.339901:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203310976 00000100:00100000:1.0:1787384465.339905:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203310976 00000100:00100000:1.0:1787384465.339944:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203311232 00000100:00100000:1.0:1787384465.339947:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203311232 00000100:00100000:1.0:1787384465.339976:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787384465.339984:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203310976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384465.340022:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203310976:12345-0@lo:400:kworker.0 Request processed in 39us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384465.340027:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787384465.340041:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787384465.340048:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203311232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384465.340073:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203311232:12345-0@lo:400:kworker.0 Request processed in 27us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384465.340079:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787384465.340271:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3651:x1874208203310848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384465.340309:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3651:x1874208203310848:12345-0@lo:400:kworker.0 Request processed in 44us (1436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384465.340315:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1787384465.341969:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203311104:0@lo:400:kworker.0 00000100:00100000:1.0:1787384465.342068:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787384465.342081:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7de3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874208203311744:0@lo:400:kworker.0 00000100:00100000:1.0:1787384465.342142:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384465.342184:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203311744 00000100:00100000:1.0:1787384465.342190:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203311744 00000100:00100000:1.0:1787384465.342243:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787384465.342253:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd759180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874208203311744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384465.342289:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874208203311616:0@lo:400:kworker.0 00000100:00100000:1.0:1787384465.342306:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd759180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874208203311744:12345-0@lo:400:kworker.0 Request processed in 53us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384465.342328:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384465.342334:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787384465.342359:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203311616 00000100:00100000:1.0:1787384465.342363:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203311616 00000100:00100000:1.0:1787384465.342388:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787384465.342394:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874208203311616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384465.342548:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384465.342584:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203310976:0@lo:400:kworker.0 00000100:00100000:3.0:1787384465.342618:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203311360:0@lo:400:kworker.0 00000100:00100000:3.0:1787384465.342631:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203311232:0@lo:400:kworker.0 00000100:00100000:3.0:1787384465.342642:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203310848:0@lo:400:kworker.0 00000100:00100000:3.0:1787384465.342664:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203311488 00000100:00100000:3.0:1787384465.342668:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203311488 00000100:00100000:3.0:1787384465.342699:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787384465.342705:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203311488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787384465.342740:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787384465.342774:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203311488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384465.342799:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:3.0:1787384465.342833:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4181c00 x1874208203311488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384481 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384465.342849:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203311488:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787384465.342892:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7de3800 x1874208203311744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384465.342901:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7de3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874208203311744:0@lo:400:kworker.0 00000100:00100000:1.0:1787384465.347519:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874208203311616:12345-0@lo:400:kworker.0 Request processed in 5110us (5177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384465.347536:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00080000:1.0:1787384465.347614:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787384465.347620:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787384465.347624:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787384465.347720:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874208203311616:0@lo:400:kworker.0 00000100:00100000:0.0:1787384465.348311:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874208203312128:0@lo:400:kworker.0 00000100:00100000:0.0:1787384465.348366:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384465.348400:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787384465.348407:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd758e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203312000:0@lo:400:kworker.0 00000100:00100000:0.0:1787384465.348430:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384465.348471:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203312000 00000100:00100000:0.0:1787384465.348478:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203312000 00000100:00100000:0.0:1787384465.348530:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787384465.348538:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203312000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384465.348603:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203312000:12345-0@lo:400:kworker.0 Request processed in 65us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384465.348609:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:0.0:1787384465.348644:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8fd758e00 x1874208203312000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384465.348655:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd758e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203312000:0@lo:400:kworker.0 00000100:00100000:1.0:1787384465.349076:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203312128 00000100:00100000:1.0:1787384465.349081:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203312128 00000100:00100000:1.0:1787384465.349128:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787384465.349136:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874208203312128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384465.349197:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874208203312128:12345-0@lo:400:kworker.0 Request processed in 61us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384465.349203:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1787384465.349542:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203312256:0@lo:400:kworker.0 00000100:00100000:3.0:1787384465.349587:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384465.349611:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787384465.349618:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd75a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203311872:0@lo:400:kworker.0 00000100:00100000:3.0:1787384465.349640:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384465.349660:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203312384:0@lo:400:kworker.0 00000100:00100000:3.0:1787384465.349680:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384465.349718:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203311872 00000100:00100000:3.0:1787384465.349722:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203311872 00000100:00100000:3.0:1787384465.349748:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203312384 00000100:00100000:3.0:1787384465.349751:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203312384 00000100:00100000:3.0:1787384465.349770:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787384465.349792:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203311872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384465.349830:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203311872:12345-0@lo:400:kworker.0 Request processed in 53us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384465.349837:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787384465.349850:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787384465.349868:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203312384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384465.349895:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203312384:12345-0@lo:400:kworker.0 Request processed in 39us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384465.349900:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:3.0:1787384465.349936:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8fd75a680 x1874208203311872/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384465.349949:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd75a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203311872:0@lo:400:kworker.0 00010000:00080000:3.0:1787384465.349959:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3a6c700 x1874208203312384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384465.349982:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203312384:0@lo:400:kworker.0 00000100:00100000:3.0:1787384465.350006:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203312256 00000100:00100000:3.0:1787384465.350009:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203312256 00000100:00100000:3.0:1787384465.350038:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787384465.350044:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874208203312256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384465.350082:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874208203312256:12345-0@lo:400:kworker.0 Request processed in 38us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384465.350088:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00010000:00080000:3.0:1787384465.350111:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3a6c000 x1874208203312256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384465.350120:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203312256:0@lo:400:kworker.0 00000100:00080000:0.0:1787384465.350475:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787384465.350488:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787384465.350491:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787384465.350517:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874208203312128:0@lo:400:kworker.0 00000100:00100000:0.0:1787384465.847681:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787384465.851063:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee147800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203312512:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787384465.851179:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384465.851326:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203312512 00000100:00100000:3.0:1787384465.851335:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203312512 00000100:00100000:3.0:1787384465.851411:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787384465.851422:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd75a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203312512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787384465.851447:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787384465.851506:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd75a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203312512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384465.851513:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:0.0:1787384465.851703:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee147800 x1874208203312512/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384481 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384465.851720:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee147800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203312512:0@lo:13:osp-pre-1-1.0 00000020:00000080:1.0:1787384466.129165:0:13191:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffcca1be2c0 00000020:00000080:1.0:1787384466.129182:0:13191:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1787384466.129187:0:13191:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1787384466.129194:0:13191:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcca1c0550 20000000:00000080:1.0:1787384466.129200:0:13191:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98f7c3a60c00 uarg=0000000000000000 20000000:01000000:1.0:1787384466.129245:0:13191:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787384466.129252:0:13191:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787384466.129257:0:13191:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787384466.133471:0:13192:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1787384466.133639:0:13191:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787384466.151314:0:13191:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787384466.151605:0:13191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98f8c0031000/0x7ef423838fba28e1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.151626:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f7c2091800/0x7ef423838fba2878 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2871 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.151634:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f8f58cd800/0x7ef423838fba2886 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba287f expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.151653:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f8f58cc000/0x7ef423838fba2894 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba288d expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.151664:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f7c2090200/0x7ef423838fba28a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba289b expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.151674:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f8f58cda00/0x7ef423838fba28a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce362f expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.151682:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f7c2090400/0x7ef423838fba28be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce366e expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.151690:0:13191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98f8c0031000/0x7ef423838fba28e1 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.151744:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f7c2090400/0x7ef423838fba28be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce366e expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.151758:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f7c2090400/0x7ef423838fba28be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce366e expref: 12 pid: 6516 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384466.151809:0:13191:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee147800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874208203312640:192.168.203.45@tcp:104: 00010000:00010000:2.0:1787384466.151913:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f8f58cda00/0x7ef423838fba28a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce362f expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.151921:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f8f58cda00/0x7ef423838fba28a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce362f expref: 12 pid: 6516 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384466.151929:0:13191:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c355a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874208203312768:192.168.203.45@tcp:104: 00010000:00010000:2.0:1787384466.151965:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f7c2090200/0x7ef423838fba28a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba289b expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.151973:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f7c2090200/0x7ef423838fba28a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba289b expref: 23 pid: 6514 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384466.151982:0:13191:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3558e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874208203312896:0@lo:104: 00000100:00100000:2.0:1787384466.152019:0:13191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787384466.152055:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f8f58cc000/0x7ef423838fba2894 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba288d expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384466.152062:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203312896 00010000:00010000:2.0:1787384466.152063:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f8f58cc000/0x7ef423838fba2894 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba288d expref: 23 pid: 6516 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384466.152069:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203312896 00000100:00100000:2.0:1787384466.152070:0:13191:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3559180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874208203313024:0@lo:104: 00000100:00100000:2.0:1787384466.152089:0:13191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787384466.152162:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f8f58cd800/0x7ef423838fba2886 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba287f expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.152170:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f8f58cd800/0x7ef423838fba2886 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba287f expref: 23 pid: 6515 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384466.152178:0:13191:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c355b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874208203313152:0@lo:104: 00000100:00100000:2.0:1787384466.152199:0:13191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787384466.156931:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f7c2091800/0x7ef423838fba2878 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba2871 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.156948:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f7c2091800/0x7ef423838fba2878 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba2871 expref: 23 pid: 6516 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384466.156974:0:13191:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c355aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874208203313280:0@lo:104: 00000100:00100000:2.0:1787384466.157027:0:13191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384466.162816:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203313024 00000100:00100000:0.0:1787384466.162841:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203313024 00000100:00100000:0.0:1787384466.162916:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203313152 00000100:00100000:0.0:1787384466.162920:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203313152 00000100:00100000:0.0:1787384466.162946:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787384466.162963:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c355b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+5:13191:x1874208203312896:12345-0@lo:104: 00010000:00010000:0.0:1787384466.162982:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f8f58cce00/0x7ef423838fba289b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba28a2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384466.163053:0:9526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787384466.163063:0:9526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3559880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ca80b7f5-0e34-441a-981f-ebff717028c4+5:13191:x1874208203313024:12345-0@lo:104: 00010000:00010000:3.0:1787384466.163072:0:9526:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc800/0x7ef423838fba288d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2894 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384466.163287:0:13191:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2b71cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384466.163311:0:13191:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3558e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874208203312896:0@lo:104: 00000100:00100000:2.0:1787384466.163320:0:13191:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3559180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874208203313024:0@lo:104: 00000100:00100000:2.0:1787384466.163493:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384466.163516:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384466.163540:0:13191:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee147800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874208203312640:192.168.203.45@tcp:104: 00000100:00100000:2.0:1787384466.163548:0:13191:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c355a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874208203312768:192.168.203.45@tcp:104: 00010000:00010000:0.0:1787384466.164110:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787384466.164119:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c355b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+5:13191:x1874208203312896:12345-0@lo:104: Request processed in 1157us (12099us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384466.164128:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787384466.164151:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203313280 00000100:00100000:0.0:1787384466.164156:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203313280 00000100:00100000:0.0:1787384466.164179:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787384466.164185:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c355b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+5:13191:x1874208203313152:12345-0@lo:104: 00010000:00010000:0.0:1787384466.164195:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f7c3952200/0x7ef423838fba287f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2886 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384466.164226:0:9526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1787384466.164265:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787384466.164270:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c355b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+5:13191:x1874208203313152:12345-0@lo:104: Request processed in 86us (12071us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384466.164277:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787384466.164290:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787384466.164296:0:9526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3559880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ca80b7f5-0e34-441a-981f-ebff717028c4+4:13191:x1874208203313024:12345-0@lo:104: Request processed in 1235us (12205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384466.164297:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+4:13191:x1874208203313280:12345-0@lo:104: 00000100:00100000:3.0:1787384466.164303:0:9526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:0.0:1787384466.164305:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba2871 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2878 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384466.164334:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1787384466.164339:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+3:13191:x1874208203313280:12345-0@lo:104: Request processed in 43us (7313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384466.164344:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787384466.164358:0:13191:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c355b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874208203313152:0@lo:104: 00000100:00100000:0.0:1787384466.164362:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182257664 00000100:00100000:3.0:1787384466.164366:0:13191:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c355aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1874208203313280:0@lo:104: 00000100:00100000:0.0:1787384466.164378:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182257664 00010000:00010000:0.0:1787384466.164396:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f7c2090400/0x7ef423838fba28be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce366e expref: 13 pid: 6516 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384466.164418:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182257792 00000100:00100000:0.0:1787384466.164420:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182257792 00010000:00010000:0.0:1787384466.164431:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f8f58cda00/0x7ef423838fba28a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce362f expref: 14 pid: 6516 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384466.164474:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 40 00010000:00010000:3.0:1787384466.164477:0:13191:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98f8c0031000/0x7ef423838fba28e1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384466.164481:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3adad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09777221-fe6d-4549-9ee6-04300d230fb6+14:2415:x1874208182257664:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787384466.164503:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384466.164509:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f7c2090400/0x7ef423838fba28be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce366e expref: 14 pid: 6516 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384466.164516:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 41 00000100:00100000:3.0:1787384466.164523:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09777221-fe6d-4549-9ee6-04300d230fb6+14:2415:x1874208182257792:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787384466.164526:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f7c2090400/0x7ef423838fba28be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce366e expref: 14 pid: 6516 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384466.164530:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384466.164534:0:10399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f8f58cda00/0x7ef423838fba28a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce362f expref: 14 pid: 6516 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384466.164543:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c2090400/0x7ef423838fba28be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce366e expref: 14 pid: 6516 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.164558:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787384466.164564:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8f58cce00/0x7ef423838fba289b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba28a2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.164571:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cce00 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384466.164575:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8f58cce00/0x7ef423838fba289b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba28a2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.164584:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8f58cce00/0x7ef423838fba289b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba28a2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384466.164591:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8f58cce00/0x7ef423838fba289b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba28a2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384466.164597:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787384466.164628:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8f58cce00/0x7ef423838fba289b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba28a2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.164646:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787384466.164670:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8f58cce00/0x7ef423838fba289b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba28a2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.164676:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8f58cce00/0x7ef423838fba289b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba28a2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.164687:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787384466.164690:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc800/0x7ef423838fba288d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2894 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.164696:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cc800 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384466.164699:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc800/0x7ef423838fba288d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba2894 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.164705:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc800/0x7ef423838fba288d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba2894 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384466.164711:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc800/0x7ef423838fba288d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba2894 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384466.164716:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787384466.164730:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc800/0x7ef423838fba288d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2894 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.164736:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787384466.164750:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc800/0x7ef423838fba288d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2894 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.164757:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc800/0x7ef423838fba288d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2894 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.164935:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787384466.164939:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f7c3952200/0x7ef423838fba287f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2886 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.164944:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3952200 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384466.164947:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f7c3952200/0x7ef423838fba287f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba2886 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.164954:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f7c3952200/0x7ef423838fba287f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba2886 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384466.164960:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f7c3952200/0x7ef423838fba287f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba2886 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384466.164965:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787384466.164980:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f7c3952200/0x7ef423838fba287f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2886 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.164986:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787384466.164992:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f7c3952200/0x7ef423838fba287f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2886 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.164997:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f7c3952200/0x7ef423838fba287f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2886 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.165007:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384466.165010:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba2871 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2878 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.165025:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cdc00 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384466.165029:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba2871 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba2878 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.165036:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba2871 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba2878 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384466.165042:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba2871 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba2878 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384466.165047:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787384466.165059:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba2871 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2878 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.165064:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787384466.165070:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba2871 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2878 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.165075:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba2871 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2878 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.165087:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384466.165089:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384466.165092:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384466.165118:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3adaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203313792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787384466.165317:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384466.165359:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787384466.165366:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203313408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787384466.165487:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384466.165511:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ad9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203313536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787384466.165534:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384466.165546:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787384466.165552:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3adb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203313664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787384466.165574:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384466.165870:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203313792 00000100:00100000:2.0:1787384466.165877:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203313792 00010000:00010000:2.0:1787384466.165905:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f7c2091800/0x7ef423838fba2878 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba2871 expref: 24 pid: 6516 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384466.165923:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203313408 00000100:00100000:2.0:1787384466.165926:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203313408 00010000:00010000:2.0:1787384466.165937:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f7c2090200/0x7ef423838fba28a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba289b expref: 25 pid: 6514 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384466.165948:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203313536 00000100:00100000:2.0:1787384466.165950:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203313536 00010000:00010000:2.0:1787384466.165961:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f8f58cc000/0x7ef423838fba2894 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba288d expref: 26 pid: 6516 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384466.165970:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203313664 00000100:00100000:2.0:1787384466.165972:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203313664 00010000:00010000:2.0:1787384466.165981:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f8f58cd800/0x7ef423838fba2886 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba287f expref: 27 pid: 6515 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384466.165992:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787384466.165999:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ca80b7f5-0e34-441a-981f-ebff717028c4+27:3653:x1874208203313792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787384466.166008:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384466.166020:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f7c2091800/0x7ef423838fba2878 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba2871 expref: 27 pid: 6516 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384466.166115:0:10399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f8f58cda00/0x7ef423838fba28a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce362f expref: 14 pid: 6516 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384466.166211:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f58cda00/0x7ef423838fba28a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce362f expref: 14 pid: 6516 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384466.166225:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787384466.166366:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f7c2091800/0x7ef423838fba2878 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba2871 expref: 27 pid: 6516 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.166378:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c2091800/0x7ef423838fba2878 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba2871 expref: 27 pid: 6516 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.166386:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384466.166503:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ca80b7f5-0e34-441a-981f-ebff717028c4+26:3653:x1874208203313792:12345-0@lo:103:ldlm_bl.0 Request processed in 504us (1185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384466.166511:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787384466.166528:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787384466.166533:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3ad9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ca80b7f5-0e34-441a-981f-ebff717028c4+25:3653:x1874208203313408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787384466.166542:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384466.166547:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f7c2090200/0x7ef423838fba28a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba289b expref: 25 pid: 6514 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.166554:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f7c2090200/0x7ef423838fba28a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba289b expref: 25 pid: 6514 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.166563:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c2090200/0x7ef423838fba28a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba289b expref: 25 pid: 6514 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.166572:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384466.166592:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3ad9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3653:x1874208203313408:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384466.166598:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787384466.166609:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787384466.166622:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ca80b7f5-0e34-441a-981f-ebff717028c4+23:3651:x1874208203313536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787384466.166630:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384466.166635:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f8f58cc000/0x7ef423838fba2894 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba288d expref: 23 pid: 6516 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.166642:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f8f58cc000/0x7ef423838fba2894 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba288d expref: 23 pid: 6516 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.166651:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f58cc000/0x7ef423838fba2894 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba288d expref: 23 pid: 6516 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.166659:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384466.166685:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ca80b7f5-0e34-441a-981f-ebff717028c4+22:3651:x1874208203313536:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384466.166691:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787384466.166703:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787384466.166710:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b45050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ca80b7f5-0e34-441a-981f-ebff717028c4+21:3651:x1874208203313664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787384466.166718:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384466.166722:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f8f58cd800/0x7ef423838fba2886 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba287f expref: 21 pid: 6515 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.166730:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f8f58cd800/0x7ef423838fba2886 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba287f expref: 21 pid: 6515 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.166739:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f58cd800/0x7ef423838fba2886 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba287f expref: 21 pid: 6515 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.166749:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98f8c0031000/0x7ef423838fba28e1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.166766:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8c0031000/0x7ef423838fba28e1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.166810:0:8463:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f8c0031000/0x7ef423838fba28e1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.166817:0:8463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f8c0031000/0x7ef423838fba28e1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.166823:0:8463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98f8c0031000/0x7ef423838fba28e1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.166829:0:8463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98f8c0031000/0x7ef423838fba28e1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.166834:0:8463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c0031000 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:2.0:1787384466.166837:0:8463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98f8c0031000/0x7ef423838fba28e1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.166844:0:8463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98f8c0031000/0x7ef423838fba28e1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.166858:0:8463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98f8c0031000/0x7ef423838fba28e1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384466.166866:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384466.166890:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b45050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ca80b7f5-0e34-441a-981f-ebff717028c4+20:3651:x1874208203313664:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (1313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384466.166896:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00010000:2.0:1787384466.166914:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384466.166930:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384466.166945:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3adb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203313664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787384466.166954:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ad9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203313536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384466.166975:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3adad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09777221-fe6d-4549-9ee6-04300d230fb6+12:2415:x1874208182257664:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 2493us (3483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384466.166982:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203313408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384466.166982:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 40 00000100:00100000:2.0:1787384466.166989:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3adaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203313792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787384466.167013:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09777221-fe6d-4549-9ee6-04300d230fb6+11:2415:x1874208182257792:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 2490us (3495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384466.167019:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 41 00010000:00010000:1.0:1787384466.167215:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384466.167320:0:13191:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98f8c0031000/0x7ef423838fba28e1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384466.167329:0:13191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98f8c0031000/0x7ef423838fba28e1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384466.167345:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8c0031000/0x7ef423838fba28e1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384466.277319:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384466.277353:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384466.277377:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384466.277398:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384466.277424:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182257920 00000100:00100000:1.0:1787384466.277433:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182257920 00000100:00100000:1.0:1787384466.277513:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182258176 00000100:00100000:1.0:1787384466.277517:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182258176 00000100:00100000:1.0:1787384466.277532:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182258048 00000100:00100000:1.0:1787384466.277535:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182258048 00000100:00100000:1.0:1787384466.277546:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182258304 00000100:00100000:1.0:1787384466.277548:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182258304 00000100:00100000:1.0:1787384466.277565:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 193 00000100:00100000:1.0:1787384466.277573:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2413:x1874208182257920:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384466.278142:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 194 00000100:00100000:2.0:1787384466.278155:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2413:x1874208182258176:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384466.278230:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2413:x1874208182258176:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 79us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384466.278238:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 194 00000100:00100000:2.0:1787384466.278259:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 195 00000100:00100000:2.0:1787384466.278265:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2413:x1874208182258048:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384466.278301:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2413:x1874208182258048:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 26us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384466.278308:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 195 00000100:00100000:2.0:1787384466.278322:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 196 00000100:00100000:2.0:1787384466.278329:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2413:x1874208182258304:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384466.278352:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2413:x1874208182258304:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 24us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384466.278356:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 196 00000100:00100000:1.0:1787384466.278940:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2413:x1874208182257920:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 1367us (1631us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384466.278948:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 193 00000100:00080000:1.0:1787384466.278968:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787384466.278974:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787384466.361649:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787384467.256436:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787384467.256444:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98f8f7d47800 from 7 10000000:01000000:2.0:1787384467.256457:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787384467.256507:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8c0030800/0x7ef423838fba28e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.256520:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8c0030800/0x7ef423838fba28e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.256530:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8c0030800/0x7ef423838fba28e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384467.256557:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ad8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203313920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787384467.256625:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384467.256696:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2b71600 going to sleep for 11 seconds 00000100:00100000:1.0:1787384467.256804:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203313920 00000100:00100000:1.0:1787384467.256812:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203313920 00000100:00100000:1.0:1787384467.256878:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1787384467.256888:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+20:6519:x1874208203313920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787384467.256903:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384467.256917:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c3953e00/0x7ef423838fba28ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba28e8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384467.256942:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c3953e00/0x7ef423838fba28ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba28e8 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384467.256966:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c3953e00/0x7ef423838fba28ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba28e8 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384467.256975:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3953e00, rc 0) 00000100:00100000:1.0:1787384467.257037:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+21:6519:x1874208203313920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384467.257044:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1787384467.261043:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ad8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203313920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384467.261088:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8c0030800/0x7ef423838fba28e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba28ef expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.261102:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8c0030800/0x7ef423838fba28e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba28ef expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384467.261210:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203314048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384467.261274:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384467.261331:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c5353f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787384467.261697:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203314048 00000100:00100000:0.0:1787384467.261704:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203314048 00000100:00100000:0.0:1787384467.261774:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1787384467.261820:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d25f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+21:6519:x1874208203314048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384467.262018:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d25f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+21:6519:x1874208203314048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 199us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384467.262026:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1787384467.262285:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203314048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384467.262324:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203314176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384467.262378:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384467.262414:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c5353f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787384467.262553:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203314176 00000100:00100000:2.0:1787384467.262558:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203314176 00000100:00100000:2.0:1787384467.262597:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1787384467.262605:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d945a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+21:6519:x1874208203314176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787384467.262700:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d945a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+21:6519:x1874208203314176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384467.262707:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1787384467.263566:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203314176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787384467.264665:0:13204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787384467.265180:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787384467.265204:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787384467.265215:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8c0030800/0x7ef423838fba28e8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba28ef expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.265227:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8c0030800/0x7ef423838fba28e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba28ef expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384467.265256:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787384467.265258:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98f8f5669000 from 7 10000000:01000000:3.0:1787384467.265261:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787384467.265304:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c2090800/0x7ef423838fba28f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.265312:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f7c2090800/0x7ef423838fba28f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.265321:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f7c2090800/0x7ef423838fba28f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384467.265346:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203314304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787384467.265432:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384467.265486:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c5353f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787384467.265576:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203314304 00000100:00100000:1.0:1787384467.265584:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203314304 00000100:00100000:1.0:1787384467.265638:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1787384467.265647:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9458c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+21:6519:x1874208203314304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787384467.265659:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384467.265701:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c3953000/0x7ef423838fba28fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba28f6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384467.265723:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c3953000/0x7ef423838fba28fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba28f6 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384467.265734:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c3953000/0x7ef423838fba28fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba28f6 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384467.265753:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3953000, rc 0) 00000100:00100000:1.0:1787384467.265825:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9458c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+22:6519:x1874208203314304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384467.265832:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1787384467.266108:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203314304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384467.266121:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f7c2090800/0x7ef423838fba28f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba28fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.266130:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f7c2090800/0x7ef423838fba28f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba28fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384467.266186:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203314432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384467.266213:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384467.266249:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c5353f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787384467.266310:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203314432 00000100:00100000:2.0:1787384467.266315:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203314432 00000100:00100000:2.0:1787384467.266348:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1787384467.266355:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d945bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+22:6519:x1874208203314432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787384467.266495:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d945bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+22:6519:x1874208203314432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384467.266513:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1787384467.267043:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203314432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384467.267077:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203314560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384467.267127:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384467.267160:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c5353f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787384467.267288:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203314560 00000100:00100000:1.0:1787384467.267293:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203314560 00000100:00100000:1.0:1787384467.267339:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1787384467.267347:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d945ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+22:6519:x1874208203314560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787384467.267444:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d945ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+22:6519:x1874208203314560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384467.267459:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1787384467.267857:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203314560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787384467.273360:0:13205:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787384467.273946:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787384467.273968:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787384467.273979:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c2090800/0x7ef423838fba28f6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba28fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384467.273992:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f7c2090800/0x7ef423838fba28f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba28fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384467.274026:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787384467.274029:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98f8f5698000 from 7 10000000:01000000:0.0:1787384467.274031:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787384467.274070:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05000/0x7ef423838fba2904 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384467.274078:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05000/0x7ef423838fba2904 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384467.274088:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05000/0x7ef423838fba2904 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384467.274113:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd758e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203314688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787384467.274179:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384467.274213:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c41c3900 going to sleep for 11 seconds 00000100:00100000:1.0:1787384467.274327:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203314688 00000100:00100000:1.0:1787384467.274334:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203314688 00000100:00100000:1.0:1787384467.274376:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1787384467.274384:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+22:6519:x1874208203314688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787384467.274397:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384467.274411:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c3953a00/0x7ef423838fba290b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba2904 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384467.274453:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c3953a00/0x7ef423838fba290b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba2904 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384467.274463:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c3953a00/0x7ef423838fba290b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2904 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384467.274471:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3953a00, rc 0) 00000100:00100000:1.0:1787384467.274512:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+23:6519:x1874208203314688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384467.274519:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1787384467.275036:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd758e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203314688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787384467.275051:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05000/0x7ef423838fba2904 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba290b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384467.275059:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05000/0x7ef423838fba2904 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba290b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384467.275122:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd758e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203314816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384467.275150:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384467.275174:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c41c3900 going to sleep for 11 seconds 00000100:00100000:3.0:1787384467.275235:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203314816 00000100:00100000:3.0:1787384467.275239:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203314816 00000100:00100000:3.0:1787384467.275273:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1787384467.275282:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+23:6519:x1874208203314816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384467.275394:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+23:6519:x1874208203314816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384467.275401:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1787384467.275720:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd758e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203314816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384467.276015:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd758e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203314944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787384467.276067:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384467.276132:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c41c3900 going to sleep for 11 seconds 00000100:00100000:2.0:1787384467.284111:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203314944 00000100:00100000:2.0:1787384467.284126:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203314944 00000100:00100000:2.0:1787384467.284188:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1787384467.284198:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+23:6519:x1874208203314944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787384467.284497:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+23:6519:x1874208203314944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 299us (8427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384467.284505:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1787384467.285839:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd758e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203314944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787384467.301342:0:13206:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787384467.304343:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787384467.304506:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787384467.304518:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05000/0x7ef423838fba2904 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba290b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384467.304544:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05000/0x7ef423838fba2904 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba290b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384467.304554:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787384467.304556:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98f8c896e000 from 7 10000000:01000000:1.0:1787384467.304559:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787384467.304596:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3952200/0x7ef423838fba2912 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384467.305471:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f7c3952200/0x7ef423838fba2912 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384467.305485:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f7c3952200/0x7ef423838fba2912 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384467.305513:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203315072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787384467.305584:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384467.306139:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d82c9540 going to sleep for 11 seconds 00000100:00100000:0.0:1787384467.317498:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203315072 00000100:00100000:0.0:1787384467.317515:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203315072 00000100:00100000:0.0:1787384467.317582:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1787384467.317593:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+23:6519:x1874208203315072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787384467.317611:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384467.317631:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c3b05e00/0x7ef423838fba2919 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba2912 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384467.317658:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c3b05e00/0x7ef423838fba2919 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba2912 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384467.317671:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c3b05e00/0x7ef423838fba2919 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2912 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384467.317681:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3b05e00, rc 0) 00000100:00100000:0.0:1787384467.317765:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:6519:x1874208203315072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (12180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384467.317772:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1787384467.318007:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203315072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384467.318026:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f7c3952200/0x7ef423838fba2912 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2919 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.318035:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f7c3952200/0x7ef423838fba2912 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2919 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384467.318112:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203315200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384467.318146:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384467.318175:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7ea7600 going to sleep for 11 seconds 00000100:00100000:2.0:1787384467.318299:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203315200 00000100:00100000:2.0:1787384467.318304:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203315200 00000100:00100000:2.0:1787384467.318343:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1787384467.318361:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+24:6519:x1874208203315200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787384467.318474:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+24:6519:x1874208203315200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384467.318480:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1787384467.318609:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203315200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384467.318637:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203315328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384467.318681:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384467.318703:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7ea7600 going to sleep for 11 seconds 00000100:00100000:0.0:1787384467.319182:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203315328 00000100:00100000:0.0:1787384467.319188:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203315328 00000100:00100000:0.0:1787384467.319225:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1787384467.319232:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+24:6519:x1874208203315328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787384467.319334:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+24:6519:x1874208203315328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384467.319341:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1787384467.319482:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203315328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787384467.321179:0:13207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787384467.321390:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787384467.321425:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787384467.321436:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3952200/0x7ef423838fba2912 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2919 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.321457:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f7c3952200/0x7ef423838fba2912 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2919 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384467.383250:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787384467.383274:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203315456:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787384467.383401:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787384467.383804:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384467.384113:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203315456 00000100:00100000:3.0:1787384467.384124:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203315456 00000100:00100000:3.0:1787384467.384235:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787384467.384246:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3ad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203315456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787384467.384290:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787384467.384378:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3ad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203315456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 134us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384467.384386:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787384467.384486:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203315456:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787384467.900126:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203315584:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787384467.900219:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384467.903527:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203315584 00000100:00100000:1.0:1787384467.903538:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203315584 00000100:00100000:1.0:1787384467.903591:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787384467.903676:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203315584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787384467.903714:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787384467.903989:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203315584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 389us (3769us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384467.904011:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787384467.904516:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203315584:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787384468.194754:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384468.194817:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182258432 00000100:00100000:3.0:1787384468.194826:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182258432 00000100:00100000:3.0:1787384468.194879:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 326 00000100:00100000:3.0:1787384468.194889:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+11:6186:x1874208182258432:12345-192.168.203.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384468.194907:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384468.194926:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c2091e00/0x7ef423838fba2920 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce369f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.194975:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c2091e00/0x7ef423838fba2920 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce369f expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.194987:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c2091e00/0x7ef423838fba2920 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce369f expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.194996:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2091e00, rc 0) 00000100:00100000:3.0:1787384468.195048:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+12:6186:x1874208182258432:12345-192.168.203.45@tcp:101:ll_cfg_requeue.0 Request processed in 160us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384468.195055:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 326 00000100:00100000:3.0:1787384468.206226:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384468.206323:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182258560 00000100:00100000:0.0:1787384468.206341:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182258560 00000100:00100000:0.0:1787384468.206447:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 327 00000100:00100000:0.0:1787384468.206458:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+12:6186:x1874208182258560:12345-192.168.203.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384468.206604:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+12:6186:x1874208182258560:12345-192.168.203.45@tcp:501:ll_cfg_requeue.0 Request processed in 147us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384468.206612:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 327 00000100:00100000:3.0:1787384468.210712:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384468.211079:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182258688 00000100:00100000:0.0:1787384468.211090:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182258688 00000100:00100000:0.0:1787384468.211145:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 328 00000100:00100000:0.0:1787384468.211155:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+12:6186:x1874208182258688:12345-192.168.203.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787384468.211589:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+12:6186:x1874208182258688:12345-192.168.203.45@tcp:503:ll_cfg_requeue.0 Request processed in 433us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384468.211597:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 328 00000100:00100000:3.0:1787384468.230190:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384468.230230:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182258816 00000100:00100000:3.0:1787384468.230240:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182258816 00000100:00100000:3.0:1787384468.230293:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 329 00000100:00100000:3.0:1787384468.230304:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+12:6186:x1874208182258816:12345-192.168.203.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384468.230321:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384468.230340:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c2090c00/0x7ef423838fba2927 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce36a6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.231642:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c2090c00/0x7ef423838fba2927 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36a6 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.231659:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c2090c00/0x7ef423838fba2927 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36a6 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.231680:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2090c00, rc 0) 00000100:00100000:3.0:1787384468.231758:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+13:6186:x1874208182258816:12345-192.168.203.45@tcp:101:ll_cfg_requeue.0 Request processed in 1454us (1577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384468.231768:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 329 00000100:00100000:1.0:1787384468.253135:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384468.253216:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182258944 00000100:00100000:0.0:1787384468.253227:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182258944 00000100:00100000:0.0:1787384468.253284:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 330 00000100:00100000:0.0:1787384468.253294:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+13:6186:x1874208182258944:12345-192.168.203.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384468.253467:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+13:6186:x1874208182258944:12345-192.168.203.45@tcp:501:ll_cfg_requeue.0 Request processed in 173us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384468.253475:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 330 00000100:00100000:3.0:1787384468.262876:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384468.262965:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182259072 00000100:00100000:1.0:1787384468.262974:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182259072 00000100:00100000:1.0:1787384468.263032:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 331 00000100:00100000:1.0:1787384468.263042:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+13:6186:x1874208182259072:12345-192.168.203.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787384468.263177:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+13:6186:x1874208182259072:12345-192.168.203.45@tcp:503:ll_cfg_requeue.0 Request processed in 136us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384468.263185:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 331 00010000:00010000:3.0:1787384468.412089:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384469.431802:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384469.944628:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203315712:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787384469.944699:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384469.944803:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203315840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787384469.944831:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384469.944880:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203315712 00000100:00100000:1.0:1787384469.944887:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203315712 00000100:00100000:0.0:1787384469.944970:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203315840 00000100:00100000:0.0:1787384469.944976:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203315840 00000100:00100000:1.0:1787384469.946529:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787384469.946555:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203315712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787384469.946592:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787384469.946675:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203315712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 133us (1975us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384469.948215:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787384469.948252:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787384469.948267:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203315840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787384469.948292:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787384469.948458:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203315840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 197us (3626us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384469.948467:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1787384469.948489:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787384469.948524:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3a6c700 x1874208203315712/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384485 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384469.948544:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203315712:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1787384469.954972:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3a6c000 x1874208203315840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384485 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384469.955645:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203315840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787384470.454900:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384470.454921:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203315968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787384470.454976:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874208203316480:0@lo:400:kworker.0 00000100:00100000:3.0:1787384470.454990:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384470.455004:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384470.455061:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203316352:0@lo:400:kworker.0 00000100:00100000:3.0:1787384470.455087:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384470.455105:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee31d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203316864:0@lo:400:kworker.0 00000100:00100000:1.0:1787384470.455281:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee31df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874208203316992:0@lo:400:kworker.0 00000100:00100000:1.0:1787384470.455313:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203316096:0@lo:400:kworker.0 00000100:00100000:1.0:1787384470.455343:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384470.455456:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384470.455483:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee31f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203317376:0@lo:400:kworker.0 00000100:00100000:1.0:1787384470.455483:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203316608:0@lo:400:kworker.0 00000100:00100000:3.0:1787384470.455506:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384470.455506:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384470.455521:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee31d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203317120:0@lo:400:kworker.0 00000100:00100000:3.0:1787384470.455537:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203316352 00000100:00100000:1.0:1787384470.455540:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384470.455544:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203316352 00000100:00100000:1.0:1787384470.455569:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787384470.455575:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203316224:0@lo:400:kworker.0 00000100:00100000:3.0:1787384470.455581:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203316608 00000100:00100000:3.0:1787384470.455583:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203316608 00000100:00100000:1.0:1787384470.455594:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384470.455598:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787384470.455605:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203316352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384470.455608:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203316736:0@lo:400:kworker.0 00000100:00100000:1.0:1787384470.455625:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384470.455633:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee31ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203317248:0@lo:400:kworker.0 00000100:00100000:1.0:1787384470.455650:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384470.455657:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203316352:12345-0@lo:400:kworker.0 Request processed in 52us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384470.455664:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787384470.455677:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203315968 00000100:00100000:3.0:1787384470.455680:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787384470.455689:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203315968 00000100:00100000:3.0:1787384470.455692:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee31c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203316608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384470.455724:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee31c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203316608:12345-0@lo:400:kworker.0 Request processed in 32us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384470.455724:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787384470.455730:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787384470.455730:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203315968:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787384470.455746:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203317376 00000100:00100000:3.0:1787384470.455749:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203317376 00002000:00000024:1.0:1787384470.455754:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787384470.455768:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203317248 00000100:00100000:3.0:1787384470.455771:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203317248 00000100:00100000:1.0:1787384470.455803:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3653:x1874208203315968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384470.455809:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787384470.455809:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787384470.455815:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c355aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3653:x1874208203317376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384470.455844:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c355aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3653:x1874208203317376:12345-0@lo:400:kworker.0 Request processed in 29us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384470.455849:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787384470.455860:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787384470.455866:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee31e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203317248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384470.455893:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee31e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203317248:12345-0@lo:400:kworker.0 Request processed in 27us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384470.455899:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787384470.455938:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203316352:0@lo:400:kworker.0 00010000:00080000:3.0:1787384470.455950:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee31f100 x1874208203317376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384470.455960:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee31f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203317376:0@lo:400:kworker.0 00010000:00080000:3.0:1787384470.455969:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f91d8000 x1874208203315968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384486 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384470.455981:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203315968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787384470.456050:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203316480 00000100:00100000:1.0:1787384470.456056:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203316480 00000100:00100000:1.0:1787384470.456073:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203316864 00000100:00100000:1.0:1787384470.456077:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203316864 00000100:00100000:1.0:1787384470.456088:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203317120 00000100:00100000:1.0:1787384470.456090:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203317120 00000100:00100000:1.0:1787384470.456099:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203316224 00000100:00100000:1.0:1787384470.456101:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203316224 00000100:00100000:1.0:1787384470.456110:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203316736 00000100:00100000:1.0:1787384470.456112:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203316736 00000100:00100000:1.0:1787384470.456124:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787384470.456130:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee31dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874208203316480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384470.456162:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee31dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874208203316480:12345-0@lo:400:kworker.0 Request processed in 32us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384470.456168:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787384470.456181:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787384470.456186:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203316864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384470.456224:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203316864:12345-0@lo:400:kworker.0 Request processed in 37us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384470.456229:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787384470.456241:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787384470.456246:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee31c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874208203317120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384470.456295:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee31c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874208203317120:12345-0@lo:400:kworker.0 Request processed in 48us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384470.456301:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787384470.456314:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787384470.456319:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee31ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203316224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384470.456343:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee31ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203316224:12345-0@lo:400:kworker.0 Request processed in 24us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384470.456349:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787384470.456439:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787384470.456446:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee31fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203316736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384470.456477:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee31fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203316736:12345-0@lo:400:kworker.0 Request processed in 32us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384470.456482:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:1.0:1787384470.456526:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787384470.456530:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787384470.456532:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787384470.456545:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384470.456655:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874208203316480:0@lo:400:kworker.0 00000100:00100000:1.0:1787384470.456683:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203316224:0@lo:400:kworker.0 00000100:00100000:1.0:1787384470.456691:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203316736:0@lo:400:kworker.0 00010000:00080000:1.0:1787384470.456701:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee31ce00 x1874208203317248/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384470.456710:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee31ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203317248:0@lo:400:kworker.0 00000100:00100000:1.0:1787384470.456718:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203316608:0@lo:400:kworker.0 00010000:00080000:1.0:1787384470.456737:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee31d180 x1874208203317120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384470.456745:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee31d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203317120:0@lo:400:kworker.0 00000100:00100000:1.0:1787384470.456766:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203316992 00000100:00100000:1.0:1787384470.456770:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203316992 00010000:00080000:3.0:1787384470.456881:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee31d880 x1874208203316864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384470.456890:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee31d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203316864:0@lo:400:kworker.0 00000100:00100000:1.0:1787384470.457043:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1787384470.457051:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee31f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874208203316992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384470.457093:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee31f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874208203316992:12345-0@lo:400:kworker.0 Request processed in 44us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384470.457099:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:1.0:1787384470.457116:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384470.457134:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee31df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874208203316992:0@lo:400:kworker.0 00000100:00100000:0.0:1787384470.457209:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203316096 00000100:00100000:0.0:1787384470.457215:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203316096 00000100:00100000:0.0:1787384470.457252:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1787384470.457260:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3651:x1874208203316096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384470.457296:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3651:x1874208203316096:12345-0@lo:400:kworker.0 Request processed in 37us (1953us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384470.457302:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1787384470.457464:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203316096:0@lo:400:kworker.0 00010000:00010000:3.0:1787384470.458489:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384470.966902:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd758e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203317504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787384470.966974:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384470.967034:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203317504 00000100:00100000:0.0:1787384470.967041:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203317504 00000100:00100000:0.0:1787384470.967083:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787384470.967091:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203317504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787384470.967111:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787384470.967188:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203317504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384470.967209:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:0.0:1787384470.967249:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8fd758e00 x1874208203317504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384486 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384470.967276:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd758e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203317504:0@lo:13:osp-pre-1-1.0 00000001:02000400:0.0:1787384471.071852:0:13390:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg345-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1787384471.406320:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384471.407223:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384471.407256:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384471.407275:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384471.407297:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384471.408065:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182259456 00000100:00100000:2.0:1787384471.408075:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182259456 00000100:00100000:2.0:1787384471.408129:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182259712 00000100:00100000:2.0:1787384471.408132:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182259712 00000100:00100000:2.0:1787384471.408145:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182259328 00000100:00100000:2.0:1787384471.408148:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182259328 00000100:00100000:2.0:1787384471.408158:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182259584 00000100:00100000:2.0:1787384471.408161:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182259584 00000100:00100000:2.0:1787384471.408177:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 203 00000100:00100000:2.0:1787384471.408185:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2415:x1874208182259456:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384471.408264:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2415:x1874208182259456:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 78us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384471.408272:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 203 00000100:00100000:2.0:1787384471.408291:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 204 00000100:00100000:2.0:1787384471.408299:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3adad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2415:x1874208182259712:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384471.408325:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3adad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2415:x1874208182259712:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 27us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384471.408332:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 204 00000100:00100000:2.0:1787384471.408344:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 205 00000100:00100000:2.0:1787384471.408350:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2415:x1874208182259328:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384471.408372:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2415:x1874208182259328:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 23us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384471.408379:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 205 00000100:00100000:2.0:1787384471.408390:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 206 00000100:00100000:2.0:1787384471.408395:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3adaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2415:x1874208182259584:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384471.408435:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3adaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2415:x1874208182259584:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 23us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384471.408450:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 206 00000100:00080000:2.0:1787384471.408476:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787384471.408480:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787384471.410189:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182259200 00000100:00100000:3.0:1787384471.410202:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182259200 00000100:00100000:3.0:1787384471.410268:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 333 00000100:00100000:3.0:1787384471.410276:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+13:2415:x1874208182259200:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384471.410344:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+13:2415:x1874208182259200:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 69us (4034us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384471.410352:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 333 00010000:00010000:1.0:1787384471.479871:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384472.504020:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384472.504271:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c355b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203317632:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787384472.504550:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384472.512190:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203317632 00000100:00100000:3.0:1787384472.512205:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203317632 00000100:00100000:3.0:1787384472.512478:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787384472.512489:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3ada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203317632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787384472.512530:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787384472.512633:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3ada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203317632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 145us (8083us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384472.512640:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787384472.512735:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c355b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203317632:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787384473.020991:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ad9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203317760:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787384473.021126:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384473.025056:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203317760 00000100:00100000:0.0:1787384473.025069:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203317760 00000100:00100000:0.0:1787384473.025123:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787384473.025131:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee31df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203317760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787384473.025176:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787384473.034083:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee31df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203317760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 8871us (12876us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384473.034099:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787384473.036998:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ad9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203317760:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787384473.531161:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384474.553214:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384475.063469:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee31d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203317888:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787384475.063542:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384475.063627:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203317888 00000100:00100000:0.0:1787384475.063635:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203317888 00000100:00100000:0.0:1787384475.063693:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787384475.063701:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd758e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203317888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787384475.063759:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787384475.063823:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd758e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203317888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384475.063830:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:0.0:1787384475.063850:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787384475.063879:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee31d180 x1874208203317888/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384491 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384475.063897:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee31d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203317888:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787384475.064535:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee31ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203318016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787384475.064578:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384475.065217:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203318016 00000100:00100000:1.0:1787384475.065226:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203318016 00000100:00100000:1.0:1787384475.065285:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787384475.065294:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3adb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203318016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787384475.065318:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787384475.065390:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3adb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203318016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384475.065410:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:1.0:1787384475.065453:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee31ce00 x1874208203318016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384491 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384475.065471:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee31ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203318016:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787384475.065697:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787384475.575151:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787384475.575189:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c355a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203318144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384475.575276:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787384475.575442:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384475.575635:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3558e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203318400:0@lo:400:kworker.0 00000100:00100000:3.0:1787384475.575670:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384475.575709:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203318912:0@lo:400:kworker.0 00000100:00100000:3.0:1787384475.575734:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384475.575755:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203319424:0@lo:400:kworker.0 00000100:00100000:3.0:1787384475.575821:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384475.575848:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787384475.575853:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c355b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203318528:0@lo:400:kworker.0 00000100:00100000:2.0:1787384475.576121:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203318144 00000100:00100000:2.0:1787384475.576131:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203318144 00000100:00100000:2.0:1787384475.576202:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787384475.576213:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203318144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787384475.576245:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384475.576294:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203318144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384475.576302:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:2.0:1787384475.576325:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787384475.576355:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203318400 00000100:00100000:2.0:1787384475.576359:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203318400 00000100:00100000:2.0:1787384475.576429:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203318912 00000100:00100000:2.0:1787384475.576433:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203318912 00000100:00100000:2.0:1787384475.576460:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787384475.576467:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203318400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384475.576503:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203318400:12345-0@lo:400:kworker.0 Request processed in 37us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384475.576521:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787384475.576533:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1787384475.576539:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203318912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384475.576567:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203318912:12345-0@lo:400:kworker.0 Request processed in 28us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384475.576572:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:2.0:1787384475.576605:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384475.576629:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203319424 00000100:00100000:2.0:1787384475.576632:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203319424 00000100:00100000:2.0:1787384475.576661:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787384475.576666:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203319424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384475.576696:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203319424:12345-0@lo:400:kworker.0 Request processed in 29us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384475.576701:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1787384475.576712:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787384475.577375:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3559180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203318272:0@lo:400:kworker.0 00000100:00100000:0.0:1787384475.577429:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384475.577467:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203318784:0@lo:400:kworker.0 00000100:00100000:0.0:1787384475.577506:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384475.577535:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7de3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874208203319296:0@lo:400:kworker.0 00000100:00100000:0.0:1787384475.577559:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787384475.577591:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c355a680 x1874208203318144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384491 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384475.577612:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c355a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203318144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384475.577633:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787384475.577639:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874208203318656:0@lo:400:kworker.0 00000100:00100000:0.0:1787384475.577663:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384475.577680:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874208203319168:0@lo:400:kworker.0 00000100:00100000:0.0:1787384475.577700:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384475.577725:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203319296 00000100:00100000:0.0:1787384475.577730:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203319296 00000100:00100000:0.0:1787384475.577767:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203318656 00000100:00100000:0.0:1787384475.577770:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203318656 00000100:00100000:0.0:1787384475.577802:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203319168 00000100:00100000:0.0:1787384475.577805:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203319168 00000100:00100000:0.0:1787384475.577821:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1787384475.577828:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee28bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874208203319296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384475.577871:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee28bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874208203319296:12345-0@lo:400:kworker.0 Request processed in 42us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384475.577877:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1787384475.577891:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1787384475.577897:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c355a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874208203318656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384475.577922:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c355a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874208203318656:12345-0@lo:400:kworker.0 Request processed in 26us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384475.577927:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1787384475.577945:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1787384475.577951:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874208203319168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384475.577997:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874208203319168:12345-0@lo:400:kworker.0 Request processed in 46us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384475.578003:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00080000:0.0:1787384475.578024:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787384475.578029:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787384475.578050:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874208203318656:0@lo:400:kworker.0 00000100:00100000:0.0:1787384475.578060:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874208203319168:0@lo:400:kworker.0 00010000:00080000:0.0:1787384475.578069:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7de3800 x1874208203319296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384475.578077:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7de3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874208203319296:0@lo:400:kworker.0 00000100:00100000:2.0:1787384475.578104:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384475.578124:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203319040:0@lo:400:kworker.0 00000100:00100000:0.0:1787384475.578126:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203318784 00000100:00100000:0.0:1787384475.578129:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203318784 00000100:00100000:2.0:1787384475.578147:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384475.578151:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203318528 00000100:00100000:0.0:1787384475.578153:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203318528 00000100:00100000:0.0:1787384475.578165:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787384475.578170:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3558e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203318400:0@lo:400:kworker.0 00000100:00100000:0.0:1787384475.578171:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee28b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203318784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384475.578196:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203318912:0@lo:400:kworker.0 00000100:00100000:1.0:1787384475.578252:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787384475.578261:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3ad8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203318528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384475.579179:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203318272 00000100:00100000:3.0:1787384475.579186:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203318272 00000100:00100000:3.0:1787384475.579225:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1787384475.579231:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3652:x1874208203318272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384475.582589:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee28b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203318784:12345-0@lo:400:kworker.0 Request processed in 4408us (5071us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384475.582603:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787384475.582653:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203319040 00000100:00100000:0.0:1787384475.582662:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203319040 00000100:00100000:0.0:1787384475.582712:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1787384475.582720:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3ad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203319040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384475.582798:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3ad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203319040:12345-0@lo:400:kworker.0 Request processed in 79us (4650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384475.582818:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00080000:0.0:1787384475.582837:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787384475.582872:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203318784:0@lo:400:kworker.0 00010000:00080000:2.0:1787384475.585350:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3b90e00 x1874208203319424/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384475.585384:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203319424:0@lo:400:kworker.0 00010000:00080000:2.0:1787384475.585436:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8fc1b6300 x1874208203319040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384475.585464:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203319040:0@lo:400:kworker.0 00000100:00100000:1.0:1787384475.586008:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3ad8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203318528:12345-0@lo:400:kworker.0 Request processed in 7744us (7899us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384475.586020:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787384475.586069:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c355b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203318528:0@lo:400:kworker.0 00000100:00100000:3.0:1787384475.596003:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3652:x1874208203318272:12345-0@lo:400:kworker.0 Request processed in 16762us (18563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384475.596296:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1787384475.613761:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3559180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203318272:0@lo:400:kworker.0 00000100:00100000:3.0:1787384476.087025:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384476.087050:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203319552:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787384476.087163:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384476.087434:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203319552 00000100:00100000:0.0:1787384476.087443:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203319552 00000100:00100000:0.0:1787384476.087508:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787384476.087528:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203319552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787384476.087550:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787384476.087602:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203319552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384476.087610:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:3.0:1787384476.087689:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f54f9880 x1874208203319552/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384492 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384476.087705:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203319552:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787384476.514847:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384476.514952:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182259840 00000100:00100000:0.0:1787384476.514968:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182259840 00000100:00100000:0.0:1787384476.515079:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 335 00000100:00100000:0.0:1787384476.515091:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+13:2413:x1874208182259840:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384476.515184:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+13:2413:x1874208182259840:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 88us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384476.515197:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 335 00000100:00100000:2.0:1787384476.516615:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384476.516690:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182260096 00000100:00100000:0.0:1787384476.516700:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182260096 00000100:00100000:2.0:1787384476.516749:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00080000:1.0:1787384476.516796:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787384476.516977:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384476.522288:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384476.522460:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182260352 00000100:00100000:0.0:1787384476.522476:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182260352 00000100:00100000:2.0:1787384476.522515:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182259968 00000100:00100000:2.0:1787384476.522526:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182259968 00000100:00100000:0.0:1787384476.522565:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182260224 00000100:00100000:0.0:1787384476.522572:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182260224 00000100:00100000:2.0:1787384476.522589:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 213 00000100:00100000:2.0:1787384476.522608:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3adbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2413:x1874208182260096:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384476.522620:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 214 00000100:00100000:0.0:1787384476.522633:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3ada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2413:x1874208182260352:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384476.522749:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3ada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2413:x1874208182260352:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 117us (6005us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384476.522757:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 214 00000100:00100000:0.0:1787384476.522792:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 215 00000100:00100000:0.0:1787384476.522800:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3adb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2413:x1874208182259968:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384476.522828:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3adb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2413:x1874208182259968:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 29us (5852us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384476.522833:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 215 00000100:00100000:0.0:1787384476.522845:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 216 00000100:00100000:0.0:1787384476.522850:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2413:x1874208182260224:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384476.523145:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3adbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2413:x1874208182260096:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 541us (8240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384476.523155:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 213 00000100:00100000:0.0:1787384476.525859:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2413:x1874208182260224:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 21us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384476.525893:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 216 00000100:00080000:0.0:1787384476.525967:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787384476.525974:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787384476.603729:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384477.624232:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203319680:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787384477.624326:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787384477.624365:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384477.624657:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203319680 00000100:00100000:0.0:1787384477.624671:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203319680 00000100:00100000:0.0:1787384477.624757:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787384477.624771:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee31ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203319680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787384477.624867:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787384477.625309:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee31ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203319680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 538us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384477.625321:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787384477.625502:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203319680:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1787384477.992510:0:13539:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 03:41:15 (1787384475) === 00000100:00100000:2.0:1787384478.135966:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787384478.135998:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203319808:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787384478.136093:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384478.136219:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203319808 00000100:00100000:2.0:1787384478.136229:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203319808 00000100:00100000:2.0:1787384478.136670:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787384478.136689:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203319808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787384478.136905:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787384478.136985:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203319808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 300us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384478.137012:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787384478.137100:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203319808:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787384478.254428:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384478.254482:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384478.254639:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182260480 00000100:00100000:1.0:1787384478.254649:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182260480 00000100:00100000:1.0:1787384478.254721:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 22 00000100:00100000:1.0:1787384478.254731:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2416:x1874208182260480:12345-192.168.203.45@tcp:41:mkdir.0 00000004:00000024:1.0:1787384478.254762:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787384478.254879:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182260608 00000100:00100000:2.0:1787384478.254885:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182260608 00000100:00100000:2.0:1787384478.254927:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 2 00000100:00100000:2.0:1787384478.254934:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3559180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:10507:x1874208182260608:12345-192.168.203.45@tcp:700:mkdir.0 00000100:00080000:0.0:1787384478.255634:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384478.257444:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:2416:x1874208182260480:12345-192.168.203.45@tcp:41:mkdir.0 Request processed in 2704us (3016us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384478.257465:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 22 00000100:00100000:2.0:1787384478.258603:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3559180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:10507:x1874208182260608:12345-192.168.203.45@tcp:700:mkdir.0 Request processed in 3662us (4113us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384478.258614:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 2 00000100:00100000:2.0:1787384478.266422:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384478.269601:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182260864 00000100:00100000:1.0:1787384478.269616:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182260864 00000100:00100000:1.0:1787384478.269727:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 23 00000100:00100000:1.0:1787384478.269738:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c355b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:10507:x1874208182260864:12345-192.168.203.45@tcp:36:mkdir.0 00010000:00010000:1.0:1787384478.269829:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384478.269928:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba27d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce361a expref: 6 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.269948:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c2950000) 00010000:00010000:1.0:1787384478.269959:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787384478.270075:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba292e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.270088:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba292e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.270099:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba292e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.270126:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba2935 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.270134:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba2935 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.270141:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba2935 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.270707:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba293c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.270725:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba293c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.270733:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba293c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787384478.270750:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000978d8d69 reply state 00000000569f5c0e transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba293c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.270762:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba293c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.270768:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98f8edc2e500) 00010000:00010000:1.0:1787384478.270770:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787384478.270773:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787384478.270804:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787384478.270813:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba292e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.270819:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba292e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.270826:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba292e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.270832:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3952c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384478.270836:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba292e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.270843:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba292e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.270864:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f8edc2ea00) 00010000:00010000:1.0:1787384478.270866:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384478.270870:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba292e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.270875:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba292e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787384478.270889:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000978d8d69 reply state 00000000569f5c0e transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba2935 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.270897:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba2935 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.270903:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98f8edc2e900) 00010000:00010000:1.0:1787384478.270905:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787384478.270907:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1787384478.271001:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c355b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:10507:x1874208182260864:12345-192.168.203.45@tcp:36:mkdir.0 Request processed in 1263us (4586us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787384478.271009:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 23 00000100:00100000:2.0:1787384478.294733:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384478.295007:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182260992 00000100:00100000:1.0:1787384478.295016:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182260992 00000100:00100000:1.0:1787384478.295074:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 24 00000100:00100000:1.0:1787384478.295083:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3558e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:10508:x1874208182260992:12345-192.168.203.45@tcp:101:chmod.0 00010000:00010000:1.0:1787384478.295106:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384478.295130:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba2943 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce36ad expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.295633:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953600/0x7ef423838fba294a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.295662:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953600/0x7ef423838fba294a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.295674:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953600/0x7ef423838fba294a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384478.295718:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787384478.295721:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787384478.295751:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953600/0x7ef423838fba294a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.295817:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba2943 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36ad expref: 9 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.295835:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953600/0x7ef423838fba294a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36ad expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.295843:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f8edc2ea00) 00010000:00010000:1.0:1787384478.295846:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787384478.295849:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3953600, rc 0) 00000100:00100000:1.0:1787384478.295901:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3558e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+8:10508:x1874208182260992:12345-192.168.203.45@tcp:101:chmod.0 Request processed in 819us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384478.298648:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 24 00000100:00100000:1.0:1787384478.302227:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384478.302503:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182261248 00000100:00100000:2.0:1787384478.302517:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182261248 00000100:00100000:2.0:1787384478.302579:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 25 00000100:00100000:2.0:1787384478.302589:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee31d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+8:10508:x1874208182261248:12345-192.168.203.45@tcp:36:chmod.0 00010000:00010000:2.0:1787384478.302644:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384478.302673:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953600/0x7ef423838fba294a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36ad expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.302691:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f8edc2ea00) 00010000:00010000:2.0:1787384478.302702:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787384478.302729:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031a00/0x7ef423838fba2951 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.302760:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031a00/0x7ef423838fba2951 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.302769:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031a00/0x7ef423838fba2951 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787384478.303652:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ace0aeb6 reply state 0000000036d5482a transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031a00/0x7ef423838fba2951 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.303668:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031a00/0x7ef423838fba2951 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.303676:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f8fc248200) 00010000:00010000:2.0:1787384478.303679:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787384478.303682:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787384478.303691:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787384478.303953:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee31d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+9:10508:x1874208182261248:12345-192.168.203.45@tcp:36:chmod.0 Request processed in 1363us (1733us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787384478.303963:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 25 00000100:00100000:2.0:1787384478.373412:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384478.376186:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182261376 00000100:00100000:3.0:1787384478.376202:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182261376 00000100:00100000:3.0:1787384478.376275:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 26 00000100:00100000:3.0:1787384478.376285:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4033100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+9:10509:x1874208182261376:12345-192.168.203.45@tcp:101:chown.0 00010000:00010000:3.0:1787384478.376321:0:8195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384478.376343:0:8195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091a00/0x7ef423838fba2958 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce36b4 expref: -99 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384478.376430:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091000/0x7ef423838fba295f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384478.376457:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091000/0x7ef423838fba295f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384478.376467:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091000/0x7ef423838fba295f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384478.376517:0:8195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787384478.376521:0:8195:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787384478.376567:0:8195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091000/0x7ef423838fba295f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384478.376595:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091a00/0x7ef423838fba2958 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36b4 expref: 11 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384478.376613:0:8195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091000/0x7ef423838fba295f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36b4 expref: 10 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384478.376621:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f8fc248200) 00010000:00010000:3.0:1787384478.376625:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787384478.376628:0:8195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2091000, rc 0) 00000100:00100000:3.0:1787384478.376703:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4033100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+10:10509:x1874208182261376:12345-192.168.203.45@tcp:101:chown.0 Request processed in 419us (3304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384478.376711:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 26 00000100:00100000:2.0:1787384478.383014:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384478.383504:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182261504 00000100:00100000:1.0:1787384478.383518:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182261504 00000100:00100000:1.0:1787384478.383586:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 27 00000100:00100000:1.0:1787384478.383595:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4030000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+10:10509:x1874208182261504:12345-192.168.203.45@tcp:101:chown.0 00010000:00010000:1.0:1787384478.383631:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384478.383664:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba2966 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce36bb expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.383740:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952600/0x7ef423838fba296d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.383757:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952600/0x7ef423838fba296d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.383770:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952600/0x7ef423838fba296d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.383829:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba2974 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.383837:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba2974 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.383844:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba2974 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.383943:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba297b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.383952:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba297b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.383958:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba297b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384478.384005:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787384478.384017:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787384478.384044:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba297b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.384059:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952600/0x7ef423838fba296d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.384066:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952600/0x7ef423838fba296d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.384073:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952600/0x7ef423838fba296d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.384078:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3952600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384478.384082:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952600/0x7ef423838fba296d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.384091:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952600/0x7ef423838fba296d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.384106:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f8fc248200) 00010000:00010000:1.0:1787384478.384109:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384478.384113:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952600/0x7ef423838fba296d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.384120:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952600/0x7ef423838fba296d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.384135:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba2974 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.384141:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba2974 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.384170:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba2974 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.384175:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3952400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384478.384178:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba2974 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.384185:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba2974 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.384192:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98f8edc2e900) 00010000:00010000:1.0:1787384478.384195:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384478.384198:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba2974 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.384203:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba2974 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.384232:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba2966 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36bb expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.384246:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba297b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36bb expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.384253:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98f8edc2e500) 00010000:00010000:1.0:1787384478.384254:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787384478.384257:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3952000, rc 0) 00000100:00100000:1.0:1787384478.384367:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4030000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+11:10509:x1874208182261504:12345-192.168.203.45@tcp:101:chown.0 Request processed in 771us (1365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384478.384391:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 27 00000100:00100000:2.0:1787384478.396268:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384478.403547:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182261632 00000100:00100000:3.0:1787384478.403564:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182261632 00000100:00100000:3.0:1787384478.403651:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 6 00000100:00100000:3.0:1787384478.403826:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4032680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+11:10509:x1874208182261632:12345-192.168.203.45@tcp:900:chown.0 00000100:00100000:3.0:1787384478.404021:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4032680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+11:10509:x1874208182261632:12345-192.168.203.45@tcp:900:chown.0 Request processed in 200us (7772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384478.404042:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 6 00000100:00100000:3.0:1787384478.421222:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384478.422619:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182261888 00000100:00100000:1.0:1787384478.422632:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182261888 00000100:00100000:1.0:1787384478.422716:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 28 00000100:00100000:1.0:1787384478.422726:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+11:10509:x1874208182261888:12345-192.168.203.45@tcp:36:chown.0 00010000:00010000:1.0:1787384478.422817:0:8195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384478.422842:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba297b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36bb expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.422861:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98f8edc2e500) 00010000:00010000:1.0:1787384478.422866:0:8195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787384478.422887:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba2982 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.422900:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba2982 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.422909:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba2982 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787384478.427163:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:2.0:1787384478.427300:0:8195:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000067ce3c3f reply state 00000000bbbbd758 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba2982 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.427326:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba2982 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.427337:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98f8edc2e500) 00010000:00010000:2.0:1787384478.427339:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787384478.427379:0:8195:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787384478.427394:0:8195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1787384478.427555:0:8195:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1787384478.427578:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+9:10509:x1874208182261888:12345-192.168.203.45@tcp:36:chown.0 Request processed in 4848us (6362us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787384478.427588:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 28 00010000:00010000:0.0:1787384478.427827:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba2982 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384478.427848:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba2982 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384478.427854:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba2982 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384478.427859:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3952c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384478.427863:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba2982 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384478.427870:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba2982 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384478.427881:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98f8edc2e500) 00010000:00010000:0.0:1787384478.427884:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787384478.427887:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba2982 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384478.427893:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba2982 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384478.428252:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba2935 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384478.428261:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba2935 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384478.428267:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba2935 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384478.428272:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3953c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384478.428275:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba2935 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384478.428282:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba2935 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384478.428291:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98f8edc2e900) 00010000:00010000:3.0:1787384478.428294:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384478.428297:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba2935 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384478.428303:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba2935 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384478.428319:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba293c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384478.428325:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba293c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384478.428342:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba293c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384478.428412:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3953400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384478.428467:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba293c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384478.428476:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba293c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384478.428485:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98f8edc2e500) 00010000:00010000:3.0:1787384478.428487:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384478.428490:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba293c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384478.428562:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba293c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384478.428580:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031a00/0x7ef423838fba2951 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384478.428587:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031a00/0x7ef423838fba2951 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384478.428592:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031a00/0x7ef423838fba2951 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384478.428597:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c0031a00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384478.428600:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031a00/0x7ef423838fba2951 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384478.428618:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031a00/0x7ef423838fba2951 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384478.428627:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f8fc248200) 00010000:00010000:3.0:1787384478.428629:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787384478.428633:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031a00/0x7ef423838fba2951 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384478.428639:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031a00/0x7ef423838fba2951 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384478.461949:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384478.463739:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182262016 00000100:00100000:1.0:1787384478.463753:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182262016 00000100:00100000:1.0:1787384478.463845:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 29 00000100:00100000:1.0:1787384478.463856:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4031180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:10510:x1874208182262016:12345-192.168.203.45@tcp:101:touch.500 00010000:00010000:1.0:1787384478.463880:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384478.463900:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba2989 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce36c2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787384478.466192:0:6522:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2200us 00010000:00010000:0.0:1787384478.481948:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba2990 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384478.482042:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba2990 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384478.482126:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba2990 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384478.482160:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba2997 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384478.482168:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba2997 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384478.482175:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba2997 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384478.482322:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba299e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384478.482986:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba299e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384478.482996:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba299e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384478.483041:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787384478.483056:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787384478.483104:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba299e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384478.483120:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba2990 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384478.483127:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba2990 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384478.483133:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba2990 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384478.483149:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b05400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384478.483154:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba2990 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384478.483162:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba2990 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384478.483176:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f8fc248200) 00010000:00010000:0.0:1787384478.483179:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384478.483186:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba2990 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384478.483192:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba2990 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384478.483205:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba2997 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384478.483211:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba2997 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384478.483216:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba2997 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384478.483221:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b04c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384478.483224:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba2997 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384478.483229:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba2997 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384478.483249:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98f7c3a9c300) 00010000:00010000:0.0:1787384478.483252:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384478.483255:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba2997 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384478.483262:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba2997 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384478.483305:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba2989 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36c2 expref: 8 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384478.483321:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba299e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36c2 expref: 7 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384478.483483:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98f7c3a9c000) 00010000:00010000:0.0:1787384478.483486:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787384478.483489:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3b05a00, rc 0) 00000100:00100000:0.0:1787384478.483571:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4031180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:10510:x1874208182262016:12345-192.168.203.45@tcp:101:touch.500 Request processed in 19715us (21628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384478.483581:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 29 00000100:00100000:1.0:1787384478.491403:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384478.495231:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182262272 00000100:00100000:2.0:1787384478.495247:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182262272 00000100:00100000:2.0:1787384478.495325:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 30 00000100:00100000:2.0:1787384478.495336:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee31d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:10510:x1874208182262272:12345-192.168.203.45@tcp:101:touch.500 00010000:00010000:2.0:1787384478.495358:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384478.495389:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031000/0x7ef423838fba29a5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce36c9 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.495724:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031a00/0x7ef423838fba29ac lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.495739:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031a00/0x7ef423838fba29ac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.495751:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031a00/0x7ef423838fba29ac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.495836:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030e00/0x7ef423838fba29b3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xb7582cda bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.495844:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030e00/0x7ef423838fba29b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.495851:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030e00/0x7ef423838fba29b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787384478.496685:0:6523:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:2.0:1787384478.497701:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031e00/0x7ef423838fba29ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.497721:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031e00/0x7ef423838fba29ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.497733:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031e00/0x7ef423838fba29ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.497768:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031a00/0x7ef423838fba29ac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.499725:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031a00/0x7ef423838fba29ac lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.499747:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031a00/0x7ef423838fba29ac lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.499754:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c0031a00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384478.499759:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031a00/0x7ef423838fba29ac lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.499769:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031a00/0x7ef423838fba29ac lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.500094:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98f7c3a9c000) 00010000:00010000:2.0:1787384478.500098:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384478.500103:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031a00/0x7ef423838fba29ac lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.500130:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031a00/0x7ef423838fba29ac lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787384478.500149:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000080f77029 reply state 0000000005eeff59 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030e00/0x7ef423838fba29b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.500162:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030e00/0x7ef423838fba29b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.500168:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xb7582cda (ffff98f8fc248700) 00010000:00010000:2.0:1787384478.500171:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787384478.500174:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787384478.500225:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031000/0x7ef423838fba29a5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36c9 expref: 10 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.500252:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031e00/0x7ef423838fba29ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36c9 expref: 9 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.500260:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff98f8fc248400) 00010000:00010000:2.0:1787384478.500262:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787384478.500265:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c0031e00, rc 0) 00000100:00100000:2.0:1787384478.500344:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee31d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+10:10510:x1874208182262272:12345-192.168.203.45@tcp:101:touch.500 Request processed in 5008us (8948us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787384478.500353:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 30 00000100:00100000:3.0:1787384478.504073:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384478.504217:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182262528 00000100:00100000:2.0:1787384478.504229:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182262528 00000100:00100000:2.0:1787384478.504294:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 31 00000100:00100000:2.0:1787384478.504304:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+10:10510:x1874208182262528:12345-192.168.203.45@tcp:36:touch.500 00010000:00010000:2.0:1787384478.504388:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384478.504419:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031e00/0x7ef423838fba29ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36c9 expref: 10 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.504439:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff98f8fc248400) 00010000:00010000:2.0:1787384478.504451:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787384478.504519:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031c00/0x7ef423838fba29c8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.504531:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031c00/0x7ef423838fba29c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.504541:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031c00/0x7ef423838fba29c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787384478.504646:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000abfda813 reply state 000000007bffeab1 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031c00/0x7ef423838fba29c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.504727:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031c00/0x7ef423838fba29c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.504735:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff98f8fc248000) 00010000:00010000:2.0:1787384478.504738:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787384478.504741:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787384478.504874:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+11:10510:x1874208182262528:12345-192.168.203.45@tcp:36:touch.500 Request processed in 570us (810us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787384478.504882:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 31 00000100:00100000:0.0:1787384478.513938:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384478.515175:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182262656 00000100:00100000:1.0:1787384478.515188:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182262656 00000100:00100000:1.0:1787384478.515256:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 32 00000100:00100000:1.0:1787384478.515266:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+11:10510:x1874208182262656:12345-192.168.203.45@tcp:101:touch.500 00010000:00010000:1.0:1787384478.515289:0:8195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384478.515310:0:8195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953800/0x7ef423838fba29cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce36d0 expref: -99 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.515387:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953800/0x7ef423838fba29cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36d0 expref: 12 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.515402:0:8195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953800/0x7ef423838fba29cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36d0 expref: 12 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.515420:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff98f8fc248000) 00010000:00010000:1.0:1787384478.515424:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787384478.515427:0:8195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3953800, rc 0) 00000100:00100000:1.0:1787384478.515489:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+12:10510:x1874208182262656:12345-192.168.203.45@tcp:101:touch.500 Request processed in 224us (1561us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384478.515497:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 32 00000100:00100000:1.0:1787384478.523447:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384478.527146:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182262784 00000100:00100000:3.0:1787384478.527164:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182262784 00000100:00100000:3.0:1787384478.527229:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 24 00000100:00100000:3.0:1787384478.527238:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2412:x1874208182262784:12345-192.168.203.45@tcp:8:touch.500 00010000:00080000:3.0:1787384478.527271:0:8436:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 55e96ad5-fd9d-44d4-856e-5db0c40b1329@192.168.203.45@tcp t0 exp 0000000000000000 cur 373 last 0 00000020:00000080:3.0:1787384478.527305:0:8436:0:(genops.c:1406:class_connect()) connect: client 55e96ad5-fd9d-44d4-856e-5db0c40b1329, cookie 0x7ef423838fba29d6 00002000:00100000:3.0:1787384478.527319:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 55e96ad5-fd9d-44d4-856e-5db0c40b1329/ffff98f8f7dfe000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113671 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787384478.527336:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b7, return b7 00002000:00080000:3.0:1787384478.527579:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787384478.527613:0:8436:0:(import.c:65:import_set_state_nolock()) ffff98f8f7dfb000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787384478.527734:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2412:x1874208182262784:12345-192.168.203.45@tcp:8:touch.500 Request processed in 495us (4296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384478.527743:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 24 00000100:00100000:3.0:1787384478.534160:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384478.534547:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182262912 00000100:00100000:2.0:1787384478.534561:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182262912 00000100:00100000:2.0:1787384478.534665:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 25 00000100:00100000:2.0:1787384478.534700:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:0:x1874208182262912:12345-192.168.203.45@tcp:2:touch.500 00000100:00080000:0.0:1787384478.535329:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1787384478.554968:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:1.0:1787384478.554984:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 55e96ad5-fd9d-44d4-856e-5db0c40b1329 00000100:00100000:2.0:1787384478.555581:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:0:x1874208182262912:12345-192.168.203.45@tcp:2:touch.500 Request processed in 20567us (21120us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787384478.555601:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 25 00000100:00100000:0.0:1787384478.561828:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384478.562048:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182263168 00000100:00100000:3.0:1787384478.562075:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182263168 00000100:00100000:3.0:1787384478.562139:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 2 00000100:00100000:3.0:1787384478.562150:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+12:10510:x1874208182263168:12345-192.168.203.45@tcp:35:touch.500 00000100:00100000:3.0:1787384478.562596:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+13:10510:x1874208182263168:12345-192.168.203.45@tcp:35:touch.500 Request processed in 446us (826us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787384478.562604:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 2 00000100:00100000:1.0:1787384478.601553:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384478.602480:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182263296 00000100:00100000:2.0:1787384478.602490:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182263296 00000100:00100000:2.0:1787384478.602556:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 33 00000100:00100000:2.0:1787384478.602566:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+13:10511:x1874208182263296:12345-192.168.203.45@tcp:101:rm.0 00010000:00010000:2.0:1787384478.602744:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384478.602807:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031e00/0x7ef423838fba29dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce36d7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.602881:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031000/0x7ef423838fba29e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.602896:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031000/0x7ef423838fba29e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.602912:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031000/0x7ef423838fba29e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384478.602962:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787384478.602966:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787384478.603001:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031000/0x7ef423838fba29e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.603026:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031e00/0x7ef423838fba29dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36d7 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.603062:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031000/0x7ef423838fba29e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36d7 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.603071:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98f7c3a9c000) 00010000:00010000:2.0:1787384478.603074:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787384478.603078:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c0031000, rc 0) 00000100:00100000:2.0:1787384478.603172:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+14:10511:x1874208182263296:12345-192.168.203.45@tcp:101:rm.0 Request processed in 607us (1627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384478.603180:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 33 00000100:00100000:0.0:1787384478.616950:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384478.617176:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182263552 00000100:00100000:1.0:1787384478.617203:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182263552 00000100:00100000:1.0:1787384478.617281:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 34 00000100:00100000:1.0:1787384478.617291:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+14:10511:x1874208182263552:12345-192.168.203.45@tcp:101:rm.0 00010000:00010000:1.0:1787384478.617315:0:8195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384478.617338:0:8195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952600/0x7ef423838fba29eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce36de expref: -99 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384478.617466:0:8195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787384478.617912:0:8195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952600/0x7ef423838fba29eb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36de expref: 16 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.617927:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f8fc248200) 00010000:00010000:1.0:1787384478.617930:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787384478.617935:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952600/0x7ef423838fba29eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36de expref: 16 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.617949:0:8195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3952600, rc 0) 00000100:00100000:1.0:1787384478.618184:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+15:10511:x1874208182263552:12345-192.168.203.45@tcp:101:rm.0 Request processed in 893us (1242us total) trans 4294967305 rc 301/301 00000100:00100000:1.0:1787384478.618193:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 34 00000100:00100000:1.0:1787384478.627127:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384478.627243:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182263680 00000100:00100000:3.0:1787384478.627253:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182263680 00000100:00100000:3.0:1787384478.627312:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 3 00000100:00100000:3.0:1787384478.627322:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+15:10511:x1874208182263680:12345-192.168.203.45@tcp:37:rm.0 00000100:00100000:3.0:1787384478.635077:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+15:10511:x1874208182263680:12345-192.168.203.45@tcp:37:rm.0 Request processed in 7743us (7948us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384478.635092:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 3 00000100:00100000:0.0:1787384478.644751:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384478.644939:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182263936 00000100:00100000:2.0:1787384478.644949:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182263936 00000100:00100000:2.0:1787384478.645005:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 4 00000100:00100000:2.0:1787384478.645015:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9507c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+15:10511:x1874208182263936:12345-192.168.203.45@tcp:35:rm.0 00000100:00100000:2.0:1787384478.645244:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9507c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+16:10511:x1874208182263936:12345-192.168.203.45@tcp:35:rm.0 Request processed in 230us (503us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787384478.645253:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 4 00000100:00100000:3.0:1787384478.653592:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384478.655850:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182264192 00000100:00100000:2.0:1787384478.655865:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182264192 00000100:00100000:2.0:1787384478.655924:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 35 00000100:00100000:2.0:1787384478.655933:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+16:10511:x1874208182264192:12345-192.168.203.45@tcp:101:rm.0 00010000:00010000:2.0:1787384478.655957:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384478.655976:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031a00/0x7ef423838fba29f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce36e5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.656077:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031e00/0x7ef423838fba2a00 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.656103:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031e00/0x7ef423838fba2a00 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.656114:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031e00/0x7ef423838fba2a00 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384478.656125:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787384478.656247:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031a00/0x7ef423838fba29f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36e5 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.656738:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031e00/0x7ef423838fba2a00 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36e5 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.656748:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98f7c3a9c000) 00010000:00010000:2.0:1787384478.656751:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787384478.656755:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c0031e00, rc 0) 00000100:00100000:2.0:1787384478.656873:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+18:10511:x1874208182264192:12345-192.168.203.45@tcp:101:rm.0 Request processed in 941us (3292us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787384478.656881:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 35 00010000:00010000:1.0:1787384478.658718:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384478.665599:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384478.665740:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182264320 00000100:00100000:2.0:1787384478.665751:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182264320 00000100:00100000:2.0:1787384478.665862:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 36 00000100:00100000:2.0:1787384478.665873:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+18:10511:x1874208182264320:12345-192.168.203.45@tcp:41:rm.0 00000004:00000024:2.0:1787384478.665934:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1787384478.666004:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+18:10511:x1874208182264320:12345-192.168.203.45@tcp:41:rm.0 Request processed in 132us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384478.666011:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 36 00000100:00100000:0.0:1787384478.669128:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384478.670487:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182264448 00000100:00100000:2.0:1787384478.670505:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182264448 00000100:00100000:2.0:1787384478.670599:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 37 00000100:00100000:2.0:1787384478.670613:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+18:10511:x1874208182264448:12345-192.168.203.45@tcp:101:rm.0 00010000:00010000:2.0:1787384478.670638:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384478.670664:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031a00/0x7ef423838fba2a0e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce36ec expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.670745:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148de00/0x7ef423838fba2a15 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.670762:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148de00/0x7ef423838fba2a15 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.670808:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148de00/0x7ef423838fba2a15 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.670826:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148d000/0x7ef423838fba2a1c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.670834:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148d000/0x7ef423838fba2a1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.670842:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148d000/0x7ef423838fba2a1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.670961:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b800/0x7ef423838fba2a23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.670970:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b800/0x7ef423838fba2a23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.670988:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b800/0x7ef423838fba2a23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384478.671027:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787384478.671031:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787384478.671051:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b800/0x7ef423838fba2a23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.671064:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b800/0x7ef423838fba2a23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.671072:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148de00/0x7ef423838fba2a15 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.671078:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148de00/0x7ef423838fba2a15 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.671084:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148de00/0x7ef423838fba2a15 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.671090:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c148de00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384478.671094:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148de00/0x7ef423838fba2a15 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.671101:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148de00/0x7ef423838fba2a15 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.671113:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98f7c3a9c000) 00010000:00010000:2.0:1787384478.671116:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384478.671120:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148de00/0x7ef423838fba2a15 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.671136:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148de00/0x7ef423838fba2a15 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.671151:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148d000/0x7ef423838fba2a1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.671158:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148d000/0x7ef423838fba2a1c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.671163:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148d000/0x7ef423838fba2a1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.671167:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c148d000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384478.671473:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148d000/0x7ef423838fba2a1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.671481:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148d000/0x7ef423838fba2a1c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.671491:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xb7582cda (ffff98f8fc248700) 00010000:00010000:2.0:1787384478.671493:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384478.671496:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148d000/0x7ef423838fba2a1c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.671501:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c148d000/0x7ef423838fba2a1c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.671532:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031a00/0x7ef423838fba2a0e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36ec expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.671546:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b800/0x7ef423838fba2a23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36ec expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.671560:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff98f8fc248000) 00010000:00010000:2.0:1787384478.671563:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787384478.671566:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965b800, rc 0) 00000100:00100000:2.0:1787384478.671639:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+19:10511:x1874208182264448:12345-192.168.203.45@tcp:101:rm.0 Request processed in 1028us (2525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384478.671647:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 37 00000100:00100000:3.0:1787384478.676093:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384478.676356:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182264704 00000100:00100000:2.0:1787384478.676381:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182264704 00000100:00100000:2.0:1787384478.676465:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 38 00000100:00100000:2.0:1787384478.676476:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+19:10511:x1874208182264704:12345-192.168.203.45@tcp:36:rm.0 00010000:00010000:2.0:1787384478.676533:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787384478.676560:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b800/0x7ef423838fba2a23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36ec expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.676580:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953800/0x7ef423838fba29cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36d0 expref: 18 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.676591:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff98f8fc248000) 00010000:00010000:2.0:1787384478.676600:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031000/0x7ef423838fba29e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36d7 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.676609:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98f7c3a9c000) 00010000:00010000:2.0:1787384478.676612:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787384478.676633:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba2a2a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.676667:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba2a2a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.676679:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba2a2a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.676692:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba2a31 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xb7582cda bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.676699:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba2a31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.676704:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba2a31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.676860:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b000/0x7ef423838fba2a38 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.676868:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b000/0x7ef423838fba2a38 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.676875:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b000/0x7ef423838fba2a38 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787384478.678707:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1787384478.678721:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 373758942214ns, next at 374758939104ns, rc = 0 00010000:00010000:2.0:1787384478.678805:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba2a3f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.678821:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba2a3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.678850:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba2a3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.678859:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba2a3f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.678865:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba2a3f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.678871:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba2a3f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.679042:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787384478.679063:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b000/0x7ef423838fba2a38 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.679070:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b000/0x7ef423838fba2a38 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.679075:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b000/0x7ef423838fba2a38 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.679081:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965b000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384478.679085:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b000/0x7ef423838fba2a38 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.679093:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b000/0x7ef423838fba2a38 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.679103:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff98f8fc248000) 00010000:00010000:2.0:1787384478.679106:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787384478.679117:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b000/0x7ef423838fba2a38 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.679124:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b000/0x7ef423838fba2a38 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.679144:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba2a2a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.679151:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba2a2a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.679156:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba2a2a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.679161:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965a200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384478.679163:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba2a2a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.679169:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba2a2a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.679177:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98f7c3a9c000) 00010000:00010000:2.0:1787384478.679179:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384478.679182:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba2a2a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.679199:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba2a2a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787384478.679208:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000054704fb6 reply state 00000000baf9ed2a transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba2a31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.679230:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba2a31 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384478.679237:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xb7582cda (ffff98f8fc248700) 00010000:00010000:2.0:1787384478.679239:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787384478.679241:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787384478.679330:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+18:10511:x1874208182264704:12345-192.168.203.45@tcp:36:rm.0 Request processed in 2850us (3247us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787384478.679339:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 38 00010000:00010000:3.0:1787384478.684596:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384478.684612:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba2a3f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384478.684625:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965be00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:3.0:1787384478.684630:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba2a3f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384478.684640:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba2a3f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384478.684658:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff98f8fc248000) 00010000:00010000:3.0:1787384478.684661:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787384478.684681:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba2a3f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384478.684688:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba2a3f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384478.684704:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384478.684706:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384478.684708:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384478.685135:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384478.685424:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182264960 00000100:00100000:2.0:1787384478.685434:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182264960 00000100:00100000:0.0:1787384478.685573:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 5 00000100:00100000:0.0:1787384478.685582:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+18:10511:x1874208182264960:12345-192.168.203.45@tcp:35:rm.0 00000100:00100000:0.0:1787384478.685845:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+19:10511:x1874208182264960:12345-192.168.203.45@tcp:35:rm.0 Request processed in 262us (712us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787384478.685853:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 5 00000100:00100000:0.0:1787384478.690499:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384478.690745:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182265216 00000100:00100000:1.0:1787384478.690757:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182265216 00000100:00100000:1.0:1787384478.691219:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 39 00000100:00100000:1.0:1787384478.691232:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+19:10511:x1874208182265216:12345-192.168.203.45@tcp:36:rm.0 00010000:00010000:1.0:1787384478.691301:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787384478.691341:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031e00/0x7ef423838fba2a00 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36e5 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.691364:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba299e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36c2 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.691386:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98f7c3a9c000) 00010000:00010000:1.0:1787384478.691403:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091000/0x7ef423838fba295f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36b4 expref: 17 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.691412:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f8fc248200) 00010000:00010000:1.0:1787384478.691419:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787384478.691445:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba2a46 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.691457:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba2a46 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.691467:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba2a46 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.691480:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba2a4d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.691487:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba2a4d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.691494:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba2a4d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.691581:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba2a54 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.691595:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba2a54 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.691601:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba2a54 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384478.692032:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787384478.692049:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba2a54 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.692056:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba2a54 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.692062:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba2a54 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.692068:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3952c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384478.692072:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba2a54 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.692080:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba2a54 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.692090:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff98f8edc2e300) 00010000:00010000:1.0:1787384478.692093:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787384478.692097:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba2a54 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.692103:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba2a54 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.692126:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba2a46 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.692140:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba2a46 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.692145:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba2a46 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.692151:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3953400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384478.692154:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba2a46 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.692159:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba2a46 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.692168:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f8edc2e600) 00010000:00010000:1.0:1787384478.692170:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384478.692173:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba2a46 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.692179:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba2a46 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787384478.692192:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f6f05bf8 reply state 000000003defce32 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba2a4d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.692203:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba2a4d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384478.692209:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98f8edc2e400) 00010000:00010000:1.0:1787384478.692212:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787384478.692215:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787384478.692342:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+18:10511:x1874208182265216:12345-192.168.203.45@tcp:36:rm.0 Request processed in 1112us (1853us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787384478.692357:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 39 00010000:00010000:2.0:1787384479.670966:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787384480.182961:0:8888:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 375263178940ns, next at 376263176298ns, rc = 0 00000100:00100000:1.0:1787384480.182987:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787384480.183008:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203319936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787384480.183072:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384480.183137:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203319936 00000100:00100000:1.0:1787384480.183145:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203319936 00000100:00100000:1.0:1787384480.183194:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787384480.183214:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb125500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203319936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787384480.183241:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787384480.183284:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb125500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203319936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384480.183291:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:1.0:1787384480.183324:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787384480.183373:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8cb126680 x1874208203319936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384496 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384480.183391:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203319936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787384480.185005:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787384480.185023:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4032d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203320064:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787384480.185086:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384480.185880:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203320064 00000100:00100000:1.0:1787384480.185889:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203320064 00000100:00100000:1.0:1787384480.185954:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787384480.185963:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4031c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203320064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787384480.185985:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787384480.186044:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4031c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203320064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384480.186051:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:1.0:1787384480.186111:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4032d80 x1874208203320064/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384496 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384480.186130:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4032d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203320064:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787384480.186911:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787384480.695080:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384480.695261:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c20d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203320192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787384480.695338:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384480.695443:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203320192 00000100:00100000:1.0:1787384480.695451:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203320192 00000100:00100000:1.0:1787384480.695506:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787384480.695515:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4031f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203320192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787384480.695542:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787384480.697885:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203320320:0@lo:400:kworker.0 00000100:00100000:3.0:1787384480.697954:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384480.698020:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203320320 00000100:00100000:3.0:1787384480.698026:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203320320 00000100:00100000:3.0:1787384480.698068:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1787384480.698076:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3652:x1874208203320320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384480.698122:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3652:x1874208203320320:12345-0@lo:400:kworker.0 Request processed in 45us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384480.698130:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1787384480.698178:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203320320:0@lo:400:kworker.0 00000100:00080000:3.0:1787384480.698495:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787384480.700471:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4031f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203320192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4949us (5124us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384480.700485:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787384480.701808:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203320576:0@lo:400:kworker.0 00000100:00100000:3.0:1787384480.701889:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384480.701940:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874208203321088:0@lo:400:kworker.0 00000100:00100000:3.0:1787384480.702011:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384480.702058:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787384480.702070:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874208203320448:0@lo:400:kworker.0 00000100:00100000:3.0:1787384480.702109:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384480.702151:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874208203320960:0@lo:400:kworker.0 00000100:00100000:3.0:1787384480.702175:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384480.702192:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203321472:0@lo:400:kworker.0 00000100:00100000:3.0:1787384480.702213:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384480.702248:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203321088 00000100:00100000:3.0:1787384480.702256:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203321088 00000100:00100000:3.0:1787384480.702321:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203320448 00000100:00100000:3.0:1787384480.702324:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203320448 00000100:00100000:3.0:1787384480.702337:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203320960 00000100:00100000:3.0:1787384480.702339:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203320960 00000100:00100000:3.0:1787384480.702366:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787384480.702375:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874208203321088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384480.702452:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874208203321088:12345-0@lo:400:kworker.0 Request processed in 76us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384480.702463:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787384480.702486:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1787384480.702492:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874208203320448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384480.702519:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874208203320448:12345-0@lo:400:kworker.0 Request processed in 28us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384480.702524:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1787384480.702535:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1787384480.702541:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874208203320960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384480.702566:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874208203320960:12345-0@lo:400:kworker.0 Request processed in 25us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384480.702571:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1787384480.702590:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203321472 00000100:00100000:3.0:1787384480.702594:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203321472 00000100:00100000:3.0:1787384480.702633:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787384480.702639:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203321472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384480.702688:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203321472:12345-0@lo:400:kworker.0 Request processed in 47us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384480.702697:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1787384480.702726:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787384480.702733:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787384480.702736:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787384480.702768:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203320832:0@lo:400:kworker.0 00000100:00100000:3.0:1787384480.702834:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384480.702855:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874208203321344:0@lo:400:kworker.0 00000100:00100000:3.0:1787384480.702875:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384480.702891:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787384480.702898:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874208203320704:0@lo:400:kworker.0 00000100:00100000:3.0:1787384480.702919:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384480.702946:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874208203321216:0@lo:400:kworker.0 00000100:00100000:3.0:1787384480.702977:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384480.703018:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203320576 00000100:00100000:3.0:1787384480.703026:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203320576 00000100:00100000:3.0:1787384480.703068:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203320832 00000100:00100000:3.0:1787384480.703073:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203320832 00000100:00100000:3.0:1787384480.703097:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787384480.703108:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203320576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384480.703161:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203320576:12345-0@lo:400:kworker.0 Request processed in 53us (1268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384480.703171:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787384480.703191:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787384480.703205:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203320832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384480.703242:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203320832:12345-0@lo:400:kworker.0 Request processed in 37us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384480.703248:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787384480.703267:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203321344 00000100:00100000:3.0:1787384480.703271:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203321344 00000100:00100000:3.0:1787384480.703295:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203320704 00000100:00100000:3.0:1787384480.703298:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203320704 00000100:00100000:3.0:1787384480.703307:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203321216 00000100:00100000:3.0:1787384480.703309:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203321216 00000100:00100000:3.0:1787384480.703323:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787384480.703329:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874208203321344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384480.703372:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874208203321344:12345-0@lo:400:kworker.0 Request processed in 43us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384480.703378:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787384480.703395:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787384480.703405:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874208203320704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384480.703452:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874208203320704:12345-0@lo:400:kworker.0 Request processed in 47us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384480.703461:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787384480.703478:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787384480.703484:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874208203321216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384480.703509:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874208203321216:12345-0@lo:400:kworker.0 Request processed in 26us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384480.703515:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00080000:3.0:1787384480.703530:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787384480.703533:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787384480.703572:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874208203320704:0@lo:400:kworker.0 00000100:00100000:3.0:1787384480.703583:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874208203321216:0@lo:400:kworker.0 00000100:00100000:3.0:1787384480.703592:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203320832:0@lo:400:kworker.0 00010000:00080000:3.0:1787384480.703601:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c422ce00 x1874208203321344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384480.703610:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874208203321344:0@lo:400:kworker.0 00000100:00100000:3.0:1787384480.703651:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874208203320448:0@lo:400:kworker.0 00000100:00100000:3.0:1787384480.703661:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874208203320960:0@lo:400:kworker.0 00010000:00080000:3.0:1787384480.703671:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c422e300 x1874208203321472/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384480.703680:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203321472:0@lo:400:kworker.0 00000100:00100000:3.0:1787384480.703697:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203320576:0@lo:400:kworker.0 00010000:00080000:3.0:1787384480.703713:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c422d180 x1874208203321088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384480.703724:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874208203321088:0@lo:400:kworker.0 00010000:00080000:2.0:1787384480.705813:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c20d1f80 x1874208203320192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384496 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384480.705839:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c20d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203320192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787384481.211126:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787384481.211149:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203321600:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787384481.211217:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384481.211268:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203321600 00000100:00100000:2.0:1787384481.211277:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203321600 00000100:00100000:2.0:1787384481.211318:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787384481.211324:0:8440:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1787384481.211327:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203321600:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787384481.211332:0:8440:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:2.0:1787384481.211359:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384481.211415:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203321600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384481.211433:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:1.0:1787384481.212762:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c422d180 x1874208203321600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384497 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384481.212834:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203321600:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787384481.639102:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384481.639148:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384481.639163:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384481.639176:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384481.639191:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384481.639210:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384481.639364:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182265344 00000100:00100000:3.0:1787384481.639374:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182265344 00000100:00100000:3.0:1787384481.639425:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 337 00000100:00100000:3.0:1787384481.639433:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+13:2415:x1874208182265344:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384481.639496:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+13:2415:x1874208182265344:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 63us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384481.639514:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 337 00000100:00100000:3.0:1787384481.639547:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182265600 00000100:00100000:3.0:1787384481.639551:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182265600 00000100:00100000:3.0:1787384481.639582:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182265856 00000100:00100000:3.0:1787384481.639585:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182265856 00000100:00100000:3.0:1787384481.639611:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182265472 00000100:00100000:3.0:1787384481.639613:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182265472 00000100:00100000:3.0:1787384481.639626:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182265984 00000100:00100000:3.0:1787384481.639628:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182265984 00000100:00100000:3.0:1787384481.639643:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 223 00000100:00100000:3.0:1787384481.639649:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4031880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2415:x1874208182265600:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384481.639692:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4031880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2415:x1874208182265600:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 42us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384481.639699:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 223 00000100:00100000:3.0:1787384481.639712:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 224 00000100:00100000:3.0:1787384481.639718:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4030380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2415:x1874208182265856:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384481.639743:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4030380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2415:x1874208182265856:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 25us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384481.639749:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 224 00000100:00100000:3.0:1787384481.639760:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 225 00000100:00100000:3.0:1787384481.639765:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4032a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+18:2415:x1874208182265472:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384481.639821:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4032a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+18:2415:x1874208182265472:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 55us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384481.639827:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 225 00000100:00100000:3.0:1787384481.639837:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 226 00000100:00100000:3.0:1787384481.639850:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2415:x1874208182265984:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384481.639878:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2415:x1874208182265984:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 28us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384481.639884:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 226 00000100:00100000:3.0:1787384481.639910:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182265728 00000100:00100000:3.0:1787384481.639915:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182265728 00000100:00100000:3.0:1787384481.639946:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 78 00000100:00100000:3.0:1787384481.639953:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4032d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2415:x1874208182265728:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384481.639977:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4032d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2415:x1874208182265728:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 25us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384481.639983:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 78 00000100:00080000:3.0:1787384481.640103:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787384481.640108:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787384481.640110:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787384481.719257:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384482.744484:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787384482.744507:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c355a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203321728:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787384482.744574:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787384482.744928:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384482.745215:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203321728 00000100:00100000:2.0:1787384482.745225:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203321728 00000100:00100000:2.0:1787384482.745289:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787384482.745300:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203321728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787384482.745335:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787384482.745407:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203321728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384482.745415:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787384482.745623:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c355a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203321728:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787384483.255063:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c355a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203321856:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787384483.255166:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384483.255285:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203321856 00000100:00100000:2.0:1787384483.255296:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203321856 00000100:00100000:2.0:1787384483.255375:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787384483.255385:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203321856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787384483.255432:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787384483.255729:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203321856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384483.255739:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787384483.255893:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c355a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203321856:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787384483.773576:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787384483.783065:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:2.0:1787384483.783106:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:2.0:1787384483.783118:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:0.0:1787384483.784579:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030e00/0x7ef423838fba29b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384483.784597:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030e00/0x7ef423838fba29b3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384483.784606:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030e00/0x7ef423838fba29b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384483.784623:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c0030e00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384483.784628:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030e00/0x7ef423838fba29b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384483.784636:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030e00/0x7ef423838fba29b3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384483.784653:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xb7582cda (ffff98f8fc248700) 00010000:00010000:0.0:1787384483.784661:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384483.784667:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030e00/0x7ef423838fba29b3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384483.784674:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0030e00/0x7ef423838fba29b3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384483.784696:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031c00/0x7ef423838fba29c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384483.784703:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031c00/0x7ef423838fba29c8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384483.784709:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031c00/0x7ef423838fba29c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384483.784714:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c0031c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384483.784717:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031c00/0x7ef423838fba29c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384483.784723:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031c00/0x7ef423838fba29c8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384483.784731:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff98f8fc248000) 00010000:00010000:0.0:1787384483.784733:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384483.784736:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031c00/0x7ef423838fba29c8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384483.784742:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c0031c00/0x7ef423838fba29c8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384483.784772:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba2a31 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384483.784805:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba2a31 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384483.784811:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba2a31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384483.784826:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965a800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384483.784829:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba2a31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384483.784835:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba2a31 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384483.784844:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xb7582cda (ffff98f8fc248700) 00010000:00010000:0.0:1787384483.784847:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384483.784850:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba2a31 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384483.784856:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba2a31 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xb7582cda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384483.784871:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba2a4d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384483.784878:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba2a4d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384483.784883:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba2a4d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384483.784889:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3953c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384483.784896:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba2a4d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384483.784903:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba2a4d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384483.784912:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98f8edc2e400) 00010000:00010000:0.0:1787384483.784914:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384483.784917:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba2a4d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384483.784924:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba2a4d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384483.785381:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203321984:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787384483.785454:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384483.785538:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203321984 00000100:00100000:1.0:1787384483.785548:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203321984 00000100:00100000:1.0:1787384483.789379:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787384483.789411:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203321984:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787384483.789446:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:1.0:1787384483.789487:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a89529d, atime: 0x6a89529d, ctime: 0x6a89529d, blocks: 0x0 00010000:00010000:1.0:1787384483.789496:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060c5a1fc/0x7ef423838fba2a5b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384483.789513:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=378s v=(0 0) 00010000:00010000:1.0:1787384483.789518:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384483.789525:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060c5a1fc/0x7ef423838fba2a5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384483.789545:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060c5a1fc/0x7ef423838fba2a5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384483.789558:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060c5a1fc/0x7ef423838fba2a5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384483.789566:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060c5a1fc/0x7ef423838fba2a5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384483.789604:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787384483.789815:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787384483.789821:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3653:x1874208203321984:12345-0@lo:6:osp-syn-0-0.0 Request processed in 425us (4367us total) trans 4294967301 rc 0/0 00010000:00010000:2.0:1787384483.789822:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060c5a1fc/0x7ef423838fba2a5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384483.789829:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1787384483.789830:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3952e00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:2.0:1787384483.789834:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060c5a1fc/0x7ef423838fba2a5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384483.789843:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060c5a1fc/0x7ef423838fba2a5b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787384483.789858:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787384483.789860:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060c5a1fc/0x7ef423838fba2a5b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384483.789867:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060c5a1fc/0x7ef423838fba2a5b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384483.789885:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384483.789887:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384483.789889:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787384483.789901:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98f8cb127800/2, rc 0, transno 4294967301 00000100:00100000:1.0:1787384483.789921:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203321984:0@lo:6:osp-syn-0-0.0 00000001:02000400:2.0:1787384483.814267:0:13688:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1787384484.791528:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787384485.042512:0:13736:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffcace6c450 00000020:00000080:1.0:1787384485.042536:0:13736:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1787384485.042542:0:13736:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1787384485.042552:0:13736:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcace6e6e0 20000000:00000080:1.0:1787384485.042561:0:13736:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98f8f7de7400 uarg=0000000000000000 20000000:01000000:1.0:1787384485.042628:0:13736:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1787384485.042636:0:13736:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1787384485.042644:0:13736:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1787384485.045073:0:13737:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1787384485.045795:0:13736:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1787384485.059435:0:13736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1787384485.059580:0:13736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1787384485.059608:0:13736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1787384485.059630:0:13736:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787384485.059659:0:13736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98f7c3952c00/0x7ef423838fba2a62 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384485.059905:0:13736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f7c3953e00/0x7ef423838fba28ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba28e8 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384485.059916:0:13736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f7c3953000/0x7ef423838fba28fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba28f6 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384485.059923:0:13736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f7c3953a00/0x7ef423838fba290b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2904 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384485.059929:0:13736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f7c3b05e00/0x7ef423838fba2919 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2912 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384485.059937:0:13736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f7c2091e00/0x7ef423838fba2920 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce369f expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384485.059962:0:13736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f7c2090c00/0x7ef423838fba2927 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36a6 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384485.059969:0:13736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98f7c3952c00/0x7ef423838fba2a62 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384485.060015:0:13736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f7c2090c00/0x7ef423838fba2927 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36a6 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384485.060032:0:13736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f7c2090c00/0x7ef423838fba2927 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36a6 expref: 12 pid: 6516 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384485.060049:0:13736:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb124000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1874208203322112:192.168.203.45@tcp:104: 00010000:00010000:1.0:1787384485.062178:0:13736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f7c2091e00/0x7ef423838fba2920 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce369f expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384485.062199:0:13736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f7c2091e00/0x7ef423838fba2920 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce369f expref: 12 pid: 6516 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384485.062214:0:13736:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb126300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1874208203322240:192.168.203.45@tcp:104: 00010000:00010000:1.0:1787384485.062529:0:13736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f7c3b05e00/0x7ef423838fba2919 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba2912 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384485.062538:0:13736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f7c3b05e00/0x7ef423838fba2919 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba2912 expref: 23 pid: 6516 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384485.062549:0:13736:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb127100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1874208203322368:0@lo:104: 00000100:00100000:1.0:1787384485.062594:0:13736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787384485.062664:0:13736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f7c3953a00/0x7ef423838fba290b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba2904 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384485.062674:0:13736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f7c3953a00/0x7ef423838fba290b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba2904 expref: 23 pid: 6516 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384485.062757:0:13736:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb126a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1874208203322496:0@lo:104: 00010000:00010000:1.0:1787384485.062827:0:13736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f7c3953000/0x7ef423838fba28fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba28f6 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384485.062835:0:13736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f7c3953000/0x7ef423838fba28fd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba28f6 expref: 23 pid: 6514 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384485.062844:0:13736:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb125f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1874208203322624:0@lo:104: 00010000:00010000:1.0:1787384485.062870:0:13736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f7c3953e00/0x7ef423838fba28ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba28e8 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384485.062878:0:13736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98f7c3953e00/0x7ef423838fba28ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba28e8 expref: 23 pid: 6514 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384485.062887:0:13736:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb125180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1874208203322752:0@lo:104: 00000100:00100000:1.0:1787384485.062908:0:13736:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f8749c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787384485.066177:0:6506:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787384485.066249:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384485.066312:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384485.066356:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384485.066360:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203322368 00000100:00100000:0.0:1787384485.066371:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203322496 00000100:00100000:3.0:1787384485.066380:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203322368 00000100:00100000:0.0:1787384485.066385:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203322496 00000100:00100000:3.0:1787384485.066460:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203322624 00000100:00100000:3.0:1787384485.066466:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203322624 00000100:00100000:1.0:1787384485.066539:0:9526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203322752 00000100:00100000:1.0:1787384485.066547:0:9526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203322752 00000100:00100000:0.0:1787384485.066893:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787384485.066904:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c405f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+6:13736:x1874208203322368:12345-0@lo:104: 00010000:00010000:0.0:1787384485.066927:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f7c3952200/0x7ef423838fba2912 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2919 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384485.067013:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787384485.067020:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c405f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+6:13736:x1874208203322368:12345-0@lo:104: Request processed in 118us (4425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384485.067027:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787384485.067072:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787384485.067094:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+5:13736:x1874208203322496:12345-0@lo:104: 00010000:00010000:0.0:1787384485.067102:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05000/0x7ef423838fba2904 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba290b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384485.067135:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787384485.067139:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+5:13736:x1874208203322496:12345-0@lo:104: Request processed in 47us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384485.067145:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:0.0:1787384485.067175:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787384485.067180:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f7c3952200/0x7ef423838fba2912 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba2919 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384485.067189:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3952200 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:0.0:1787384485.067194:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f7c3952200/0x7ef423838fba2912 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba2919 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384485.067202:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f7c3952200/0x7ef423838fba2912 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba2919 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787384485.067210:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f7c3952200/0x7ef423838fba2912 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba2919 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384485.067216:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787384485.067270:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f7c3952200/0x7ef423838fba2912 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2919 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384485.067277:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787384485.067298:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f7c3952200/0x7ef423838fba2912 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2919 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384485.067315:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f7c3952200/0x7ef423838fba2912 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba2919 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384485.067341:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384485.067345:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05000/0x7ef423838fba2904 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba290b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384485.067351:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b05000 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:0.0:1787384485.067354:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05000/0x7ef423838fba2904 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba290b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384485.067361:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05000/0x7ef423838fba2904 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba290b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787384485.067367:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05000/0x7ef423838fba2904 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba290b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384485.067372:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787384485.067387:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05000/0x7ef423838fba2904 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba290b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384485.067393:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787384485.067408:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05000/0x7ef423838fba2904 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba290b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384485.067416:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05000/0x7ef423838fba2904 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba290b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384485.067425:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384485.067433:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384485.067436:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384485.067443:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384485.067470:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203322880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384485.067518:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384485.067564:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203323008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384485.067583:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384485.067611:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203322880 00000100:00100000:0.0:1787384485.067616:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203322880 00010000:00010000:0.0:1787384485.067635:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f7c3b05e00/0x7ef423838fba2919 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba2912 expref: 24 pid: 6516 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384485.067655:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203323008 00000100:00100000:0.0:1787384485.067658:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203323008 00010000:00010000:0.0:1787384485.067668:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f7c3953a00/0x7ef423838fba290b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba2904 expref: 25 pid: 6516 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384485.068346:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787384485.068368:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+25:3654:x1874208203322880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787384485.068381:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384485.068388:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f7c3b05e00/0x7ef423838fba2919 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba2912 expref: 25 pid: 6516 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384485.068398:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f7c3b05e00/0x7ef423838fba2919 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba2912 expref: 25 pid: 6516 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384485.068418:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384485.068473:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+25:3654:x1874208203322880:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384485.068479:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787384485.068518:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787384485.068524:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3651:x1874208203323008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787384485.068532:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384485.068536:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f7c3953a00/0x7ef423838fba290b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba2904 expref: 24 pid: 6516 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384485.068545:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f7c3953a00/0x7ef423838fba290b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba2904 expref: 24 pid: 6516 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384485.068555:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384485.068580:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3651:x1874208203323008:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384485.068586:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787384485.068638:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203323008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384485.069166:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203322880:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787384485.071155:0:13736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c3b05e00/0x7ef423838fba2919 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba2912 expref: 23 pid: 6516 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384485.071176:0:13736:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb127100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1874208203322368:0@lo:104: 00010000:00010000:0.0:1787384485.071190:0:13736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c3953a00/0x7ef423838fba290b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba2904 expref: 22 pid: 6516 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384485.071198:0:13736:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb126a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1874208203322496:0@lo:104: 00000100:00100000:3.0:1787384485.071370:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787384485.071393:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+4:13736:x1874208203322624:12345-0@lo:104: 00010000:00010000:3.0:1787384485.071418:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f7c2090800/0x7ef423838fba28f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba28fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384485.071579:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787384485.071599:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+4:13736:x1874208203322752:12345-0@lo:104: 00010000:00010000:2.0:1787384485.071627:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f8c0030800/0x7ef423838fba28e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba28ef expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384485.071737:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787384485.071748:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ca80b7f5-0e34-441a-981f-ebff717028c4+4:13736:x1874208203322624:12345-0@lo:104: Request processed in 365us (5436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384485.071758:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:2.0:1787384485.071995:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787384485.072006:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ca80b7f5-0e34-441a-981f-ebff717028c4+4:13736:x1874208203322752:12345-0@lo:104: Request processed in 415us (5647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384485.072014:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:2.0:1787384485.072049:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787384485.072056:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f7c2090800/0x7ef423838fba28f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba28fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384485.072065:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2090800 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384485.072070:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f7c2090800/0x7ef423838fba28f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba28fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384485.072081:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f7c2090800/0x7ef423838fba28f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba28fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384485.072084:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384485.072164:0:13736:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb124000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1874208203322112:192.168.203.45@tcp:104: 00000100:00100000:0.0:1787384485.072181:0:13736:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb125f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1874208203322624:0@lo:104: 00000100:00100000:0.0:1787384485.072194:0:13736:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb125180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1874208203322752:0@lo:104: 10000000:00010000:2.0:1787384485.072316:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f7c2090800/0x7ef423838fba28f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba28fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384485.072331:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787384485.072381:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f7c2090800/0x7ef423838fba28f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba28fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384485.072389:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787384485.072421:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f7c2090800/0x7ef423838fba28f6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba28fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384485.072428:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f7c2090800/0x7ef423838fba28f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba28fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384485.072455:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384485.072460:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8c0030800/0x7ef423838fba28e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba28ef expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384485.072468:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384485.072469:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c0030800 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384485.072477:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8c0030800/0x7ef423838fba28e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba28ef expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384485.072487:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8c0030800/0x7ef423838fba28e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba28ef expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384485.072957:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c355b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203323136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384485.073014:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:2.0:1787384485.073078:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8c0030800/0x7ef423838fba28e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba28ef expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384485.073084:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787384485.073450:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8c0030800/0x7ef423838fba28e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba28ef expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384485.073458:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787384485.073942:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8c0030800/0x7ef423838fba28e8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba28ef expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384485.073952:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8c0030800/0x7ef423838fba28e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba28ef expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384485.073972:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384485.073974:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384485.073976:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384485.073996:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c355b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203323264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787384485.074052:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384485.074623:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182266112 00000100:00100000:0.0:1787384485.074640:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182266112 00010000:00010000:0.0:1787384485.074699:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f7c2090c00/0x7ef423838fba2927 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36a6 expref: 13 pid: 6516 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384485.074737:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203323136 00000100:00100000:3.0:1787384485.074741:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203323136 00010000:00010000:3.0:1787384485.074761:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f7c3953000/0x7ef423838fba28fd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba28f6 expref: 22 pid: 6514 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384485.074853:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203323264 00000100:00100000:0.0:1787384485.074857:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203323264 00010000:00010000:0.0:1787384485.074871:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f7c3953e00/0x7ef423838fba28ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba28e8 expref: 23 pid: 6514 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384485.074897:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 48 00000100:00100000:0.0:1787384485.074908:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09777221-fe6d-4549-9ee6-04300d230fb6+13:2415:x1874208182266112:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787384485.074924:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384485.074930:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f7c2090c00/0x7ef423838fba2927 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36a6 expref: 13 pid: 6516 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384485.074950:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f7c2090c00/0x7ef423838fba2927 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36a6 expref: 13 pid: 6516 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384485.074952:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787384485.074978:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb124a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ca80b7f5-0e34-441a-981f-ebff717028c4+23:3652:x1874208203323136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787384485.074987:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c2090c00/0x7ef423838fba2927 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36a6 expref: 13 pid: 6516 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384485.075000:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384485.075006:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787384485.075013:0:10399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f7c3953000/0x7ef423838fba28fd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba28f6 expref: 23 pid: 6514 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384485.075029:0:10399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f7c3953000/0x7ef423838fba28fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba28f6 expref: 23 pid: 6514 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384485.075053:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c3953000/0x7ef423838fba28fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba28f6 expref: 23 pid: 6514 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384485.075069:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384485.075081:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09777221-fe6d-4549-9ee6-04300d230fb6+12:2415:x1874208182266112:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 172us (3001us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384485.075091:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 48 00000100:00100000:0.0:1787384485.075114:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787384485.075123:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3559880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ca80b7f5-0e34-441a-981f-ebff717028c4+22:3653:x1874208203323264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787384485.075137:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787384485.075150:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb124a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ca80b7f5-0e34-441a-981f-ebff717028c4+22:3652:x1874208203323136:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (2132us total) trans 0 rc 0/0 00010000:00010000:0.0:1787384485.075167:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f7c3953e00/0x7ef423838fba28ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba28e8 expref: 22 pid: 6514 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384485.075170:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:0.0:1787384485.075191:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f7c3953e00/0x7ef423838fba28ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba28e8 expref: 22 pid: 6514 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384485.075210:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c3953e00/0x7ef423838fba28ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba28e8 expref: 21 pid: 6514 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384485.075226:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384485.075385:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c355b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203323136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384485.079044:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3559880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ca80b7f5-0e34-441a-981f-ebff717028c4+20:3653:x1874208203323264:12345-0@lo:103:ldlm_bl.0 Request processed in 3906us (4976us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384485.079063:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787384485.079539:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c355b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203323264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787384485.081833:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384485.081989:0:13736:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb126300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1874208203322240:192.168.203.45@tcp:104: 00010000:00010000:0.0:1787384485.082050:0:13736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98f7c3952c00/0x7ef423838fba2a62 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384485.082136:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182266240 00000100:00100000:3.0:1787384485.082145:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182266240 00010000:00010000:3.0:1787384485.082191:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f7c2091e00/0x7ef423838fba2920 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce369f expref: 12 pid: 6516 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384485.082237:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 51 00000100:00100000:3.0:1787384485.082247:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c355b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09777221-fe6d-4549-9ee6-04300d230fb6+12:2416:x1874208182266240:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384485.082266:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384485.082273:0:10399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f7c2091e00/0x7ef423838fba2920 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce369f expref: 12 pid: 6516 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384485.082286:0:10399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f7c2091e00/0x7ef423838fba2920 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce369f expref: 12 pid: 6516 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384485.082309:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c2091e00/0x7ef423838fba2920 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce369f expref: 12 pid: 6516 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384485.082338:0:10399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98f7c3952c00/0x7ef423838fba2a62 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384485.082348:0:10399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c3952c00/0x7ef423838fba2a62 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384485.082366:0:10399:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f7c3952c00/0x7ef423838fba2a62 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384485.082399:0:10399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f7c3952c00/0x7ef423838fba2a62 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384485.082406:0:10399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98f7c3952c00/0x7ef423838fba2a62 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384485.082413:0:10399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98f7c3952c00/0x7ef423838fba2a62 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384485.082420:0:10399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3952c00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:3.0:1787384485.082425:0:10399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98f7c3952c00/0x7ef423838fba2a62 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384485.082434:0:10399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98f7c3952c00/0x7ef423838fba2a62 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384485.082458:0:10399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98f7c3952c00/0x7ef423838fba2a62 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384485.082469:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787384485.082542:0:13736:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98f7c3952c00/0x7ef423838fba2a62 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384485.082566:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c355b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09777221-fe6d-4549-9ee6-04300d230fb6+11:2416:x1874208182266240:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 315us (741us total) trans 0 rc 0/0 00010000:00010000:1.0:1787384485.082569:0:13736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98f7c3952c00/0x7ef423838fba2a62 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384485.082578:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 51 00010000:00010000:1.0:1787384485.082605:0:13736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c3952c00/0x7ef423838fba2a62 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384485.304030:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203323392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787384485.304122:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384485.304197:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203323392 00000100:00100000:1.0:1787384485.304205:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203323392 00000100:00100000:0.0:1787384485.305706:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c355b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203323520:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787384485.305765:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384485.306050:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203323520 00000100:00100000:0.0:1787384485.306056:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203323520 00000100:00100000:0.0:1787384485.307347:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787384485.307363:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203323520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787384485.307392:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787384485.307455:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203323520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (1690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384485.307462:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787384485.309831:0:13608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787384485.309861:0:13608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb125c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3654:x1874208203323392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787384485.309892:0:13608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384485.309990:0:13608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb125c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3654:x1874208203323392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (5879us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384485.309998:0:13608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787384485.317356:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c355b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203323520:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787384485.318548:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787384485.318603:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203323392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787384485.815165:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203323648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787384485.815254:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787384485.815300:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384485.815315:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203323648 00000100:00100000:3.0:1787384485.815333:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203323648 00000100:00100000:3.0:1787384485.815455:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787384485.815467:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c355a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203323648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787384485.815500:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787384485.815550:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c355a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203323648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384485.815571:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203323776:0@lo:400:kworker.0 00000100:00100000:3.0:1787384485.815582:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787384485.815608:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384485.815645:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203324288:0@lo:400:kworker.0 00000100:00100000:1.0:1787384485.815667:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384485.815686:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203324800:0@lo:400:kworker.0 00000100:00100000:1.0:1787384485.815707:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384485.815727:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787384485.815733:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203323904:0@lo:400:kworker.0 00000100:00100000:1.0:1787384485.815769:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384485.815809:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb126300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203324416:0@lo:400:kworker.0 00000100:00100000:1.0:1787384485.815831:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384485.815860:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203323776 00000100:00100000:1.0:1787384485.815864:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203323776 00000100:00100000:2.0:1787384485.815972:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb124380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203324160:0@lo:400:kworker.0 00000100:00100000:2.0:1787384485.815998:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384485.816016:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874208203324672:0@lo:400:kworker.0 00000100:00100000:2.0:1787384485.816037:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787384485.816084:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7e06680 x1874208203323648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384501 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384485.816104:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203323648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787384485.816121:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787384485.816126:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874208203324032:0@lo:400:kworker.0 00000100:00100000:2.0:1787384485.816156:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384485.816174:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874208203324544:0@lo:400:kworker.0 00000100:00100000:2.0:1787384485.816195:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384485.816215:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203323904 00000100:00100000:2.0:1787384485.816218:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203323904 00000100:00100000:2.0:1787384485.816244:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203324160 00000100:00100000:2.0:1787384485.816247:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203324160 00000100:00100000:2.0:1787384485.816261:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787384485.816267:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203323904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384485.816332:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203323904:12345-0@lo:400:kworker.0 Request processed in 64us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384485.816339:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787384485.816352:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787384485.816357:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c355b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203324160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384485.816398:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c355b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203324160:12345-0@lo:400:kworker.0 Request processed in 40us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384485.816404:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787384485.816420:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203324288 00000100:00100000:2.0:1787384485.816423:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203324288 00000100:00100000:3.0:1787384485.816481:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203324416 00000100:00100000:3.0:1787384485.816485:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203324416 00000100:00100000:1.0:1787384485.816588:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203324672 00000100:00100000:1.0:1787384485.816592:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203324672 00000100:00080000:0.0:1787384485.819074:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787384485.819085:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787384485.819088:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787384485.819154:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203324800 00000100:00100000:0.0:1787384485.819164:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203324800 00000100:00100000:3.0:1787384485.819289:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203324032 00000100:00100000:3.0:1787384485.819295:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203324032 00000100:00100000:3.0:1787384485.819332:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203324544 00000100:00100000:3.0:1787384485.819336:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203324544 00000100:00100000:3.0:1787384485.819357:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787384485.819368:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203323776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384485.819485:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203323776:12345-0@lo:400:kworker.0 Request processed in 118us (3877us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384485.819496:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787384485.819497:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787384485.819511:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203324800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384485.819528:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1787384485.819537:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203324416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384485.819557:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203324800:12345-0@lo:400:kworker.0 Request processed in 49us (3847us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384485.819574:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203324416:12345-0@lo:400:kworker.0 Request processed in 40us (3742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384485.819580:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1787384485.819593:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787384485.819598:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874208203324032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384485.819625:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874208203324032:12345-0@lo:400:kworker.0 Request processed in 27us (3468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384485.819630:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1787384485.819637:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787384485.819643:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1787384485.819651:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874208203324544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384485.819694:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874208203324544:12345-0@lo:400:kworker.0 Request processed in 44us (3498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384485.819719:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787384485.820010:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787384485.820019:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203324288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384485.820135:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203324288:12345-0@lo:400:kworker.0 Request processed in 115us (4464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384485.820143:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00080000:2.0:1787384485.820169:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787384485.820173:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787384485.820217:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203323904:0@lo:400:kworker.0 00010000:00080000:2.0:1787384485.820377:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8cb126300 x1874208203324416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384485.820391:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb126300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203324416:0@lo:400:kworker.0 00000100:00100000:2.0:1787384485.820408:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203323776:0@lo:400:kworker.0 00000100:00100000:2.0:1787384485.820417:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203324288:0@lo:400:kworker.0 00010000:00080000:2.0:1787384485.820429:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8cb124000 x1874208203324800/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384485.820439:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203324800:0@lo:400:kworker.0 00000100:00100000:1.0:1787384485.820463:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1787384485.820584:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874208203324672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384485.820625:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874208203324672:12345-0@lo:400:kworker.0 Request processed in 43us (4586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384485.820631:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787384485.820918:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874208203324032:0@lo:400:kworker.0 00000100:00100000:3.0:1787384485.820934:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874208203324544:0@lo:400:kworker.0 00000100:00100000:3.0:1787384485.820946:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb124380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203324160:0@lo:400:kworker.0 00010000:00080000:3.0:1787384485.820960:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8cb125f80 x1874208203324672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384485.820970:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874208203324672:0@lo:400:kworker.0 00000020:00000080:2.0:1787384486.031108:0:13785:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007fff530b1120 00000020:00000080:2.0:1787384486.031124:0:13785:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:2.0:1787384486.031128:0:13785:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:2.0:1787384486.031143:0:13785:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff530b33b0 20000000:00000080:2.0:1787384486.031150:0:13785:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98f8f7e03800 uarg=0000000000000000 20000000:01000000:2.0:1787384486.031192:0:13785:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1787384486.031198:0:13785:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1787384486.031272:0:13785:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:0.0:1787384486.032091:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:2.0:1787384486.032345:0:13785:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:2.0:1787384486.032417:0:13785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:2.0:1787384486.032447:0:13785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:2.0:1787384486.032464:0:13785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:2.0:1787384486.032475:0:13785:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787384486.032494:0:13785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98f8d965b800/0x7ef423838fba2a69 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384486.032511:0:13785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8d965b800/0x7ef423838fba2a69 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384486.032521:0:13785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f8d965b800/0x7ef423838fba2a69 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384486.032529:0:13785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f8d965b800/0x7ef423838fba2a69 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384486.032536:0:13785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98f8d965b800/0x7ef423838fba2a69 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384486.032543:0:13785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98f8d965b800/0x7ef423838fba2a69 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384486.032550:0:13785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965b800 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:2.0:1787384486.032554:0:13785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98f8d965b800/0x7ef423838fba2a69 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384486.032577:0:13785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98f8d965b800/0x7ef423838fba2a69 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384486.032591:0:13785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98f8d965b800/0x7ef423838fba2a69 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384486.032599:0:13785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98f8d965b800/0x7ef423838fba2a69 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384486.032605:0:13785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8d965b800/0x7ef423838fba2a69 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384486.327208:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203324928:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787384486.327283:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384486.327502:0:13608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203324928 00000100:00100000:2.0:1787384486.327510:0:13608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203324928 00000100:00100000:2.0:1787384486.331829:0:13608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787384486.331854:0:13608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203324928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787384486.332019:0:13608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384486.332115:0:13608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203324928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 274us (4830us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384486.332122:0:13608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:1.0:1787384486.332264:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c422d500 x1874208203324928/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384502 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384486.332284:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203324928:0@lo:13:osp-pre-1-1.0 10000000:01000000:0.0:1787384486.397172:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787384486.397180:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98f8f7d47800 from 7 10000000:01000000:0.0:1787384486.397185:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787384486.397245:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05800/0x7ef423838fba2a70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384486.397258:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05800/0x7ef423838fba2a70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384486.397269:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05800/0x7ef423838fba2a70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384486.397297:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203325056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787384486.397375:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384486.397439:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3520780 going to sleep for 11 seconds 00000100:00100000:3.0:1787384486.397546:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203325056 00000100:00100000:3.0:1787384486.397555:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203325056 00000100:00100000:3.0:1787384486.397614:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1787384486.397623:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+20:6519:x1874208203325056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384486.397636:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384486.397650:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c2091a00/0x7ef423838fba2a77 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba2a70 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384486.397673:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c2091a00/0x7ef423838fba2a77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba2a70 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384486.397683:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c2091a00/0x7ef423838fba2a77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2a70 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384486.397691:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2091a00, rc 0) 00000100:00100000:3.0:1787384486.397740:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+21:6519:x1874208203325056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384486.397747:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1787384486.399080:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203325056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787384486.399109:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05800/0x7ef423838fba2a70 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2a77 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384486.399120:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05800/0x7ef423838fba2a70 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2a77 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384486.399211:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203325184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787384486.399272:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384486.399323:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3a5e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384486.399392:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203325184 00000100:00100000:3.0:1787384486.399398:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203325184 00000100:00100000:3.0:1787384486.399445:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1787384486.399453:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+21:6519:x1874208203325184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384486.399585:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+21:6519:x1874208203325184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 131us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384486.399593:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1787384486.399811:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203325184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787384486.399841:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203325312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787384486.399884:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384486.399901:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3a5e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384486.399955:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203325312 00000100:00100000:0.0:1787384486.399960:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203325312 00000100:00100000:0.0:1787384486.399993:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1787384486.400007:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+21:6519:x1874208203325312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787384486.400089:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+21:6519:x1874208203325312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384486.400096:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1787384486.400286:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203325312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787384486.400688:0:13798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4123800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:13798:1874208203325440:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787384486.400733:0:13798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384486.400757:0:13798:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f87496c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384486.400866:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203325440 00000100:00100000:0.0:1787384486.400872:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203325440 00000100:00100000:0.0:1787384486.400910:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1787384486.400917:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+21:13798:x1874208203325440:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787384486.401007:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+21:13798:x1874208203325440:12345-0@lo:502:llog_process_th.0 Request processed in 90us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384486.401014:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1787384486.401206:0:13798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4123800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:13798:1874208203325440:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787384486.401230:0:13798:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787384486.401240:0:13798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384486.401242:0:13798:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787384486.401250:0:13798:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f8f7d47800 00000020:00000080:2.0:1787384486.401252:0:13798:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787384486.401308:0:13798:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384486.401312:0:13798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384486.401322:0:13798:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787384486.401326:0:13798:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787384486.401329:0:13798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384486.401331:0:13798:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787384486.401335:0:13798:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f8f7d47800 00000020:00000080:2.0:1787384486.401337:0:13798:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787384486.401369:0:13798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40dd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:13798:1874208203325568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384486.401403:0:13798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384486.401434:0:13798:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3a5e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384486.401487:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203325568 00000100:00100000:1.0:1787384486.401492:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203325568 00000100:00100000:1.0:1787384486.401523:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1787384486.401538:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+21:13798:x1874208203325568:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787384486.401614:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+21:13798:x1874208203325568:12345-0@lo:502:llog_process_th.0 Request processed in 85us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384486.401622:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1787384486.403177:0:13798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40dd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:13798:1874208203325568:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787384486.414334:0:13798:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384486.414353:0:13798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384486.414355:0:13798:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787384486.414362:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1787384486.418662:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1787384486.418704:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787384486.418718:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05800/0x7ef423838fba2a70 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2a77 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384486.418731:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05800/0x7ef423838fba2a70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2a77 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384486.418742:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787384486.418745:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98f8f5669000 from 7 10000000:01000000:0.0:1787384486.419035:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787384486.419073:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04200/0x7ef423838fba2a7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384486.419082:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04200/0x7ef423838fba2a7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384486.419094:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04200/0x7ef423838fba2a7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384486.419126:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203325696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787384486.419655:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384486.419735:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3520d80 going to sleep for 11 seconds 00000040:00080000:1.0:1787384486.424101:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787384486.432634:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203325696 00000100:00100000:2.0:1787384486.432649:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203325696 00000100:00100000:2.0:1787384486.432712:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1787384486.432724:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+21:6519:x1874208203325696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787384486.432743:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384486.432769:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8d965b800/0x7ef423838fba2a85 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba2a7e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384486.432840:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8d965b800/0x7ef423838fba2a85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba2a7e expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384486.432855:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8d965b800/0x7ef423838fba2a85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2a7e expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384486.432865:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965b800, rc 0) 00000100:00100000:2.0:1787384486.432941:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+22:6519:x1874208203325696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 218us (13285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384486.432951:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1787384486.433187:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203325696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787384486.433205:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04200/0x7ef423838fba2a7e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2a85 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384486.433215:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04200/0x7ef423838fba2a7e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2a85 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384486.433288:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203325824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384486.433333:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384486.433366:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3520d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787384486.433458:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203325824 00000100:00100000:2.0:1787384486.433463:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203325824 00000100:00100000:2.0:1787384486.433494:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1787384486.433502:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+22:6519:x1874208203325824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787384486.433639:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+22:6519:x1874208203325824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384486.433646:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1787384486.433774:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203325824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384486.433830:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203325952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787384486.433878:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384486.433894:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3520d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787384486.433947:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203325952 00000100:00100000:3.0:1787384486.433951:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203325952 00000100:00100000:3.0:1787384486.433978:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1787384486.433986:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+22:6519:x1874208203325952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384486.434081:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+22:6519:x1874208203325952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384486.434088:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1787384486.436027:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203325952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787384486.436839:0:13803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:13803:1874208203326080:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787384486.436917:0:13803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384486.436942:0:13803:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3520540 going to sleep for 11 seconds 00000100:00100000:3.0:1787384486.437002:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203326080 00000100:00100000:3.0:1787384486.437008:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203326080 00000100:00100000:3.0:1787384486.437052:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1787384486.437061:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+22:13803:x1874208203326080:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787384486.437182:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+22:13803:x1874208203326080:12345-0@lo:502:llog_process_th.0 Request processed in 121us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384486.437190:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1787384486.437660:0:13803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:13803:1874208203326080:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787384486.437687:0:13803:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787384486.437702:0:13803:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384486.437705:0:13803:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787384486.437712:0:13803:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f8f5669000 00000020:00000080:0.0:1787384486.437715:0:13803:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787384486.437767:0:13803:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384486.438054:0:13803:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384486.438057:0:13803:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787384486.438062:0:13803:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787384486.438065:0:13803:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384486.438067:0:13803:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787384486.438071:0:13803:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f8f5669000 00000020:00000080:0.0:1787384486.438073:0:13803:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787384486.438249:0:13803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:13803:1874208203326208:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787384486.438300:0:13803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384486.438337:0:13803:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3520540 going to sleep for 11 seconds 00000100:00100000:3.0:1787384486.439658:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203326208 00000100:00100000:3.0:1787384486.439669:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203326208 00000100:00100000:3.0:1787384486.439702:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1787384486.439709:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+22:13803:x1874208203326208:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787384486.439870:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+22:13803:x1874208203326208:12345-0@lo:502:llog_process_th.0 Request processed in 160us (1569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384486.439885:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1787384486.440556:0:13803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:13803:1874208203326208:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787384486.440589:0:13803:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384486.440597:0:13803:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384486.440599:0:13803:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787384486.440604:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1787384486.442159:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1787384486.442225:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787384486.442239:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04200/0x7ef423838fba2a7e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2a85 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384486.442251:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04200/0x7ef423838fba2a7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2a85 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384486.442263:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787384486.442266:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98f8f5698000 from 7 10000000:01000000:3.0:1787384486.442269:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787384486.442302:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c2091e00/0x7ef423838fba2a8c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384486.442310:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f7c2091e00/0x7ef423838fba2a8c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384486.442331:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f7c2091e00/0x7ef423838fba2a8c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384486.442355:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e05500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203326336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787384486.442428:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384486.442597:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c356ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1787384486.444856:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203326336 00000100:00100000:2.0:1787384486.444878:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203326336 00000100:00100000:3.0:1787384486.445529:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1787384486.445540:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+22:6519:x1874208203326336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384486.445556:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384486.445575:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c2091000/0x7ef423838fba2a93 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba2a8c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384486.445610:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c2091000/0x7ef423838fba2a93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba2a8c expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384486.445621:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c2091000/0x7ef423838fba2a93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2a8c expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384486.445629:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2091000, rc 0) 00000100:00100000:3.0:1787384486.445697:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+23:6519:x1874208203326336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (3268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384486.445705:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1787384486.445757:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e05500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203326336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384486.445791:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f7c2091e00/0x7ef423838fba2a8c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2a93 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384486.445801:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f7c2091e00/0x7ef423838fba2a8c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2a93 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384486.445866:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e05500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203326464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384486.445897:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384486.445920:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c356ba80 going to sleep for 11 seconds 00000040:00080000:1.0:1787384486.446965:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787384486.449421:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203326464 00000100:00100000:2.0:1787384486.449435:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203326464 00000100:00100000:2.0:1787384486.449501:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1787384486.449510:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+23:6519:x1874208203326464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787384486.449677:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+23:6519:x1874208203326464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 168us (3779us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384486.449685:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1787384486.449986:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e05500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203326464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384486.450037:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e05500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203326592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384486.450087:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384486.450119:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c356ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1787384486.450176:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203326592 00000100:00100000:2.0:1787384486.450181:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203326592 00000100:00100000:2.0:1787384486.450225:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1787384486.450233:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+23:6519:x1874208203326592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787384486.450311:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+23:6519:x1874208203326592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384486.450329:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1787384486.450370:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e05500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203326592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787384486.450567:0:13805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40dd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:13805:1874208203326720:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384486.450602:0:13805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384486.450622:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203326720 00000100:00100000:2.0:1787384486.450626:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203326720 00000100:00100000:2.0:1787384486.450648:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1787384486.450653:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+23:13805:x1874208203326720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384486.450718:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+23:13805:x1874208203326720:12345-0@lo:502:llog_process_th.0 Request processed in 63us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384486.450724:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1787384486.450752:0:13805:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3a5eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787384486.450770:0:13805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40dd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:13805:1874208203326720:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787384486.450814:0:13805:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787384486.450823:0:13805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384486.450825:0:13805:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787384486.450833:0:13805:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f8f5698000 00000020:00000080:2.0:1787384486.450835:0:13805:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787384486.453735:0:13805:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384486.453749:0:13805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384486.453752:0:13805:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787384486.453757:0:13805:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787384486.453762:0:13805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384486.453763:0:13805:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787384486.453768:0:13805:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f8f5698000 00000020:00000080:2.0:1787384486.453770:0:13805:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787384486.453875:0:13805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40dd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:13805:1874208203326848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384486.453953:0:13805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384486.453999:0:13805:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3a5eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787384486.454075:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203326848 00000100:00100000:0.0:1787384486.454083:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203326848 00000100:00100000:0.0:1787384486.454134:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1787384486.454143:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+23:13805:x1874208203326848:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787384486.454274:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+23:13805:x1874208203326848:12345-0@lo:502:llog_process_th.0 Request processed in 132us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384486.454282:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1787384486.454529:0:13805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40dd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:13805:1874208203326848:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787384486.454555:0:13805:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384486.454560:0:13805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384486.454561:0:13805:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787384486.454565:0:13805:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1787384486.454721:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1787384486.454749:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787384486.454768:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c2091e00/0x7ef423838fba2a8c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2a93 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384486.454817:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f7c2091e00/0x7ef423838fba2a8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2a93 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384486.454830:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787384486.454832:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98f8c896e000 from 7 10000000:01000000:0.0:1787384486.454835:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787384486.454862:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04800/0x7ef423838fba2a9a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384486.454871:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04800/0x7ef423838fba2a9a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384486.454879:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04800/0x7ef423838fba2a9a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384486.454894:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203326976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787384486.454928:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384486.454948:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3520e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787384486.455011:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203326976 00000100:00100000:2.0:1787384486.455016:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203326976 00000100:00100000:2.0:1787384486.455051:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1787384486.455058:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+23:6519:x1874208203326976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787384486.455067:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384486.455080:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8d965b000/0x7ef423838fba2aa1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba2a9a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384486.455116:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8d965b000/0x7ef423838fba2aa1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba2a9a expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384486.455129:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8d965b000/0x7ef423838fba2aa1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba2a9a expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384486.455140:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965b000, rc 0) 00000100:00100000:2.0:1787384486.455171:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+24:6519:x1874208203326976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384486.455178:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1787384486.459108:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203326976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787384486.459140:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04800/0x7ef423838fba2a9a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2aa1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384486.459154:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04800/0x7ef423838fba2a9a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2aa1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384486.459265:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203327104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384486.459354:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384486.459418:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3520e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787384486.460391:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203327104 00000100:00100000:1.0:1787384486.460399:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203327104 00000100:00100000:1.0:1787384486.460454:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1787384486.460463:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:6519:x1874208203327104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787384486.460642:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:6519:x1874208203327104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 179us (1287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384486.460650:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1787384486.461807:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203327104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384486.461868:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203327232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787384486.461934:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384486.461970:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3520e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787384486.462084:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203327232 00000100:00100000:2.0:1787384486.462092:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203327232 00000100:00100000:2.0:1787384486.462143:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1787384486.462154:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cacee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:6519:x1874208203327232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787384486.463637:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cacee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:6519:x1874208203327232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1479us (1698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384486.463652:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1787384486.463747:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ca80b7f5-0e34-441a-981f-ebff717028c4:6519:1874208203327232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384486.464137:0:13807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e07800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:13807:1874208203327360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787384486.464204:0:13807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384486.464242:0:13807:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c356b480 going to sleep for 11 seconds 00000100:00100000:0.0:1787384486.464639:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203327360 00000100:00100000:0.0:1787384486.464645:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203327360 00000100:00100000:0.0:1787384486.464695:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1787384486.464702:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cacecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+24:13807:x1874208203327360:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787384486.464861:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cacecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+24:13807:x1874208203327360:12345-0@lo:502:llog_process_th.0 Request processed in 158us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384486.464869:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1787384486.464985:0:13807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e07800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:13807:1874208203327360:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787384486.465013:0:13807:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787384486.465024:0:13807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384486.465026:0:13807:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787384486.465034:0:13807:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f8c896e000 00000020:00000080:3.0:1787384486.465037:0:13807:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787384486.465102:0:13807:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787384486.465106:0:13807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384486.465108:0:13807:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787384486.465111:0:13807:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787384486.465113:0:13807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384486.465114:0:13807:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787384486.465118:0:13807:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f8c896e000 00000020:00000080:3.0:1787384486.465120:0:13807:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787384486.465159:0:13807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e07800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:13807:1874208203327488:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787384486.465200:0:13807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384486.465226:0:13807:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c356b480 going to sleep for 11 seconds 00000100:00100000:2.0:1787384486.467827:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203327488 00000100:00100000:2.0:1787384486.467842:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203327488 00000100:00100000:2.0:1787384486.467907:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1787384486.467917:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cacec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+24:13807:x1874208203327488:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384486.468081:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cacec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+24:13807:x1874208203327488:12345-0@lo:502:llog_process_th.0 Request processed in 164us (2879us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384486.468090:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1787384486.468290:0:13807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e07800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ca80b7f5-0e34-441a-981f-ebff717028c4:13807:1874208203327488:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787384486.468334:0:13807:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787384486.468343:0:13807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384486.468344:0:13807:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787384486.468349:0:13807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1787384486.468974:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1787384486.469001:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787384486.469014:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04800/0x7ef423838fba2a9a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2aa1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384486.469028:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04800/0x7ef423838fba2a9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2aa1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384486.497907:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384486.502849:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182266368 00000100:00100000:0.0:1787384486.502864:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182266368 00000100:00100000:0.0:1787384486.502944:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 358 00000100:00100000:0.0:1787384486.502956:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+11:6186:x1874208182266368:12345-192.168.203.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787384486.502981:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384486.503013:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c3b05400/0x7ef423838fba2aa8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce36f3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384486.503046:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c3b05400/0x7ef423838fba2aa8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36f3 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384486.503060:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c3b05400/0x7ef423838fba2aa8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36f3 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384486.503071:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3b05400, rc 0) 00000100:00100000:0.0:1787384486.503145:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+12:6186:x1874208182266368:12345-192.168.203.45@tcp:101:ll_cfg_requeue.0 Request processed in 191us (5250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384486.503153:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 358 00000100:00100000:0.0:1787384486.512996:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384486.513133:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182266496 00000100:00100000:3.0:1787384486.513143:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182266496 00000100:00100000:3.0:1787384486.513213:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 359 00000100:00100000:3.0:1787384486.513223:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+12:6186:x1874208182266496:12345-192.168.203.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384486.513386:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+12:6186:x1874208182266496:12345-192.168.203.45@tcp:501:ll_cfg_requeue.0 Request processed in 163us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384486.513395:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 359 00000100:00100000:1.0:1787384486.523728:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384486.524082:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182266624 00000100:00100000:3.0:1787384486.524097:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182266624 00000100:00100000:3.0:1787384486.524193:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 360 00000100:00100000:3.0:1787384486.524204:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d0c74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+12:6186:x1874208182266624:12345-192.168.203.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384486.524356:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d0c74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+12:6186:x1874208182266624:12345-192.168.203.45@tcp:503:ll_cfg_requeue.0 Request processed in 153us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384486.524365:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 360 00000100:00100000:0.0:1787384486.529501:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384486.529560:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182266752 00000100:00100000:2.0:1787384486.529570:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182266752 00000100:00100000:2.0:1787384486.529642:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 361 00000100:00100000:2.0:1787384486.529652:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+12:10795:x1874208182266752:12345-192.168.203.45@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787384486.529815:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+12:10795:x1874208182266752:12345-192.168.203.45@tcp:502:llog_process_th.0 Request processed in 163us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384486.529823:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 361 00000100:00100000:1.0:1787384486.543340:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384486.543420:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182266880 00000100:00100000:3.0:1787384486.543430:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182266880 00000100:00100000:3.0:1787384486.543490:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 362 00000100:00100000:3.0:1787384486.543500:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+12:10795:x1874208182266880:12345-192.168.203.45@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787384486.543665:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+12:10795:x1874208182266880:12345-192.168.203.45@tcp:502:llog_process_th.0 Request processed in 164us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384486.543674:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 362 00000100:00100000:3.0:1787384486.549471:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384486.550134:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182267008 00000100:00100000:0.0:1787384486.550149:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182267008 00000100:00100000:0.0:1787384486.550212:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 363 00000100:00100000:0.0:1787384486.550222:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+12:6186:x1874208182267008:12345-192.168.203.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787384486.550238:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384486.550257:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c3b04c00/0x7ef423838fba2aaf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce36fa expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384486.550284:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c3b04c00/0x7ef423838fba2aaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36fa expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384486.550295:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c3b04c00/0x7ef423838fba2aaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36fa expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384486.550311:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3b04c00, rc 0) 00000100:00100000:0.0:1787384486.550395:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+13:6186:x1874208182267008:12345-192.168.203.45@tcp:101:ll_cfg_requeue.0 Request processed in 173us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384486.550403:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 363 00000100:00100000:0.0:1787384486.552121:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384486.552207:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182267136 00000100:00100000:3.0:1787384486.552223:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182267136 00000100:00100000:3.0:1787384486.552304:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 364 00000100:00100000:3.0:1787384486.552324:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+13:6186:x1874208182267136:12345-192.168.203.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384486.552610:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+13:6186:x1874208182267136:12345-192.168.203.45@tcp:501:ll_cfg_requeue.0 Request processed in 294us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384486.552641:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 364 00000100:00100000:3.0:1787384486.559669:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384486.561594:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182267264 00000100:00100000:0.0:1787384486.561609:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182267264 00000100:00100000:0.0:1787384486.561677:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 365 00000100:00100000:0.0:1787384486.561688:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+13:6186:x1874208182267264:12345-192.168.203.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787384486.561869:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+13:6186:x1874208182267264:12345-192.168.203.45@tcp:503:ll_cfg_requeue.0 Request processed in 181us (2226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384486.561877:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 365 00000100:00100000:0.0:1787384486.575328:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384486.576175:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182267392 00000100:00100000:3.0:1787384486.576197:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182267392 00000100:00100000:3.0:1787384486.576287:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 366 00000100:00100000:3.0:1787384486.576300:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+13:10798:x1874208182267392:12345-192.168.203.45@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787384486.576557:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+13:10798:x1874208182267392:12345-192.168.203.45@tcp:502:llog_process_th.0 Request processed in 257us (1246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384486.576568:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 366 00000100:00100000:0.0:1787384486.580163:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384486.580303:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182267520 00000100:00100000:3.0:1787384486.580327:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182267520 00000100:00100000:3.0:1787384486.580420:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 367 00000100:00100000:3.0:1787384486.580437:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+13:10798:x1874208182267520:12345-192.168.203.45@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787384486.580658:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+13:10798:x1874208182267520:12345-192.168.203.45@tcp:502:llog_process_th.0 Request processed in 224us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384486.580669:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 367 00000100:00100000:2.0:1787384486.754413:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384486.754459:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384486.754495:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384486.754530:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384486.754561:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384486.754590:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182267904 00000100:00100000:2.0:1787384486.754600:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182267904 00000100:00100000:2.0:1787384486.754662:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 80 00000100:00100000:2.0:1787384486.754673:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2414:x1874208182267904:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384486.754745:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2414:x1874208182267904:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 74us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384486.754754:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 80 00000100:00080000:2.0:1787384486.754775:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787384486.755019:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182267776 00000100:00100000:0.0:1787384486.755023:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182267776 00000100:00100000:0.0:1787384486.755060:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182268032 00000100:00100000:0.0:1787384486.755063:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182268032 00000100:00100000:0.0:1787384486.755077:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182267648 00000100:00100000:0.0:1787384486.755079:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182267648 00000100:00100000:0.0:1787384486.755106:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182268160 00000100:00100000:0.0:1787384486.755109:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182268160 00000100:00100000:0.0:1787384486.755127:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 233 00000100:00100000:0.0:1787384486.755133:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2414:x1874208182267776:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384486.755167:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2414:x1874208182267776:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 34us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384486.755189:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 233 00000100:00100000:0.0:1787384486.755203:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 234 00000100:00100000:0.0:1787384486.755209:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182268032:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384486.755234:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182268032:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 26us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384486.755239:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 234 00000100:00100000:0.0:1787384486.755249:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 235 00000100:00100000:0.0:1787384486.755254:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2414:x1874208182267648:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384486.755272:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2414:x1874208182267648:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 19us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384486.755277:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 235 00000100:00100000:0.0:1787384486.755286:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 236 00000100:00100000:0.0:1787384486.755304:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182268160:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384486.755338:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182268160:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 35us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384486.755344:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 236 00000100:00080000:2.0:1787384486.758006:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787384486.758015:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787384486.839591:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787384487.479432:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787384487.480281:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787384487.863380:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1787384487.863388:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384487.863406:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203327616:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787384487.863473:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384487.863599:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203327616 00000100:00100000:2.0:1787384487.863607:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203327616 00000100:00100000:2.0:1787384487.863657:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787384487.863680:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203327616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787384487.863718:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787384487.864159:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203327616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 479us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384487.864180:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787384487.867146:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203327616:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787384488.375156:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203327744:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787384488.375226:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384488.375382:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203327744 00000100:00100000:2.0:1787384488.375390:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203327744 00000100:00100000:2.0:1787384488.375444:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787384488.375454:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203327744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787384488.375486:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787384488.375538:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203327744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384488.375544:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787384488.375662:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203327744:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787384488.887329:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787384489.912278:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:3.0:1787384489.912470:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384490.423065:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4122300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203327872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787384490.423143:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384490.423205:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384490.423212:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203328000:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787384490.423234:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384490.423324:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203327872 00000100:00100000:1.0:1787384490.423332:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203327872 00000100:00100000:1.0:1787384490.423384:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203328000 00000100:00100000:1.0:1787384490.423387:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203328000 00000100:00100000:1.0:1787384490.423405:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787384490.423414:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203327872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787384490.423442:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787384490.423498:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203327872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (365us total) trans 0 rc 0/0 00000100:00080000:3.0:1787384490.423646:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787384490.423686:0:3653:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1787384490.423692:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98f8cb127800, transno 4294967301 00000100:00100000:3.0:1787384490.423709:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4122300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203327872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787384490.423880:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787384490.423899:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787384490.423905:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203328000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787384490.423920:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787384490.423957:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203328000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384490.423963:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787384490.424232:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203328000:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787384490.935268:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384490.935589:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee31ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874208203328512:0@lo:400:kworker.0 00000100:00100000:0.0:1787384490.935662:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384490.935717:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203329024:0@lo:400:kworker.0 00000100:00100000:0.0:1787384490.935742:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384490.935763:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203329536:0@lo:400:kworker.0 00000100:00100000:0.0:1787384490.935828:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384490.935853:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787384490.935860:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee31d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203328384:0@lo:400:kworker.0 00000100:00100000:0.0:1787384490.935885:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384490.935902:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874208203328896:0@lo:400:kworker.0 00000100:00100000:0.0:1787384490.935924:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384490.935944:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874208203329408:0@lo:400:kworker.0 00000100:00100000:0.0:1787384490.935967:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384490.935999:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203328512 00000100:00100000:0.0:1787384490.936007:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203328512 00000100:00100000:0.0:1787384490.936055:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203328896 00000100:00100000:0.0:1787384490.936058:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203328896 00000100:00100000:0.0:1787384490.936080:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203329408 00000100:00100000:0.0:1787384490.936082:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203329408 00000100:00100000:0.0:1787384490.936100:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1787384490.936110:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874208203328512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384490.936167:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787384490.936173:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874208203328512:12345-0@lo:400:kworker.0 Request processed in 62us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384490.936182:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4106d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874208203328896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384490.936184:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1787384490.936204:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787384490.936213:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874208203329408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384490.936245:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4106d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874208203328896:12345-0@lo:400:kworker.0 Request processed in 66us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384490.936253:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874208203329408:12345-0@lo:400:kworker.0 Request processed in 41us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384490.936260:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787384490.936276:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203329024 00000100:00100000:0.0:1787384490.936279:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203329024 00000100:00100000:0.0:1787384490.936313:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203329536 00000100:00100000:3.0:1787384490.936314:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787384490.936323:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203329536 00000100:00100000:0.0:1787384490.936347:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787384490.936354:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203329024:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787384490.936369:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787384490.936378:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787384490.936387:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203329024:12345-0@lo:400:kworker.0 Request processed in 32us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384490.936395:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787384490.936407:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787384490.936415:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4107480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203329536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384490.936442:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4107480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203329536:12345-0@lo:400:kworker.0 Request processed in 28us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384490.936448:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:0.0:1787384490.936497:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7dbc000 x1874208203328896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384490.936511:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874208203328896:0@lo:400:kworker.0 00010000:00080000:0.0:1787384490.936522:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7dbf480 x1874208203329408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384490.936531:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874208203329408:0@lo:400:kworker.0 00000100:00100000:0.0:1787384490.936540:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee31ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874208203328512:0@lo:400:kworker.0 00000100:00100000:0.0:1787384490.936549:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203329024:0@lo:400:kworker.0 00010000:00080000:0.0:1787384490.936557:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7dbfb80 x1874208203329536/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384490.936565:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203329536:0@lo:400:kworker.0 00000100:00100000:0.0:1787384490.936596:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874208203328256:0@lo:400:kworker.0 00000100:00100000:0.0:1787384490.936628:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384490.936666:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874208203328768:0@lo:400:kworker.0 00000100:00100000:0.0:1787384490.936685:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384490.936698:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874208203329280:0@lo:400:kworker.0 00000100:00100000:0.0:1787384490.936716:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384490.936729:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203329792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384490.936749:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384490.936767:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1787384490.936774:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203328128:0@lo:400:kworker.0 00000100:00100000:0.0:1787384490.936823:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384490.936846:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203328640:0@lo:400:kworker.0 00000100:00100000:0.0:1787384490.936867:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384490.936881:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203329152:0@lo:400:kworker.0 00000100:00100000:0.0:1787384490.936901:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384490.936914:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203329664:0@lo:400:kworker.0 00000100:00100000:0.0:1787384490.936931:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384490.936952:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203328128 00000100:00100000:0.0:1787384490.936956:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203328128 00000100:00100000:0.0:1787384490.936985:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1787384490.936992:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3652:x1874208203328128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384490.937024:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3652:x1874208203328128:12345-0@lo:400:kworker.0 Request processed in 32us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384490.937031:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1787384490.937059:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203329152 00000100:00100000:0.0:1787384490.937062:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203329152 00000100:00100000:0.0:1787384490.937082:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203329664 00000100:00100000:0.0:1787384490.937085:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203329664 00000100:00100000:0.0:1787384490.937102:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787384490.937107:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4105f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203329152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384490.937135:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4105f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203329152:12345-0@lo:400:kworker.0 Request processed in 27us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384490.937141:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787384490.937151:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787384490.937156:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee31ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203329664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384490.937178:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee31ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203329664:12345-0@lo:400:kworker.0 Request processed in 22us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384490.937184:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787384490.937198:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203328256 00000100:00100000:0.0:1787384490.937201:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203328256 00000100:00100000:0.0:1787384490.937218:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203328768 00000100:00100000:0.0:1787384490.937221:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203328768 00000100:00100000:0.0:1787384490.937231:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203329280 00000100:00100000:0.0:1787384490.937234:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203329280 00000100:00100000:0.0:1787384490.937246:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787384490.937251:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4105c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874208203328256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384490.937277:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4105c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874208203328256:12345-0@lo:400:kworker.0 Request processed in 26us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384490.937295:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787384490.937306:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787384490.937312:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4105180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874208203328768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384490.937337:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4105180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874208203328768:12345-0@lo:400:kworker.0 Request processed in 25us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384490.937351:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787384490.937362:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787384490.937368:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874208203329280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384490.937392:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874208203329280:12345-0@lo:400:kworker.0 Request processed in 24us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384490.937398:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787384490.937418:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203329792 00000100:00100000:0.0:1787384490.937421:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203329792 00000100:00100000:0.0:1787384490.937441:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787384490.937447:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4107800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203329792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787384490.937466:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787384490.937493:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4107800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203329792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384490.937499:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787384490.937527:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203328128:0@lo:400:kworker.0 00000100:00100000:0.0:1787384490.937538:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203329152:0@lo:400:kworker.0 00010000:00080000:0.0:1787384490.937550:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7dbf100 x1874208203329664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384490.937561:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203329664:0@lo:400:kworker.0 00000100:00100000:0.0:1787384490.937573:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874208203328256:0@lo:400:kworker.0 00000100:00100000:0.0:1787384490.937583:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874208203328768:0@lo:400:kworker.0 00000100:00100000:0.0:1787384490.937593:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874208203329280:0@lo:400:kworker.0 00010000:00080000:0.0:1787384490.937615:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7e04000 x1874208203329792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384506 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384490.937628:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203329792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787384490.938279:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203328384 00000100:00100000:2.0:1787384490.938296:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203328384 00000100:00100000:2.0:1787384490.938331:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203328640 00000100:00100000:2.0:1787384490.938334:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203328640 00000100:00100000:2.0:1787384490.938348:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787384490.938355:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203328384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384490.938414:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203328384:12345-0@lo:400:kworker.0 Request processed in 58us (2528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384490.938421:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787384490.938435:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787384490.938440:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4105880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203328640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384490.938471:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4105880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203328640:12345-0@lo:400:kworker.0 Request processed in 30us (1603us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384490.938477:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787384490.938536:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee31d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203328384:0@lo:400:kworker.0 00000100:00100000:1.0:1787384490.938550:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203328640:0@lo:400:kworker.0 00000100:00080000:3.0:1787384490.938551:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787384490.938560:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787384491.447234:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787384491.447274:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee31d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203329920:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787384491.447347:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384491.455383:0:13608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203329920 00000100:00100000:3.0:1787384491.455400:0:13608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203329920 00000100:00100000:3.0:1787384491.455480:0:13608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787384491.455568:0:13608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203329920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787384491.455597:0:13608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787384491.455690:0:13608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203329920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 125us (8342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384491.455698:0:13608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:2.0:1787384491.455867:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee31d500 x1874208203329920/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384507 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384491.455890:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee31d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203329920:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787384491.874473:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384491.874521:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384491.874562:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384491.874592:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384491.874617:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384491.874651:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384491.874686:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182268672 00000100:00100000:0.0:1787384491.874699:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182268672 00000100:00100000:0.0:1787384491.874772:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 85 00000100:00100000:0.0:1787384491.874823:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2415:x1874208182268672:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384491.874916:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2415:x1874208182268672:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 96us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384491.874924:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 85 00000100:00100000:1.0:1787384491.875088:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182268544 00000100:00100000:1.0:1787384491.875107:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182268544 00000100:00100000:1.0:1787384491.875168:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182268800 00000100:00100000:1.0:1787384491.875171:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182268800 00000100:00100000:1.0:1787384491.875198:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182268416 00000100:00100000:1.0:1787384491.875201:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182268416 00000100:00100000:1.0:1787384491.875220:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182268928 00000100:00100000:1.0:1787384491.875222:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182268928 00000100:00100000:1.0:1787384491.875253:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 243 00000100:00100000:1.0:1787384491.875262:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee31d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2415:x1874208182268544:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384491.875364:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182268288 00000100:00100000:3.0:1787384491.875372:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182268288 00000100:00100000:3.0:1787384491.875423:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 369 00000100:00100000:3.0:1787384491.875446:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+13:2415:x1874208182268288:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384491.875494:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+13:2415:x1874208182268288:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 63us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384491.875509:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 369 00000100:00080000:3.0:1787384491.875547:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787384491.875552:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787384491.875555:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787384491.875570:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 244 00000100:00100000:3.0:1787384491.875577:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2415:x1874208182268800:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384491.875606:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2415:x1874208182268800:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 30us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384491.875612:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 244 00000100:00100000:3.0:1787384491.875629:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 245 00000100:00100000:3.0:1787384491.875635:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2415:x1874208182268416:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384491.875658:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2415:x1874208182268416:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 23us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384491.875664:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 245 00000100:00100000:3.0:1787384491.875675:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 246 00000100:00100000:3.0:1787384491.875681:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2415:x1874208182268928:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384491.875704:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2415:x1874208182268928:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 24us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384491.875710:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 246 00000100:00100000:1.0:1787384491.876394:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee31d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2415:x1874208182268544:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 1126us (1864us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384491.876406:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 243 00010000:00010000:0.0:1787384491.959023:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384492.983084:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384492.984013:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203330048:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787384492.984087:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384492.984342:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203330048 00000100:00100000:2.0:1787384492.984351:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203330048 00000100:00100000:2.0:1787384492.984406:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787384492.984415:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203330048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787384492.984448:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787384492.984547:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203330048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384492.984553:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787384492.985855:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203330048:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787384493.495563:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203330176:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787384493.495637:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384493.495871:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203330176 00000100:00100000:0.0:1787384493.495881:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203330176 00000100:00100000:0.0:1787384493.495940:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787384493.495948:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203330176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787384493.495982:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787384493.501817:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203330176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5858us (6168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384493.501849:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787384493.508534:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203330176:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787384494.007091:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384495.033751:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384495.544706:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4123100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203330304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787384495.544823:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384495.545112:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203330304 00000100:00100000:1.0:1787384495.545121:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203330304 00000100:00100000:1.0:1787384495.545182:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787384495.545193:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203330304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787384495.545231:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787384495.545289:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203330304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384495.545325:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787384495.545352:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787384495.545362:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203330432:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787384495.545392:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384495.545439:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203330432 00000100:00100000:1.0:1787384495.545443:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203330432 00000100:00100000:1.0:1787384495.545467:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787384495.545473:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203330432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787384495.545483:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787384495.545513:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203330432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384495.545519:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787384495.545562:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203330432:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787384495.545592:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4123100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203330304:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787384495.545921:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787384496.054976:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787384496.055132:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203330688:0@lo:400:kworker.0 00000100:00100000:1.0:1787384496.055290:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384496.055358:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787384496.055365:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203330816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787384496.055393:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384496.055442:0:13608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203330816 00000100:00100000:1.0:1787384496.055450:0:13608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203330816 00000100:00100000:1.0:1787384496.055501:0:13608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787384496.055511:0:13608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203330816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787384496.055537:0:13608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787384496.055578:0:13608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203330816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384496.055599:0:13608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1787384496.055620:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787384496.055651:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7e07100 x1874208203330816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384512 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384496.055669:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203330816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787384496.056930:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203330688 00000100:00100000:3.0:1787384496.056939:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203330688 00000100:00100000:3.0:1787384496.057005:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1787384496.057015:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203330688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384496.057079:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203330688:12345-0@lo:400:kworker.0 Request processed in 65us (1789us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384496.057086:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787384496.057204:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203330688:0@lo:400:kworker.0 00000100:00100000:3.0:1787384496.062219:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203330944:0@lo:400:kworker.0 00000100:00100000:3.0:1787384496.062325:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384496.062393:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203330560:0@lo:400:kworker.0 00000100:00100000:3.0:1787384496.062663:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384496.062767:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203330560 00000100:00100000:1.0:1787384496.062775:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203330560 00000100:00100000:1.0:1787384496.062852:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1787384496.062861:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3653:x1874208203330560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384496.062920:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3653:x1874208203330560:12345-0@lo:400:kworker.0 Request processed in 60us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384496.062928:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1787384496.063083:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203330944 00000100:00100000:2.0:1787384496.063089:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203330944 00000100:00100000:2.0:1787384496.063125:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787384496.063133:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203330944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384496.063177:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203330944:12345-0@lo:400:kworker.0 Request processed in 45us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384496.063183:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787384496.063564:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203330944:0@lo:400:kworker.0 00000100:00100000:3.0:1787384496.063576:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203330560:0@lo:400:kworker.0 00000100:00100000:1.0:1787384496.065821:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874208203331072:0@lo:400:kworker.0 00000100:00100000:1.0:1787384496.065891:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384496.065926:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203331584:0@lo:400:kworker.0 00000100:00100000:1.0:1787384496.065952:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384496.065968:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203332096:0@lo:400:kworker.0 00000100:00100000:1.0:1787384496.065987:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384496.066007:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787384496.066013:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874208203331456:0@lo:400:kworker.0 00000100:00100000:1.0:1787384496.066035:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384496.066056:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874208203331968:0@lo:400:kworker.0 00000100:00100000:1.0:1787384496.066076:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384496.066120:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203331072 00000100:00100000:1.0:1787384496.066127:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203331072 00000100:00100000:1.0:1787384496.066172:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203331456 00000100:00100000:1.0:1787384496.066175:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203331456 00000100:00100000:1.0:1787384496.066198:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203331968 00000100:00100000:1.0:1787384496.066201:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203331968 00000100:00100000:1.0:1787384496.066218:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787384496.066226:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874208203331072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384496.066523:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874208203331072:12345-0@lo:400:kworker.0 Request processed in 296us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384496.066532:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787384496.066552:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1787384496.066558:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874208203331456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384496.066587:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874208203331456:12345-0@lo:400:kworker.0 Request processed in 30us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384496.066592:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1787384496.066604:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1787384496.066610:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874208203331968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384496.066634:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874208203331968:12345-0@lo:400:kworker.0 Request processed in 24us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384496.066639:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00080000:1.0:1787384496.066659:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787384496.066706:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7dbc700 x1874208203331456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384496.066721:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874208203331456:0@lo:400:kworker.0 00010000:00080000:1.0:1787384496.066733:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3a83480 x1874208203331968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384496.066756:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874208203331968:0@lo:400:kworker.0 00000100:00100000:1.0:1787384496.066771:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874208203331072:0@lo:400:kworker.0 00000100:00100000:2.0:1787384496.066897:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203331584 00000100:00100000:2.0:1787384496.066902:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203331584 00000100:00100000:2.0:1787384496.066937:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203332096 00000100:00100000:2.0:1787384496.066940:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203332096 00000100:00100000:2.0:1787384496.066966:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787384496.066979:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203331584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384496.067017:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203331584:12345-0@lo:400:kworker.0 Request processed in 39us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384496.067023:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787384496.067037:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787384496.067042:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203332096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384496.067069:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203332096:12345-0@lo:400:kworker.0 Request processed in 26us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384496.067075:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1787384496.067098:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787384496.067111:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203331200:0@lo:400:kworker.0 00000100:00100000:2.0:1787384496.067141:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384496.067163:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203331712:0@lo:400:kworker.0 00000100:00100000:2.0:1787384496.067188:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384496.067207:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787384496.067213:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203331328:0@lo:400:kworker.0 00000100:00100000:2.0:1787384496.067235:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384496.067262:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874208203331840:0@lo:400:kworker.0 00000100:00100000:2.0:1787384496.067360:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384496.067388:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203331200 00000100:00100000:2.0:1787384496.067392:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203331200 00000100:00100000:2.0:1787384496.067502:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787384496.067511:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203331200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384496.067549:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203331200:12345-0@lo:400:kworker.0 Request processed in 40us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384496.067556:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787384496.067581:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203331328 00000100:00100000:2.0:1787384496.067585:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203331328 00000100:00100000:2.0:1787384496.067609:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203331840 00000100:00100000:2.0:1787384496.067612:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203331840 00000100:00100000:2.0:1787384496.067626:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787384496.067631:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203331328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384496.067674:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203331328:12345-0@lo:400:kworker.0 Request processed in 42us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384496.067681:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787384496.067693:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787384496.067699:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874208203331840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384496.067722:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874208203331840:12345-0@lo:400:kworker.0 Request processed in 24us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384496.067728:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00080000:2.0:1787384496.067741:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384496.067750:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203331712 00000100:00100000:2.0:1787384496.067754:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203331712 00000100:00100000:2.0:1787384496.067773:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00010000:00010000:3.0:1787384496.067980:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384496.068030:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203331328:0@lo:400:kworker.0 00000100:00100000:3.0:1787384496.068040:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874208203331840:0@lo:400:kworker.0 00000100:00100000:3.0:1787384496.068049:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203331200:0@lo:400:kworker.0 00000100:00100000:1.0:1787384496.068171:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203331584:0@lo:400:kworker.0 00010000:00080000:1.0:1787384496.068185:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3a80700 x1874208203332096/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384496.068195:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203332096:0@lo:400:kworker.0 00000100:00100000:2.0:1787384496.068614:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd624050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203331712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384496.068723:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd624050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203331712:12345-0@lo:400:kworker.0 Request processed in 943us (1533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384496.068732:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787384496.078695:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203331712:0@lo:400:kworker.0 00000100:00100000:1.0:1787384496.569635:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4121880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203332224:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787384496.569735:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384496.569841:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203332224 00000100:00100000:1.0:1787384496.569849:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203332224 00000100:00100000:1.0:1787384496.569891:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787384496.569899:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203332224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787384496.569926:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787384496.571323:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203332224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1416us (1581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384496.571337:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:1.0:1787384496.571409:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4121880 x1874208203332224/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384512 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384496.572201:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4121880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203332224:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787384496.998095:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384496.998203:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182269056 00000100:00100000:2.0:1787384496.998212:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182269056 00000100:00100000:2.0:1787384496.998275:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 371 00000100:00100000:2.0:1787384496.998285:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+13:2415:x1874208182269056:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384496.998368:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+13:2415:x1874208182269056:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 84us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384496.998390:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 371 00000100:00100000:0.0:1787384497.002881:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384497.002924:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384497.002956:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384497.002983:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384497.003062:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384497.003094:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182269184 00000100:00100000:0.0:1787384497.003105:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182269184 00000100:00100000:0.0:1787384497.003157:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182269312 00000100:00100000:0.0:1787384497.003160:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182269312 00000100:00100000:0.0:1787384497.003173:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182269696 00000100:00100000:0.0:1787384497.003175:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182269696 00000100:00100000:1.0:1787384497.003298:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182269440 00000100:00100000:1.0:1787384497.003302:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182269440 00000100:00100000:1.0:1787384497.003338:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 89 00000100:00100000:1.0:1787384497.003348:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2416:x1874208182269440:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384497.003455:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2416:x1874208182269440:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 108us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384497.003465:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 89 00000100:00100000:3.0:1787384497.003749:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182269568 00000100:00100000:3.0:1787384497.003755:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182269568 00000100:00100000:3.0:1787384497.003820:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 253 00000100:00100000:3.0:1787384497.003828:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2415:x1874208182269184:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384497.003869:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2415:x1874208182269184:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 42us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384497.003883:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 253 00000100:00100000:3.0:1787384497.003899:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 254 00000100:00100000:3.0:1787384497.003905:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2415:x1874208182269312:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384497.003935:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2415:x1874208182269312:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 30us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384497.003941:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 254 00000100:00100000:3.0:1787384497.003952:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 255 00000100:00100000:3.0:1787384497.003959:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2415:x1874208182269568:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384497.003983:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2415:x1874208182269568:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 25us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384497.003989:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 255 00000100:00080000:2.0:1787384497.004371:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787384497.004376:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787384497.004379:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384497.004649:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 256 00000100:00100000:2.0:1787384497.004658:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2416:x1874208182269696:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384497.004705:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2416:x1874208182269696:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 49us (1720us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384497.004712:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 256 00010000:00010000:2.0:1787384497.078998:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787384497.720335:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1787384497.721149:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787384498.103269:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384498.105638:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787384498.105663:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203332352:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787384498.105735:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384498.105902:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203332352 00000100:00100000:2.0:1787384498.105910:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203332352 00000100:00100000:2.0:1787384498.105964:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787384498.105975:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203332352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787384498.106014:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787384498.106072:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203332352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384498.106079:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787384498.106219:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203332352:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787384498.615458:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787384498.615496:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203332480:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787384498.615564:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384498.615803:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203332480 00000100:00100000:2.0:1787384498.615810:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203332480 00000100:00100000:2.0:1787384498.615867:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787384498.615877:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203332480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787384498.615910:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787384498.615970:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203332480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384498.615978:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787384498.616270:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203332480:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787384499.127476:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384500.151136:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384500.662971:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4123480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203332608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787384500.663063:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384500.663377:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203332736:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787384500.663425:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384500.663540:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203332736 00000100:00100000:0.0:1787384500.663540:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203332608 00000100:00100000:2.0:1787384500.663547:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203332736 00000100:00100000:0.0:1787384500.663547:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203332608 00000100:00100000:2.0:1787384500.663664:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787384500.663675:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203332736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787384500.663704:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384500.663755:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203332736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384500.663761:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787384500.663858:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203332736:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787384500.666447:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787384500.666464:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203332608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787384500.666492:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787384500.666592:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203332608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (3528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384500.666599:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787384500.666763:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4123480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203332608:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787384500.675317:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787384501.174964:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384501.175206:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4122300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203333120:0@lo:400:kworker.0 00000100:00100000:1.0:1787384501.175291:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384501.175301:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4123480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203332864:0@lo:400:kworker.0 00000100:00100000:2.0:1787384501.175333:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384501.175346:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874208203333632:0@lo:400:kworker.0 00000100:00100000:2.0:1787384501.175353:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203333376:0@lo:400:kworker.0 00000100:00100000:1.0:1787384501.175369:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384501.175371:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384501.175386:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203333888:0@lo:400:kworker.0 00000100:00100000:1.0:1787384501.175386:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874208203334144:0@lo:400:kworker.0 00000100:00100000:1.0:1787384501.175405:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384501.175406:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384501.175419:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee146680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203334400:0@lo:400:kworker.0 00000100:00100000:1.0:1787384501.175426:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787384501.175431:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4120e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874208203332992:0@lo:400:kworker.0 00000100:00100000:2.0:1787384501.175436:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384501.175448:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384501.175452:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787384501.175457:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4123800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874208203333248:0@lo:400:kworker.0 00000100:00100000:1.0:1787384501.175461:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874208203333504:0@lo:400:kworker.0 00000100:00100000:2.0:1787384501.175476:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384501.175486:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203333120 00000100:00100000:2.0:1787384501.175493:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203333760:0@lo:400:kworker.0 00000100:00100000:1.0:1787384501.175493:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203333120 00000100:00100000:2.0:1787384501.175512:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384501.175527:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee144700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203334272:0@lo:400:kworker.0 00000100:00100000:2.0:1787384501.175546:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384501.175580:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203333376 00000100:00100000:2.0:1787384501.175584:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203333376 00000100:00100000:2.0:1787384501.175623:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787384501.175631:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203333376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384501.175683:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203333376:12345-0@lo:400:kworker.0 Request processed in 52us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384501.175691:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787384501.175714:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203333632 00000100:00100000:2.0:1787384501.175718:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203333632 00000100:00100000:3.0:1787384501.175741:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203332864 00000100:00100000:3.0:1787384501.175745:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203332864 00000100:00100000:2.0:1787384501.175745:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203334144 00000100:00100000:2.0:1787384501.175747:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203334144 00000100:00100000:2.0:1787384501.175759:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203332992 00000100:00100000:2.0:1787384501.175761:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203332992 00000100:00100000:2.0:1787384501.175770:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203333248 00000100:00100000:3.0:1787384501.175773:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1787384501.175773:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203333248 00000100:00100000:2.0:1787384501.175810:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787384501.175811:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3652:x1874208203332864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384501.175816:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874208203333632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384501.175843:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3652:x1874208203332864:12345-0@lo:400:kworker.0 Request processed in 65us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384501.175843:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874208203333632:12345-0@lo:400:kworker.0 Request processed in 26us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384501.175849:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787384501.175850:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1787384501.175860:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787384501.175865:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874208203334144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384501.175885:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203333888 00000100:00100000:2.0:1787384501.175888:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874208203334144:12345-0@lo:400:kworker.0 Request processed in 22us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384501.175889:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203333888 00000100:00100000:2.0:1787384501.175893:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787384501.175903:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787384501.175905:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203334400 00000100:00100000:3.0:1787384501.175907:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203334400 00000100:00100000:2.0:1787384501.175907:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874208203332992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384501.175918:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203333760 00000100:00100000:3.0:1787384501.175920:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203333760 00000100:00100000:2.0:1787384501.175931:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874208203332992:12345-0@lo:400:kworker.0 Request processed in 23us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384501.175942:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203334272 00000100:00100000:2.0:1787384501.175942:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787384501.175945:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203334272 00000100:00100000:2.0:1787384501.175954:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787384501.175957:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787384501.175959:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874208203333248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384501.175962:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203333888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384501.175985:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874208203333248:12345-0@lo:400:kworker.0 Request processed in 25us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384501.175990:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787384501.175995:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203333888:12345-0@lo:400:kworker.0 Request processed in 23us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384501.176001:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787384501.176008:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787384501.176011:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787384501.176014:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203334400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384501.176016:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203333760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384501.176041:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203333760:12345-0@lo:400:kworker.0 Request processed in 23us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384501.176041:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203334400:12345-0@lo:400:kworker.0 Request processed in 27us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384501.176046:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787384501.176144:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787384501.176160:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787384501.176166:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203334272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384501.176251:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787384501.176257:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203333120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384501.176278:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203334272:12345-0@lo:400:kworker.0 Request processed in 29us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384501.176285:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787384501.176293:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203333120:12345-0@lo:400:kworker.0 Request processed in 38us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384501.176299:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787384501.176316:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203334528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787384501.176344:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4123800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874208203333248:0@lo:400:kworker.0 00000100:00100000:2.0:1787384501.176346:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384501.176355:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203333760:0@lo:400:kworker.0 00010000:00080000:1.0:1787384501.176366:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee144700 x1874208203334272/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384501.176376:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee144700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203334272:0@lo:400:kworker.0 00000100:00080000:2.0:1787384501.176386:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787384501.176386:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4123480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203332864:0@lo:400:kworker.0 00000100:00080000:2.0:1787384501.176392:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787384501.176395:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203333376:0@lo:400:kworker.0 00000100:00100000:1.0:1787384501.176404:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203333888:0@lo:400:kworker.0 00010000:00080000:1.0:1787384501.176414:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee146680 x1874208203334400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384501.176418:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384501.176423:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee146680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203334400:0@lo:400:kworker.0 00000100:00100000:2.0:1787384501.176436:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874208203334016:0@lo:400:kworker.0 00000100:00100000:2.0:1787384501.176460:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384501.176465:0:13608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203334528 00000100:00100000:1.0:1787384501.176468:0:13608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203334528 00000100:00100000:2.0:1787384501.176488:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4122300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203333120:0@lo:400:kworker.0 00000100:00100000:1.0:1787384501.176495:0:13608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00010000:00080000:2.0:1787384501.176499:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee257b80 x1874208203333632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384501.176514:0:13608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203334528:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787384501.176515:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874208203333632:0@lo:400:kworker.0 00010000:00080000:2.0:1787384501.176529:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c35db100 x1874208203334144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384501.176537:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874208203334144:0@lo:400:kworker.0 00000100:00100000:2.0:1787384501.176557:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4120e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874208203332992:0@lo:400:kworker.0 00000100:00100000:2.0:1787384501.176572:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203333504 00000100:00100000:2.0:1787384501.176575:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203333504 00000100:00100000:2.0:1787384501.176600:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203334016 00000100:00100000:2.0:1787384501.176603:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203334016 00000100:00100000:2.0:1787384501.176619:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787384501.176623:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874208203333504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384501.176656:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874208203333504:12345-0@lo:400:kworker.0 Request processed in 32us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384501.176662:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787384501.176673:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787384501.176678:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874208203334016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384501.176702:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874208203334016:12345-0@lo:400:kworker.0 Request processed in 24us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384501.176707:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00080000:2.0:1787384501.176723:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384501.176743:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874208203333504:0@lo:400:kworker.0 00000100:00100000:2.0:1787384501.176751:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874208203334016:0@lo:400:kworker.0 00002000:00000024:1.0:1787384501.178118:0:13608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787384501.178192:0:13608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203334528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1688us (1842us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384501.178224:0:13608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:2.0:1787384501.178369:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7e05180 x1874208203334528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384517 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384501.178400:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203334528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787384501.687058:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384501.687082:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203334656:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787384501.687151:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384501.687280:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203334656 00000100:00100000:1.0:1787384501.687288:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203334656 00000100:00100000:1.0:1787384501.687341:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787384501.687351:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203334656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787384501.687373:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787384501.687429:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203334656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384501.687437:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:3.0:1787384501.687616:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3ad8e00 x1874208203334656/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384517 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384501.687633:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203334656:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787384502.117304:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384502.117399:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384502.117645:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182269824 00000100:00100000:0.0:1787384502.117655:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182269824 00000100:00100000:0.0:1787384502.117723:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 373 00000100:00100000:0.0:1787384502.117733:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+13:2415:x1874208182269824:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384502.117841:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+13:2415:x1874208182269824:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 109us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384502.117848:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 373 00000100:00100000:2.0:1787384502.122057:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182269952 00000100:00100000:2.0:1787384502.122072:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182269952 00000100:00100000:2.0:1787384502.122151:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 263 00000100:00100000:2.0:1787384502.122161:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2415:x1874208182269952:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384502.122248:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2415:x1874208182269952:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 88us (4849us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384502.122256:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 263 00000100:00080000:3.0:1787384502.122427:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384502.131677:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384502.132493:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182270080 00000100:00100000:2.0:1787384502.132506:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182270080 00000100:00100000:2.0:1787384502.132600:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 264 00000100:00100000:2.0:1787384502.132611:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee146680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2416:x1874208182270080:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384502.132711:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee146680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2416:x1874208182270080:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 102us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384502.132719:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 264 00000100:00080000:3.0:1787384502.133095:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787384502.135117:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384502.135160:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384502.135199:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384502.135294:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182270464 00000100:00100000:1.0:1787384502.135305:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182270464 00000100:00100000:1.0:1787384502.135376:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182270336 00000100:00100000:1.0:1787384502.135379:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182270336 00000100:00100000:1.0:1787384502.135410:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 265 00000100:00100000:1.0:1787384502.135418:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2415:x1874208182270464:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384502.135494:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2415:x1874208182270464:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 76us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384502.135502:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 265 00000100:00100000:1.0:1787384502.135521:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 266 00000100:00100000:1.0:1787384502.135528:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2416:x1874208182270336:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384502.135553:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2416:x1874208182270336:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 26us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384502.135577:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 266 00000100:00080000:0.0:1787384502.136133:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787384502.136140:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787384502.136288:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182270208 00000100:00100000:2.0:1787384502.136294:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182270208 00000100:00100000:2.0:1787384502.136361:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 27 00000100:00100000:2.0:1787384502.136370:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2412:x1874208182270208:12345-192.168.203.45@tcp:9:kworker.0 00000020:00000080:2.0:1787384502.136391:0:8435:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba29d6 00000100:00080000:2.0:1787384502.136400:0:8435:0:(import.c:65:import_set_state_nolock()) ffff98f8f7dfb000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787384502.136448:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:2.0:1787384502.136612:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+2:2412:x1874208182270208:12345-192.168.203.45@tcp:9:kworker.0 Request processed in 244us (1507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384502.136633:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 27 00010000:00010000:3.0:1787384502.136764:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787384502.136844:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787384502.204919:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384503.222940:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384503.223653:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7de9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203334784:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787384503.223720:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384503.223861:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203334784 00000100:00100000:2.0:1787384503.223870:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203334784 00000100:00100000:2.0:1787384503.223916:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787384503.223926:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203334784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787384503.223958:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787384503.224013:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203334784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384503.224029:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787384503.224151:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7de9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203334784:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787384503.735299:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203334912:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787384503.735377:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384503.735952:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203334912 00000100:00100000:2.0:1787384503.735961:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203334912 00000100:00100000:2.0:1787384503.736021:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787384503.736030:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee144700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203334912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787384503.736079:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787384503.736337:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee144700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203334912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 306us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384503.736345:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787384503.736446:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203334912:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787384504.247275:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384505.271270:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384505.783349:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203335040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787384505.783487:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203335168:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787384505.783554:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384505.783709:0:13608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203335168 00000100:00100000:1.0:1787384505.783723:0:13608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203335168 00000100:00100000:1.0:1787384505.783846:0:13608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787384505.783861:0:13608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203335168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787384505.783902:0:13608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787384505.783972:0:13608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203335168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384505.783982:0:13608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:0.0:1787384505.784074:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787384505.784562:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384505.784598:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203335168:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787384505.784687:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203335040 00000100:00100000:1.0:1787384505.784694:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203335040 00000100:00100000:1.0:1787384505.784834:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787384505.784844:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203335040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787384505.784859:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787384505.784948:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203335040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384505.784955:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787384505.785440:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203335040:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787384505.785566:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787384506.295952:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787384506.295974:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203335296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787384506.296077:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203335680:0@lo:400:kworker.0 00000100:00100000:2.0:1787384506.296133:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384506.296192:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874208203336192:0@lo:400:kworker.0 00000100:00100000:1.0:1787384506.296207:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384506.296232:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384506.296241:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7de9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203335424:0@lo:400:kworker.0 00000100:00100000:2.0:1787384506.296263:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874208203336704:0@lo:400:kworker.0 00000100:00100000:1.0:1787384506.296271:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384506.296281:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384506.296299:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203335936:0@lo:400:kworker.0 00000100:00100000:2.0:1787384506.296300:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787384506.296305:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874208203335552:0@lo:400:kworker.0 00000100:00100000:2.0:1787384506.296321:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384506.296321:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384506.296337:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874208203336064:0@lo:400:kworker.0 00000100:00100000:1.0:1787384506.296337:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203336448:0@lo:400:kworker.0 00000100:00100000:2.0:1787384506.296355:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384506.296355:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384506.296369:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874208203336576:0@lo:400:kworker.0 00000100:00100000:1.0:1787384506.296369:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9148a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203336960:0@lo:400:kworker.0 00000100:00100000:2.0:1787384506.296386:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384506.296387:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384506.296401:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787384506.296406:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874208203335808:0@lo:400:kworker.0 00000100:00100000:2.0:1787384506.296408:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203335424 00000100:00100000:2.0:1787384506.296414:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203335424 00000100:00100000:1.0:1787384506.296425:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384506.296434:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fc1b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203336320:0@lo:400:kworker.0 00000100:00100000:1.0:1787384506.296451:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384506.296461:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1787384506.296469:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3652:x1874208203335424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384506.296517:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3652:x1874208203335424:12345-0@lo:400:kworker.0 Request processed in 48us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384506.296523:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1787384506.296551:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203336832:0@lo:400:kworker.0 00000100:00100000:2.0:1787384506.296554:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203336192 00000100:00100000:2.0:1787384506.296557:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203336192 00000100:00100000:1.0:1787384506.296571:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384506.296584:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203336704 00000100:00100000:2.0:1787384506.296587:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203336704 00000100:00100000:2.0:1787384506.296598:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203335552 00000100:00100000:1.0:1787384506.296598:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7de9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203335424:0@lo:400:kworker.0 00000100:00100000:2.0:1787384506.296600:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203335552 00000100:00100000:2.0:1787384506.296609:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203336064 00000100:00100000:2.0:1787384506.296611:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203336064 00000100:00100000:2.0:1787384506.296621:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203336576 00000100:00100000:1.0:1787384506.296622:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203335296 00000100:00100000:2.0:1787384506.296624:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203336576 00000100:00100000:1.0:1787384506.296625:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203335296 00000100:00100000:2.0:1787384506.296633:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203335808 00000100:00100000:2.0:1787384506.296641:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203335808 00000100:00100000:1.0:1787384506.296649:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787384506.296655:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203335296:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787384506.296656:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787384506.296660:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874208203336192:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1787384506.296675:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384506.296692:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874208203336192:12345-0@lo:400:kworker.0 Request processed in 31us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384506.296699:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787384506.296702:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203335296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384506.296708:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787384506.296710:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787384506.296715:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874208203336704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384506.296725:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787384506.296730:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874208203335552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384506.296739:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874208203336704:12345-0@lo:400:kworker.0 Request processed in 25us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384506.296745:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1787384506.296754:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874208203335552:12345-0@lo:400:kworker.0 Request processed in 24us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384506.296755:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787384506.296760:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874208203336064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384506.296765:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787384506.297502:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874208203336064:12345-0@lo:400:kworker.0 Request processed in 737us (1141us total) trans 0 rc 0/0 00010000:00010000:0.0:1787384506.299633:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384506.299679:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203336448 00000100:00100000:0.0:1787384506.299689:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203336448 00000100:00100000:0.0:1787384506.299728:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203336960 00000100:00100000:0.0:1787384506.299732:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203336960 00000100:00100000:0.0:1787384506.299743:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203336320 00000100:00100000:0.0:1787384506.299745:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203336320 00000100:00100000:0.0:1787384506.299756:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203336832 00000100:00100000:0.0:1787384506.299758:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203336832 00000100:00100000:0.0:1787384506.299883:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787384506.299894:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203336448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384506.300085:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203336448:12345-0@lo:400:kworker.0 Request processed in 193us (3727us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384506.300092:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787384506.300109:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787384506.300115:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203336960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384506.300144:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203336960:12345-0@lo:400:kworker.0 Request processed in 30us (3756us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384506.300149:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787384506.300159:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787384506.300164:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203336320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384506.300202:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203336320:12345-0@lo:400:kworker.0 Request processed in 38us (3750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384506.300208:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787384506.300220:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787384506.300227:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203336832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384506.300253:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203336832:12345-0@lo:400:kworker.0 Request processed in 27us (3680us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384506.300258:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787384506.300278:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203335680 00000100:00100000:0.0:1787384506.300282:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203335680 00000100:00100000:0.0:1787384506.300309:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203335936 00000100:00100000:0.0:1787384506.300312:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203335936 00000100:00100000:0.0:1787384506.300323:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787384506.300328:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203335680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384506.300371:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203335680:12345-0@lo:400:kworker.0 Request processed in 42us (4238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384506.300377:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787384506.300388:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787384506.300393:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203335936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384506.300420:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203335936:12345-0@lo:400:kworker.0 Request processed in 27us (4098us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384506.300426:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787384506.300514:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203336320:0@lo:400:kworker.0 00010000:00080000:0.0:1787384506.300530:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f9149c00 x1874208203336832/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384506.300540:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203336832:0@lo:400:kworker.0 00000100:00100000:0.0:1787384506.300551:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203335936:0@lo:400:kworker.0 00000100:00100000:0.0:1787384506.300560:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fc1b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203336448:0@lo:400:kworker.0 00010000:00080000:0.0:1787384506.300570:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f9148a80 x1874208203336960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384506.300577:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9148a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203336960:0@lo:400:kworker.0 00010000:00080000:0.0:1787384506.300587:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee255f80 x1874208203335296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384522 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384506.300601:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203335296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787384506.303502:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1787384506.303533:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874208203336576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384506.303629:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874208203336576:12345-0@lo:400:kworker.0 Request processed in 111us (7240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384506.305932:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787384506.305978:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787384506.305995:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874208203335808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384506.306089:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874208203335808:12345-0@lo:400:kworker.0 Request processed in 102us (9661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384506.306096:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787384506.306151:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874208203335552:0@lo:400:kworker.0 00000100:00100000:2.0:1787384506.306164:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874208203336064:0@lo:400:kworker.0 00000100:00100000:2.0:1787384506.306176:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874208203336576:0@lo:400:kworker.0 00000100:00100000:2.0:1787384506.306368:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203335680:0@lo:400:kworker.0 00010000:00080000:2.0:1787384506.306382:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee289500 x1874208203336192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384506.306392:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874208203336192:0@lo:400:kworker.0 00010000:00080000:2.0:1787384506.306403:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f914ad80 x1874208203336704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384506.306410:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874208203336704:0@lo:400:kworker.0 00000100:00080000:2.0:1787384506.306451:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787384506.306457:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787384506.306459:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787384506.306481:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874208203335808:0@lo:400:kworker.0 00000100:00100000:1.0:1787384506.310648:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1787384506.813508:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787384506.813531:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203337088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787384506.813611:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384506.813675:0:13608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203337088 00000100:00100000:0.0:1787384506.813683:0:13608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203337088 00000100:00100000:0.0:1787384506.813725:0:13608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787384506.813732:0:13608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203337088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787384506.813752:0:13608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787384506.813809:0:13608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203337088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384506.813816:0:13608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00010000:00080000:0.0:1787384506.813855:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3a80a80 x1874208203337088/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384522 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384506.813874:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203337088:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787384507.240336:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384507.240370:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384507.240391:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384507.240408:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384507.240431:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384507.240456:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182270848 00000100:00100000:2.0:1787384507.240465:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182270848 00000100:00100000:2.0:1787384507.240517:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182271104 00000100:00100000:2.0:1787384507.240521:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182271104 00000100:00100000:2.0:1787384507.240535:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182270720 00000100:00100000:2.0:1787384507.240537:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182270720 00000100:00100000:2.0:1787384507.240549:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182270976 00000100:00100000:2.0:1787384507.240551:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182270976 00000100:00100000:2.0:1787384507.240566:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 273 00000100:00100000:2.0:1787384507.240574:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee117b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2416:x1874208182270848:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384507.240664:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee117b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2416:x1874208182270848:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 89us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384507.240673:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 273 00000100:00100000:2.0:1787384507.240691:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 274 00000100:00100000:2.0:1787384507.240697:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2416:x1874208182271104:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384507.240720:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2416:x1874208182271104:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 23us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384507.240726:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 274 00000100:00100000:2.0:1787384507.240736:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 275 00000100:00100000:2.0:1787384507.240742:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2416:x1874208182270720:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384507.240765:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2416:x1874208182270720:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 24us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384507.240771:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 275 00000100:00100000:2.0:1787384507.240819:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 276 00000100:00100000:2.0:1787384507.240826:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2416:x1874208182270976:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384507.240852:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2416:x1874208182270976:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 27us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384507.240858:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 276 00000100:00080000:2.0:1787384507.240884:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787384507.240888:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787384507.241016:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182270592 00000100:00100000:2.0:1787384507.241021:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182270592 00000100:00100000:2.0:1787384507.241045:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 375 00000100:00100000:2.0:1787384507.241051:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+13:2416:x1874208182270592:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384507.241090:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+13:2416:x1874208182270592:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 38us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384507.241096:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 375 00010000:00010000:2.0:1787384507.320051:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787384507.838585:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 55e96ad5-fd9d-44d4-856e-5db0c40b1329 00000020:00000080:1.0:1787384507.838594:0:8432:0:(genops.c:906:class_export_put()) final put ffff98f8f7dfe000/55e96ad5-fd9d-44d4-856e-5db0c40b1329 00000020:00000080:3.0:1787384507.838753:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f7dfe000/55e96ad5-fd9d-44d4-856e-5db0c40b1329 for lustre-OST0000 00000020:00000080:3.0:1787384507.839373:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8f7dfb000 for lustre-OST0000 00000040:00080000:1.0:1787384507.959904:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1787384507.961316:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787384508.345226:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384508.352562:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384508.352585:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7de9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203337216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787384508.352651:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384508.353564:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203337216 00000100:00100000:1.0:1787384508.353573:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203337216 00000100:00100000:1.0:1787384508.353627:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787384508.353636:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203337216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787384508.353668:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787384508.353726:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203337216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384508.353733:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787384508.353854:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7de9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203337216:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787384508.855184:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787384508.855205:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203337344:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787384508.855273:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384508.855341:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203337344 00000100:00100000:2.0:1787384508.855348:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203337344 00000100:00100000:2.0:1787384508.855390:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787384508.855399:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd75b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203337344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787384508.855429:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787384508.855470:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd75b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203337344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384508.855477:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787384508.855523:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203337344:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787384509.369164:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384510.391107:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384510.903396:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7de9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203337472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787384510.903468:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384510.903548:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203337472 00000100:00100000:1.0:1787384510.903557:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203337472 00000100:00100000:1.0:1787384510.903614:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787384510.903624:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203337472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787384510.903658:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787384510.903717:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203337472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384510.903742:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:1.0:1787384510.903768:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787384510.903840:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7de9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203337472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787384510.914818:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787384510.914852:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203337600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787384510.914931:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384510.915010:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203337600 00000100:00100000:3.0:1787384510.915019:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203337600 00000100:00100000:3.0:1787384510.915083:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787384510.915092:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203337600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787384510.915113:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787384510.915244:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203337600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 152us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384510.915252:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:3.0:1787384510.915275:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787384510.915929:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203337600:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787384511.415488:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203337728:0@lo:400:kworker.0 00000100:00100000:2.0:1787384511.415567:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384511.415626:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203338240:0@lo:400:kworker.0 00000100:00100000:2.0:1787384511.415677:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384511.415701:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203338752:0@lo:400:kworker.0 00000100:00100000:2.0:1787384511.415738:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384511.415765:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9148a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203339264:0@lo:400:kworker.0 00000100:00100000:2.0:1787384511.415815:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384511.415838:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787384511.415844:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874208203338112:0@lo:400:kworker.0 00000100:00100000:2.0:1787384511.415870:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384511.415902:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203338624:0@lo:400:kworker.0 00000100:00100000:2.0:1787384511.415921:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384511.415935:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203339136:0@lo:400:kworker.0 00000100:00100000:2.0:1787384511.415955:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384511.415985:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203338240 00000100:00100000:2.0:1787384511.415992:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203338240 00000100:00100000:2.0:1787384511.416038:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787384511.416047:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd759500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203338240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384511.416102:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd759500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203338240:12345-0@lo:400:kworker.0 Request processed in 55us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384511.416110:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787384511.416133:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203338112 00000100:00100000:2.0:1787384511.416136:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203338112 00000100:00100000:2.0:1787384511.416174:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1787384511.416179:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874208203338112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384511.416209:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874208203338112:12345-0@lo:400:kworker.0 Request processed in 29us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384511.416215:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1787384511.416258:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874208203338112:0@lo:400:kworker.0 00000100:00100000:1.0:1787384511.416416:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203337856:0@lo:400:kworker.0 00000100:00100000:1.0:1787384511.416446:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384511.416468:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203338368:0@lo:400:kworker.0 00000100:00100000:2.0:1787384511.416476:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203338240:0@lo:400:kworker.0 00000100:00100000:1.0:1787384511.416489:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384511.416505:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f54fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874208203338880:0@lo:400:kworker.0 00000100:00100000:2.0:1787384511.416514:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203337856 00000100:00100000:2.0:1787384511.416518:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203337856 00000100:00100000:1.0:1787384511.416527:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384511.416542:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203339392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787384511.416564:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787384511.416574:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384511.416582:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787384511.416588:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203337984:0@lo:400:kworker.0 00000100:00100000:0.0:1787384511.416650:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203337728 00000100:00100000:0.0:1787384511.416655:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203337728 00000100:00100000:0.0:1787384511.416686:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1787384511.416693:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3654:x1874208203337728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384511.416730:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384511.416733:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203338368 00000100:00100000:2.0:1787384511.416736:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203338368 00000100:00100000:2.0:1787384511.416766:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203338880 00000100:00100000:2.0:1787384511.416769:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203338880 00000100:00100000:2.0:1787384511.416809:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1787384511.416815:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203337856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384511.419073:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1787384511.419100:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203338368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384511.419299:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3654:x1874208203337728:12345-0@lo:400:kworker.0 Request processed in 2602us (3728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384511.419309:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1787384511.419375:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203338752 00000100:00100000:0.0:1787384511.419384:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203338752 00000100:00100000:0.0:1787384511.419412:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203339264 00000100:00100000:0.0:1787384511.419415:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203339264 00000100:00100000:0.0:1787384511.419431:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203338624 00000100:00100000:0.0:1787384511.419433:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203338624 00000100:00100000:0.0:1787384511.419443:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203339136 00000100:00100000:0.0:1787384511.419445:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203339136 00000100:00100000:0.0:1787384511.419466:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787384511.419471:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203338752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384511.419501:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203338752:12345-0@lo:400:kworker.0 Request processed in 30us (3763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384511.419506:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787384511.419515:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787384511.419521:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203339264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384511.419542:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203339264:12345-0@lo:400:kworker.0 Request processed in 22us (3728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384511.419547:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787384511.419556:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787384511.419560:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203338624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384511.419582:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203338624:12345-0@lo:400:kworker.0 Request processed in 22us (3660us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384511.419587:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787384511.419596:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787384511.419601:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203339136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384511.419625:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203339136:12345-0@lo:400:kworker.0 Request processed in 24us (3669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384511.419630:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787384511.419685:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203338624:0@lo:400:kworker.0 00010000:00080000:0.0:1787384511.419699:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f9148000 x1874208203339136/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384511.419709:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203339136:0@lo:400:kworker.0 00000100:00100000:0.0:1787384511.419718:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203337728:0@lo:400:kworker.0 00000100:00100000:0.0:1787384511.419736:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203338752:0@lo:400:kworker.0 00010000:00080000:0.0:1787384511.419749:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f9148a80 x1874208203339264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384511.419773:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9148a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203339264:0@lo:400:kworker.0 00000100:00100000:0.0:1787384511.419847:0:13608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203339392 00000100:00100000:0.0:1787384511.419851:0:13608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203339392 00000100:00100000:0.0:1787384511.419894:0:13608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787384511.419901:0:13608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203339392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787384511.419921:0:13608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787384511.419959:0:13608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203339392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (3392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384511.419965:0:13608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787384511.419983:0:6521:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1787384511.419990:0:6521:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1787384511.420091:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1787384511.420099:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874208203338880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384511.420131:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874208203338880:12345-0@lo:400:kworker.0 Request processed in 33us (3603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384511.420137:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1787384511.420289:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203337984 00000100:00100000:0.0:1787384511.420295:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203337984 00000100:00100000:0.0:1787384511.420329:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787384511.420335:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee31e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203337984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384511.420368:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee31e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203337984:12345-0@lo:400:kworker.0 Request processed in 33us (3638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384511.420384:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787384511.431405:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203337856:12345-0@lo:400:kworker.0 Request processed in 14577us (14945us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384511.431421:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00080000:2.0:1787384511.431509:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787384511.431515:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787384511.431709:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203338368:12345-0@lo:400:kworker.0 Request processed in 12622us (15216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384511.431717:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1787384511.443798:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203337984:0@lo:400:kworker.0 00000100:00100000:0.0:1787384511.443820:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874208203338496:0@lo:400:kworker.0 00000100:00100000:0.0:1787384511.443913:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384511.443954:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203339008:0@lo:400:kworker.0 00000100:00100000:0.0:1787384511.443976:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384511.444011:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203338496 00000100:00100000:0.0:1787384511.444011:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203337856:0@lo:400:kworker.0 00000100:00100000:1.0:1787384511.444018:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203338496 00000100:00100000:0.0:1787384511.444022:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203338368:0@lo:400:kworker.0 00000100:00100000:0.0:1787384511.444033:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f54fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874208203338880:0@lo:400:kworker.0 00010000:00080000:0.0:1787384511.444046:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c2a03b80 x1874208203339392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384527 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384511.444062:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203339392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787384511.444070:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1787384511.444078:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874208203338496:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787384511.444125:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787384511.444151:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203339008 00000100:00100000:0.0:1787384511.444155:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203339008 00000100:00080000:2.0:1787384511.444182:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787384511.444190:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1787384511.444196:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874208203339008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384511.448397:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874208203338496:12345-0@lo:400:kworker.0 Request processed in 4311us (4475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384511.448411:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1787384511.448580:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874208203339008:12345-0@lo:400:kworker.0 Request processed in 4383us (4601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384511.448589:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00010000:00080000:0.0:1787384511.448631:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3a80380 x1874208203338496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384511.448646:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874208203338496:0@lo:400:kworker.0 00010000:00080000:0.0:1787384511.448660:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f914ad80 x1874208203339008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384511.448689:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203339008:0@lo:400:kworker.0 00000100:00100000:1.0:1787384511.927190:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203339520:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787384511.927277:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384511.927522:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203339520 00000100:00100000:2.0:1787384511.927530:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203339520 00000100:00100000:2.0:1787384511.931033:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787384511.931059:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee31ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203339520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787384511.931098:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384511.931193:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee31ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203339520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 148us (3928us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384511.931201:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:1.0:1787384511.931294:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f914ad80 x1874208203339520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384527 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384511.931326:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203339520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787384512.358019:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384512.358350:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182271232 00000100:00100000:3.0:1787384512.358360:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182271232 00000100:00100000:3.0:1787384512.358421:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 377 00000100:00100000:3.0:1787384512.358431:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+13:2414:x1874208182271232:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384512.358506:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+13:2414:x1874208182271232:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 76us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384512.358515:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 377 00000100:00100000:2.0:1787384512.361430:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384512.361585:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182271360 00000100:00100000:3.0:1787384512.361597:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182271360 00000100:00100000:3.0:1787384512.361730:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 283 00000100:00100000:3.0:1787384512.361742:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2414:x1874208182271360:12345-192.168.203.45@tcp:400:kworker.0 00000100:00080000:2.0:1787384512.362933:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787384512.363449:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2414:x1874208182271360:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 1706us (2023us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384512.363460:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 283 00000100:00100000:3.0:1787384512.370593:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384512.370687:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384512.378041:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384512.378352:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182271616 00000100:00100000:2.0:1787384512.378362:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182271616 00000100:00100000:2.0:1787384512.378423:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182271488 00000100:00100000:2.0:1787384512.378427:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182271488 00000100:00100000:2.0:1787384512.378454:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 284 00000100:00100000:2.0:1787384512.378464:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2413:x1874208182271616:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384512.378535:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2413:x1874208182271616:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 73us (7952us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384512.378543:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 284 00000100:00100000:2.0:1787384512.378559:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 285 00000100:00100000:2.0:1787384512.378565:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2413:x1874208182271488:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384512.378590:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2413:x1874208182271488:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 25us (7904us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384512.378595:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 285 00000100:00080000:2.0:1787384512.378613:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787384512.378617:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787384512.380521:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182271744 00000100:00100000:0.0:1787384512.380533:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182271744 00000100:00080000:3.0:1787384512.380601:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787384512.387624:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 286 00000100:00100000:2.0:1787384512.387931:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2413:x1874208182271744:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384512.388011:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2413:x1874208182271744:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 375us (9980us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384512.388019:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 286 00010000:00010000:1.0:1787384512.439946:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787384513.223371:0:14069:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 03:41:50 (1787384510) 00000100:00100000:0.0:1787384513.473218:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203339648:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787384513.473329:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787384513.473446:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384513.473504:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203339648 00000100:00100000:3.0:1787384513.473512:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203339648 00000100:00100000:3.0:1787384513.473564:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787384513.473572:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203339648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787384513.473607:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787384513.473684:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203339648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384513.473691:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787384513.473885:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203339648:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787384513.976675:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787384513.976699:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203339776:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787384513.976842:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384513.976973:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203339776 00000100:00100000:2.0:1787384513.976982:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203339776 00000100:00100000:2.0:1787384513.977031:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787384513.977051:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4106a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203339776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787384513.977088:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787384513.977168:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4106a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203339776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384513.977175:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787384513.977336:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203339776:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787384514.487040:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384515.504612:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384515.504710:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182271872 00000100:00100000:3.0:1787384515.504721:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182271872 00000100:00100000:3.0:1787384515.504826:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 40 00000100:00100000:3.0:1787384515.504839:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:11091:x1874208182271872:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787384515.504857:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384515.506323:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba2ab6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3701 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384515.506422:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090200/0x7ef423838fba2abd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384515.506436:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090200/0x7ef423838fba2abd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384515.506452:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090200/0x7ef423838fba2abd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384515.506529:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787384515.506533:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787384515.506568:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090200/0x7ef423838fba2abd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384515.506596:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba2ab6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3701 expref: 7 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384515.506618:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090200/0x7ef423838fba2abd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3701 expref: 6 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384515.506643:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c294fb00) 00010000:00010000:3.0:1787384515.506646:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787384515.506650:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2090200, rc 0) 00000100:00100000:3.0:1787384515.506729:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:11091:x1874208182271872:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 1893us (2125us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384515.506738:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 40 00000100:00080000:2.0:1787384515.508325:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787384515.511069:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384515.527283:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384515.527471:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182272000 00000100:00100000:3.0:1787384515.527480:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182272000 00000100:00100000:3.0:1787384515.527539:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 41 00000100:00100000:3.0:1787384515.527550:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:11092:x1874208182272000:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787384515.527569:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384515.527588:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba2ac4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3708 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384515.527646:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba2acb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384515.527659:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba2acb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384515.527669:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba2acb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384515.527682:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2ad2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384515.527689:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384515.527708:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384515.527768:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090800/0x7ef423838fba2ad9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384515.527807:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090800/0x7ef423838fba2ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384515.527816:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090800/0x7ef423838fba2ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384515.527891:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787384515.527895:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787384515.527913:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090800/0x7ef423838fba2ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384515.527924:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba2acb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384515.527929:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba2acb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384515.527935:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba2acb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384515.527940:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2091400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384515.527944:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba2acb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384515.527950:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba2acb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384515.527969:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c294fb00) 00010000:00010000:3.0:1787384515.527971:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384515.527976:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba2acb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384515.527981:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba2acb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384515.527993:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384515.527998:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2ad2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384515.528002:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2ad2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384515.528007:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2090400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384515.528009:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2ad2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384515.528014:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2ad2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384515.528020:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff98f7c294f400) 00010000:00010000:3.0:1787384515.528022:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384515.528025:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2ad2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384515.528030:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2ad2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384515.528068:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba2ac4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3708 expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384515.528080:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090800/0x7ef423838fba2ad9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3708 expref: 7 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384515.528088:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98f7c294f000) 00010000:00010000:3.0:1787384515.528090:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787384515.528092:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2090800, rc 0) 00000100:00100000:3.0:1787384515.528364:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:11092:x1874208182272000:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 611us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384515.528372:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 41 00000100:00100000:3.0:1787384515.540331:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384515.540483:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182272128 00000100:00100000:1.0:1787384515.540493:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182272128 00000100:00100000:1.0:1787384515.540549:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 7 00000100:00100000:1.0:1787384515.540559:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:11092:x1874208182272128:12345-192.168.203.45@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787384515.540648:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:11092:x1874208182272128:12345-192.168.203.45@tcp:900:lhsmtool_posix.0 Request processed in 90us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384515.540656:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 7 00000100:00100000:2.0:1787384515.561005:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384515.561160:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182272384 00000100:00100000:0.0:1787384515.561171:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182272384 00000100:00100000:0.0:1787384515.561238:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 42 00000100:00100000:0.0:1787384515.561255:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:11092:x1874208182272384:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787384515.561277:0:8195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384515.561296:0:8195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba2ae0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce370f expref: -99 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384515.561359:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05e00/0x7ef423838fba2ae7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384515.561372:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05e00/0x7ef423838fba2ae7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384515.561383:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05e00/0x7ef423838fba2ae7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384515.561442:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05000/0x7ef423838fba2aee lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384515.561463:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05000/0x7ef423838fba2aee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384515.561470:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05000/0x7ef423838fba2aee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384515.561579:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba2af5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384515.561587:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba2af5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384515.561594:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba2af5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384515.561604:0:8195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1787384515.561690:0:8195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05e00/0x7ef423838fba2ae7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384515.561698:0:8195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05e00/0x7ef423838fba2ae7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384515.561705:0:8195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05e00/0x7ef423838fba2ae7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384515.561710:0:8195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b05e00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384515.561715:0:8195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05e00/0x7ef423838fba2ae7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384515.561721:0:8195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05e00/0x7ef423838fba2ae7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384515.561743:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98f7c294f000) 00010000:00010000:0.0:1787384515.561745:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384515.561750:0:8195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05e00/0x7ef423838fba2ae7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384515.561757:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05e00/0x7ef423838fba2ae7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384515.561771:0:8195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05000/0x7ef423838fba2aee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384515.561840:0:8195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05000/0x7ef423838fba2aee lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384515.561847:0:8195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05000/0x7ef423838fba2aee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384515.561852:0:8195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b05000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384515.561854:0:8195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05000/0x7ef423838fba2aee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384515.561860:0:8195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05000/0x7ef423838fba2aee lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384515.561868:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98f7c3a9c300) 00010000:00010000:0.0:1787384515.561870:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384515.561873:0:8195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05000/0x7ef423838fba2aee lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384515.561878:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05000/0x7ef423838fba2aee lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384515.562184:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba2ae0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce370f expref: 10 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384515.562197:0:8195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba2af5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce370f expref: 9 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384515.562205:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98f7c3a9cf00) 00010000:00010000:0.0:1787384515.562207:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384515.562209:0:8195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3b04000, rc 0) 00000100:00100000:0.0:1787384515.562269:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+9:11092:x1874208182272384:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 1016us (1272us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787384515.562277:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 42 00000100:00100000:3.0:1787384515.572391:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384515.572950:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182272512 00000100:00100000:0.0:1787384515.572959:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182272512 00000100:00100000:0.0:1787384515.573014:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 43 00000100:00100000:0.0:1787384515.573025:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+9:11092:x1874208182272512:12345-192.168.203.45@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787384515.574334:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+9:11092:x1874208182272512:12345-192.168.203.45@tcp:59:lhsmtool_posix.0 Request processed in 1182us (1823us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384515.574346:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 43 00000100:00100000:1.0:1787384515.584988:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384515.585086:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182272640 00000100:00100000:3.0:1787384515.585097:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182272640 00000100:00100000:3.0:1787384515.585379:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 44 00000100:00100000:3.0:1787384515.585392:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:11092:x1874208182272640:12345-192.168.203.45@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1787384515.585905:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1787384515.593246:0:6523:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 7799us 00000100:00100000:3.0:1787384515.628272:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:11092:x1874208182272640:12345-192.168.203.45@tcp:59:lhsmtool_posix.0 Request processed in 42872us (43282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384515.628297:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 44 00000100:00100000:3.0:1787384516.026331:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787384516.026354:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203339904:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787384516.026422:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384516.027456:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203340032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787384516.027521:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384516.027588:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203339904 00000100:00100000:2.0:1787384516.027599:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203339904 00000100:00100000:2.0:1787384516.027663:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203340032 00000100:00100000:2.0:1787384516.027667:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203340032 00000100:00100000:2.0:1787384516.027688:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787384516.027696:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203339904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787384516.027727:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787384516.027824:0:13608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787384516.027834:0:13608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203340032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787384516.027845:0:13608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384516.028980:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203339904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1270us (2543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384516.028991:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:2.0:1787384516.029022:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787384516.030216:0:13608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203340032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2379us (2690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384516.030228:0:13608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787384516.037644:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203340032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787384516.037664:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203339904:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1787384516.151821:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787384516.152651:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787384516.534984:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384516.535025:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203340160:0@lo:400:kworker.0 00000100:00100000:3.0:1787384516.535099:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874208203340544:0@lo:400:kworker.0 00000100:00100000:0.0:1787384516.535099:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384516.535141:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384516.535158:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb124380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874208203341056:0@lo:400:kworker.0 00000100:00100000:0.0:1787384516.535158:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203340672:0@lo:400:kworker.0 00000100:00100000:3.0:1787384516.535182:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384516.535182:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384516.535197:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874208203341184:0@lo:400:kworker.0 00000100:00100000:3.0:1787384516.535206:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787384516.535212:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203340416:0@lo:400:kworker.0 00000100:00100000:0.0:1787384516.535218:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384516.535233:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787384516.535236:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384516.535238:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203340288:0@lo:400:kworker.0 00000100:00100000:3.0:1787384516.535251:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874208203340928:0@lo:400:kworker.0 00000100:00100000:0.0:1787384516.535258:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384516.535273:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203340800:0@lo:400:kworker.0 00000100:00100000:0.0:1787384516.535290:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384516.535304:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203340544 00000100:00100000:0.0:1787384516.535307:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203341312:0@lo:400:kworker.0 00000100:00100000:3.0:1787384516.535317:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203340544 00000100:00100000:0.0:1787384516.535329:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384516.535358:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203340160 00000100:00100000:3.0:1787384516.535360:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203341056 00000100:00100000:3.0:1787384516.535362:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203341056 00000100:00100000:0.0:1787384516.535362:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203340160 00000100:00100000:0.0:1787384516.535390:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1787384516.535391:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203341184 00000100:00100000:3.0:1787384516.535393:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203341184 00000100:00100000:0.0:1787384516.535398:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d80c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3653:x1874208203340160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384516.535414:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203340288 00000100:00100000:3.0:1787384516.535416:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203340288 00000100:00100000:3.0:1787384516.535432:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203340800 00000100:00100000:3.0:1787384516.535435:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203340800 00000100:00100000:3.0:1787384516.535451:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1787384516.535452:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d80c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3653:x1874208203340160:12345-0@lo:400:kworker.0 Request processed in 54us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384516.535458:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1787384516.535464:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874208203340544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384516.535491:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203340672 00000100:00100000:0.0:1787384516.535494:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203340672 00000100:00100000:3.0:1787384516.535503:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874208203340544:12345-0@lo:400:kworker.0 Request processed in 46us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384516.535514:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203340416 00000100:00100000:0.0:1787384516.535516:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203340416 00000100:00100000:3.0:1787384516.535527:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1787384516.535537:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787384516.535540:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1787384516.535543:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203340672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384516.535551:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874208203341056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384516.535916:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203341312 00000100:00100000:1.0:1787384516.535920:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203341312 00000100:00100000:1.0:1787384516.535949:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787384516.535957:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203341312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384516.536260:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203340672:12345-0@lo:400:kworker.0 Request processed in 715us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384516.536267:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787384516.536282:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787384516.536289:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203340416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384516.536320:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203340416:12345-0@lo:400:kworker.0 Request processed in 32us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384516.536326:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787384516.536347:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787384516.536357:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4105f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203341568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384516.536387:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384516.536414:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203341568 00000100:00100000:0.0:1787384516.536418:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203341568 00000100:00100000:0.0:1787384516.536456:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787384516.536463:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203341568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787384516.536483:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787384516.536516:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203341568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384516.536523:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00010000:00080000:0.0:1787384516.536555:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4105f80 x1874208203341568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384532 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384516.536573:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4105f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203341568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384516.536599:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203340672:0@lo:400:kworker.0 00000100:00100000:0.0:1787384516.536620:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203340160:0@lo:400:kworker.0 00000100:00100000:0.0:1787384516.536664:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1787384516.536672:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874208203341184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384516.536708:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874208203341184:12345-0@lo:400:kworker.0 Request processed in 37us (1489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384516.536714:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1787384516.536730:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787384516.536736:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203340288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384516.536762:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203340288:12345-0@lo:400:kworker.0 Request processed in 27us (1503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384516.536768:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787384516.536797:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1787384516.536803:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203340800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384516.536846:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203340800:12345-0@lo:400:kworker.0 Request processed in 43us (1554us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384516.536852:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1787384516.536871:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384516.536891:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203341440:0@lo:400:kworker.0 00000100:00100000:0.0:1787384516.536913:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384516.536936:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874208203340544:0@lo:400:kworker.0 00000100:00100000:0.0:1787384516.536953:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203340416:0@lo:400:kworker.0 00000100:00100000:0.0:1787384516.536975:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203341440 00000100:00100000:0.0:1787384516.536978:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203341440 00000100:00100000:0.0:1787384516.537000:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787384516.537013:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203341440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384516.537046:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203341440:12345-0@lo:400:kworker.0 Request processed in 33us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384516.537052:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787384516.537070:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203340928 00000100:00100000:0.0:1787384516.537073:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203340928 00000100:00100000:0.0:1787384516.537091:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1787384516.537096:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874208203340928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384516.537135:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874208203340928:12345-0@lo:400:kworker.0 Request processed in 38us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384516.537141:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00010000:00080000:0.0:1787384516.537166:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8cb125f80 x1874208203340928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384516.537175:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874208203340928:0@lo:400:kworker.0 00010000:00080000:0.0:1787384516.537185:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8cb127480 x1874208203341440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384516.537193:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203341440:0@lo:400:kworker.0 00000100:00100000:0.0:1787384516.537217:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203340288:0@lo:400:kworker.0 00000100:00100000:0.0:1787384516.537228:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203340800:0@lo:400:kworker.0 00010000:00080000:0.0:1787384516.537237:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8cb124000 x1874208203341184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384516.537245:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874208203341184:0@lo:400:kworker.0 00000100:00100000:3.0:1787384516.538073:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874208203341056:12345-0@lo:400:kworker.0 Request processed in 2523us (2884us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384516.538082:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00080000:3.0:1787384516.538371:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787384516.538377:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787384516.538380:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384516.541216:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb124380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874208203341056:0@lo:400:kworker.0 00000100:00100000:1.0:1787384516.541715:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203341312:12345-0@lo:400:kworker.0 Request processed in 5756us (6381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384516.541728:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:3.0:1787384516.544073:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8cb125180 x1874208203341312/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384516.544091:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203341312:0@lo:400:kworker.0 00000100:00100000:3.0:1787384517.048811:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203341696:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787384517.048893:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384517.049254:0:13608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203341696 00000100:00100000:1.0:1787384517.049263:0:13608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203341696 00000100:00100000:1.0:1787384517.049308:0:13608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787384517.049326:0:13608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203341696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787384517.049348:0:13608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787384517.061049:0:13608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203341696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 11713us (12145us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384517.061064:0:13608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00010000:00080000:2.0:1787384517.066190:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7dbd880 x1874208203341696/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384533 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384517.066221:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203341696:0@lo:13:osp-pre-1-1.0 00000040:00080000:0.0:1787384517.175980:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787384517.186331:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787384517.475629:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384517.475744:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384517.475950:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384517.475991:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384517.476041:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182272768 00000100:00100000:0.0:1787384517.476050:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182272768 00000100:00100000:0.0:1787384517.476096:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 379 00000100:00100000:0.0:1787384517.476116:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d25f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+13:2414:x1874208182272768:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384517.476178:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d25f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+13:2414:x1874208182272768:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 64us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384517.476185:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 379 00000100:00100000:2.0:1787384517.476603:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384517.478188:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182272896 00000100:00100000:3.0:1787384517.478202:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182272896 00000100:00100000:3.0:1787384517.478281:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182273152 00000100:00100000:3.0:1787384517.478286:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182273152 00000100:00100000:3.0:1787384517.478305:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182273024 00000100:00100000:3.0:1787384517.478308:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182273024 00000100:00100000:3.0:1787384517.478329:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 293 00000100:00100000:3.0:1787384517.478338:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+9:2414:x1874208182272896:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384517.478418:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+9:2414:x1874208182272896:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 81us (2800us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384517.478426:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 293 00000100:00100000:3.0:1787384517.478445:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 294 00000100:00100000:3.0:1787384517.478874:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182273152:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384517.478910:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182273152:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 444us (3167us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384517.478917:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 294 00000100:00100000:3.0:1787384517.478934:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 295 00000100:00100000:3.0:1787384517.478942:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2414:x1874208182273024:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384517.478966:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2414:x1874208182273024:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 26us (2975us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384517.478972:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 295 00000100:00080000:3.0:1787384517.478995:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787384517.478999:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787384517.488575:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182273280 00000100:00100000:3.0:1787384517.488589:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182273280 00000100:00100000:3.0:1787384517.488672:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 296 00000100:00100000:3.0:1787384517.488682:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c355aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182273280:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384517.488764:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c355aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182273280:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 83us (12162us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384517.488772:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 296 00000100:00080000:2.0:1787384517.490865:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787384517.559001:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384518.194895:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384518.194990:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182273408 00000100:00100000:3.0:1787384518.194999:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182273408 00000100:00100000:3.0:1787384518.195057:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 45 00000100:00100000:3.0:1787384518.195067:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4105f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+9:11133:x1874208182273408:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:3.0:1787384518.195088:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384518.195117:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba2b03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3716 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.195193:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2b0a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.195206:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2b0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.195218:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2b0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.195352:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba2b11 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.195362:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba2b11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.195369:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba2b11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.195412:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2b0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.195419:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2b0a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.195426:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2b0a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.195431:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2090400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384518.195435:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2b0a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.195452:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2b0a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.195464:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c294fb00) 00010000:00010000:3.0:1787384518.195467:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384518.195472:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2b0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.195478:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2b0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.195492:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba2b11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.195498:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba2b11 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.195504:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba2b11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.195509:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2091400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384518.195512:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba2b11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.195518:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba2b11 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.195524:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98f7c294da00) 00010000:00010000:3.0:1787384518.195527:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384518.195529:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba2b11 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.195544:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba2b11 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.195575:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba2b03 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3716 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.195586:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c294fb00) 00010000:00010000:3.0:1787384518.195588:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384518.195592:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba2b03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3716 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.195601:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2091800, rc 0) 00000100:00100000:3.0:1787384518.195657:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4105f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+9:11133:x1874208182273408:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 591us (772us total) trans 0 rc 301/301 00000100:00100000:3.0:1787384518.195664:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 45 00000100:00100000:3.0:1787384518.201250:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384518.201492:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182273664 00000100:00100000:1.0:1787384518.201502:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182273664 00000100:00100000:1.0:1787384518.201559:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 46 00000100:00100000:1.0:1787384518.201568:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+9:11133:x1874208182273664:12345-192.168.203.45@tcp:36:lfs.0 00010000:00010000:1.0:1787384518.201621:0:8195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384518.201647:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090200/0x7ef423838fba2abd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3701 expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.201663:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c294fb00) 00010000:00010000:1.0:1787384518.201674:0:8195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787384518.201731:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952200/0x7ef423838fba2b18 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.201744:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952200/0x7ef423838fba2b18 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.201754:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952200/0x7ef423838fba2b18 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.201766:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953a00/0x7ef423838fba2b1f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.201772:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953a00/0x7ef423838fba2b1f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.201807:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953a00/0x7ef423838fba2b1f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.202499:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953e00/0x7ef423838fba2b26 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.202513:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953e00/0x7ef423838fba2b26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.202520:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953e00/0x7ef423838fba2b26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787384518.202536:0:8195:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000055ec64cc reply state 0000000020450933 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953e00/0x7ef423838fba2b26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.202547:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953e00/0x7ef423838fba2b26 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.202553:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f8fd1ea700) 00010000:00010000:1.0:1787384518.202556:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787384518.202560:0:8195:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787384518.202565:0:8195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1787384518.202573:0:8195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952200/0x7ef423838fba2b18 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.202579:0:8195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952200/0x7ef423838fba2b18 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.202586:0:8195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952200/0x7ef423838fba2b18 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.202591:0:8195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3952200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384518.202603:0:8195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952200/0x7ef423838fba2b18 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.202610:0:8195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952200/0x7ef423838fba2b18 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.202620:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f8fd1eaf00) 00010000:00010000:1.0:1787384518.202623:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384518.202626:0:8195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952200/0x7ef423838fba2b18 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.202632:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952200/0x7ef423838fba2b18 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787384518.202648:0:8195:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000055ec64cc reply state 0000000020450933 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953a00/0x7ef423838fba2b1f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.202656:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953a00/0x7ef423838fba2b1f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.202675:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98f8fd1ea000) 00010000:00010000:1.0:1787384518.202677:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787384518.202679:0:8195:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1787384518.202802:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+10:11133:x1874208182273664:12345-192.168.203.45@tcp:36:lfs.0 Request processed in 1212us (1539us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1787384518.202811:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 46 00000100:00100000:1.0:1787384518.353115:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384518.353241:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182273792 00000100:00100000:3.0:1787384518.353251:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182273792 00000100:00100000:3.0:1787384518.353313:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 47 00000100:00100000:3.0:1787384518.353324:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4032d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+10:11142:x1874208182273792:12345-192.168.203.45@tcp:101:lctl.0 00010000:00010000:3.0:1787384518.353348:0:14031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384518.353371:0:14031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba2b2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce371d expref: -99 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.353432:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba2b34 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.353462:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba2b34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.353472:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba2b34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384518.353530:0:14031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787384518.353533:0:14031:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787384518.353569:0:14031:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba2b34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.353599:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba2b2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce371d expref: 12 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.353616:0:14031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba2b34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce371d expref: 11 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.353624:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c294da00) 00010000:00010000:3.0:1787384518.353627:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787384518.353631:0:14031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2091400, rc 0) 00000100:00100000:3.0:1787384518.353685:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4032d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+11:11142:x1874208182273792:12345-192.168.203.45@tcp:101:lctl.0 Request processed in 363us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384518.353692:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 47 00000100:00100000:1.0:1787384518.450411:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384518.450524:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182273920 00000100:00100000:3.0:1787384518.450533:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182273920 00000100:00100000:3.0:1787384518.450591:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 48 00000100:00100000:3.0:1787384518.450599:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+11:11148:x1874208182273920:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:3.0:1787384518.450618:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384518.450643:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba2b3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3724 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.450704:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2b42 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.450718:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2b42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.450728:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2b42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.450738:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba2b49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.450746:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba2b49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.450753:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba2b49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.451025:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090200/0x7ef423838fba2b50 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.451035:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090200/0x7ef423838fba2b50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.451042:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090200/0x7ef423838fba2b50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384518.451209:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1787384518.451214:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787384518.451253:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090200/0x7ef423838fba2b50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.451275:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2b42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.451281:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2b42 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.451288:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2b42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.451293:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2090400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384518.451297:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2b42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.451303:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2b42 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.451316:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c294da00) 00010000:00010000:3.0:1787384518.451319:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384518.451323:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2b42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.451328:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2b42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.451341:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba2b49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.451346:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba2b49 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.451351:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba2b49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.451361:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2090c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384518.451364:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba2b49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.451371:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba2b49 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.451379:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98f8fd1ea000) 00010000:00010000:3.0:1787384518.451381:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384518.451383:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba2b49 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.451388:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba2b49 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.451418:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba2b3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3724 expref: 13 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.451432:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090200/0x7ef423838fba2b50 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3724 expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.451439:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f8fd1ea700) 00010000:00010000:3.0:1787384518.451442:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787384518.451444:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2090200, rc 0) 00000100:00100000:3.0:1787384518.451550:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+12:11148:x1874208182273920:12345-192.168.203.45@tcp:101:bash.0 Request processed in 951us (1148us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384518.451559:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 48 00000100:00100000:3.0:1787384518.461150:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384518.462331:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182274176 00000100:00100000:0.0:1787384518.462343:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182274176 00000100:00100000:0.0:1787384518.462417:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 49 00000100:00100000:0.0:1787384518.462428:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+12:11148:x1874208182274176:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:0.0:1787384518.462449:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384518.462468:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05e00/0x7ef423838fba2b57 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce372b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.462577:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05000/0x7ef423838fba2b5e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.462590:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05000/0x7ef423838fba2b5e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.462601:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05000/0x7ef423838fba2b5e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.462657:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba2b65 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.462665:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba2b65 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.462682:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba2b65 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787384518.463439:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:0.0:1787384518.463628:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba2b6c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.463640:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba2b6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.463648:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba2b6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.463684:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05000/0x7ef423838fba2b5e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.463692:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05000/0x7ef423838fba2b5e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.463700:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05000/0x7ef423838fba2b5e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.463706:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b05000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384518.463710:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05000/0x7ef423838fba2b5e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.463717:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05000/0x7ef423838fba2b5e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.463729:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f8fd1ea700) 00010000:00010000:0.0:1787384518.463732:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384518.463744:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05000/0x7ef423838fba2b5e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.463750:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05000/0x7ef423838fba2b5e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787384518.463764:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d9e5907d reply state 000000000f581820 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba2b65 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.463775:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba2b65 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.465265:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f7c3a9c600) 00010000:00010000:0.0:1787384518.465268:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787384518.465272:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787384518.465326:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05e00/0x7ef423838fba2b57 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce372b expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.465347:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba2b6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce372b expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.465355:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9c500) 00010000:00010000:0.0:1787384518.465358:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787384518.465360:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6141200, rc 0) 00000100:00100000:0.0:1787384518.465548:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+15:11148:x1874208182274176:12345-192.168.203.45@tcp:101:bash.0 Request processed in 3120us (4406us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1787384518.465558:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 49 00000100:00100000:0.0:1787384518.473616:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384518.473836:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182274304 00000100:00100000:2.0:1787384518.473846:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182274304 00000100:00100000:2.0:1787384518.473890:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 28 00000100:00100000:2.0:1787384518.473899:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2412:x1874208182274304:12345-192.168.203.45@tcp:8:bash.0 00010000:00080000:2.0:1787384518.473934:0:8436:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 55e96ad5-fd9d-44d4-856e-5db0c40b1329@192.168.203.45@tcp t0 exp 0000000000000000 cur 413 last 0 00000020:00000080:2.0:1787384518.473964:0:8436:0:(genops.c:1406:class_connect()) connect: client 55e96ad5-fd9d-44d4-856e-5db0c40b1329, cookie 0x7ef423838fba2b7a 00002000:00100000:2.0:1787384518.473976:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 55e96ad5-fd9d-44d4-856e-5db0c40b1329/ffff98f7c2a45000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113671 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787384518.473992:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type b7, return b7 00002000:00080000:2.0:1787384518.474654:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787384518.474686:0:8436:0:(import.c:65:import_set_state_nolock()) ffff98f7c2a46000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787384518.474755:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2412:x1874208182274304:12345-192.168.203.45@tcp:8:bash.0 Request processed in 854us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384518.474764:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 28 00000100:00100000:2.0:1787384518.478534:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384518.478627:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182274432 00000100:00100000:0.0:1787384518.478637:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182274432 00000100:00100000:0.0:1787384518.478721:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 29 00000100:00100000:0.0:1787384518.478731:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:0:x1874208182274432:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:0.0:1787384518.478747:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384518.478770:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037b223cf/0x7ef423838fba2b81 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3732 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787384518.478839:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384518.478860:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=413s v=(0 0) 00010000:00010000:0.0:1787384518.478865:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384518.478874:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037b223cf/0x7ef423838fba2b81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3732 expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.478894:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000037b223cf/0x7ef423838fba2b81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3732 expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.478907:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6140600, rc 0) 00000100:00100000:0.0:1787384518.478964:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:0:x1874208182274432:12345-192.168.203.45@tcp:101:bash.0 Request processed in 235us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384518.478970:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 29 00000100:00080000:2.0:1787384518.480185:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787384518.490056:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384518.490188:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182274560 00000100:00100000:0.0:1787384518.490201:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182274560 00000100:00100000:0.0:1787384518.490317:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 30 00000100:00100000:0.0:1787384518.490328:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:11148:x1874208182274560:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:0.0:1787384518.490346:0:8890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384518.490366:0:8890:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000678a5ba/0x7ef423838fba2b88 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3739 expref: -99 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.490418:0:8890:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000037b223cf/0x7ef423838fba2b81 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3732 expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.490428:0:8890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384518.490432:0:8890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384518.490438:0:8890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000678a5ba/0x7ef423838fba2b88 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3739 expref: 8 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.490474:0:8890:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000037b223cf/0x7ef423838fba2b81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3732 expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.490488:0:8890:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000037b223cf/0x7ef423838fba2b81 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3732 expref: 8 pid: 8435 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384518.490504:0:8890:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7dbd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8890:1874208203341824:192.168.203.45@tcp:104: 00000100:00100000:0.0:1787384518.490607:0:8890:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7240180 going to sleep for 11 seconds 00000100:00100000:0.0:1787384518.495509:0:8890:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7dbd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8890:1874208203341824:192.168.203.45@tcp:104: 00010000:00010000:0.0:1787384518.495552:0:8890:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000678a5ba/0x7ef423838fba2b88 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3739 expref: 8 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.495572:0:8890:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6140400, rc 0) 00000100:00100000:0.0:1787384518.495628:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+8:11148:x1874208182274560:12345-192.168.203.45@tcp:101:bash.0 Request processed in 5302us (5582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384518.495755:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 30 00000100:00100000:3.0:1787384518.497856:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384518.499973:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182274688 00000100:00100000:2.0:1787384518.499995:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182274688 00010000:00010000:2.0:1787384518.500061:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000037b223cf/0x7ef423838fba2b81 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3732 expref: 8 pid: 8435 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384518.500409:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 52 00000100:00100000:2.0:1787384518.500428:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b44850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+8:2415:x1874208182274688:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384518.500445:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384518.500494:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000037b223cf/0x7ef423838fba2b81 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3732 expref: 8 pid: 8435 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384518.500510:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000037b223cf/0x7ef423838fba2b81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3732 expref: 8 pid: 8435 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384518.500550:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037b223cf/0x7ef423838fba2b81 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3732 expref: 8 pid: 8435 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384518.500569:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384518.500574:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384518.500589:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000678a5ba/0x7ef423838fba2b88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3739 expref: 7 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384518.500599:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000678a5ba/0x7ef423838fba2b88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3739 expref: 7 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384518.500647:0:6508:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000678a5ba/0x7ef423838fba2b88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3739 expref: 7 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384518.500676:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91da680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6508:1874208203341952:192.168.203.45@tcp:105: 00000100:00100000:2.0:1787384518.500846:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fc1d8780 going to sleep for 11 seconds 00000100:00100000:2.0:1787384518.509129:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91da680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6508:1874208203341952:192.168.203.45@tcp:105: 00010000:00010000:2.0:1787384518.509155:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384518.509215:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b44850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:2415:x1874208182274688:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 8795us (11365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384518.509252:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 52 00000100:00100000:3.0:1787384518.518841:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384518.519036:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182274944 00000100:00100000:0.0:1787384518.519049:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182274944 00000100:00100000:0.0:1787384518.519118:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 6 00000100:00100000:0.0:1787384518.519128:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+15:11148:x1874208182274944:12345-192.168.203.45@tcp:35:bash.0 00000100:00100000:0.0:1787384518.519586:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+16:11148:x1874208182274944:12345-192.168.203.45@tcp:35:bash.0 Request processed in 459us (753us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787384518.519596:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 6 00000100:00100000:2.0:1787384518.583317:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203342080:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787384518.583393:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384518.583493:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203342080 00000100:00100000:2.0:1787384518.583502:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203342080 00000100:00100000:2.0:1787384518.583547:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787384518.583555:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203342080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787384518.583592:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787384518.583651:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203342080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384518.583659:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787384518.583931:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203342080:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787384518.584341:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384518.632682:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384518.632761:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182275200 00000100:00100000:0.0:1787384518.632771:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182275200 00000100:00100000:0.0:1787384518.632864:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 50 00000100:00100000:0.0:1787384518.632874:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+16:11159:x1874208182275200:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:0.0:1787384518.632898:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384518.632917:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2b8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3740 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384518.633011:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1787384518.633131:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2b8f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3740 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.633146:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c294da00) 00010000:00010000:0.0:1787384518.633149:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787384518.633153:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2b8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3740 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.633166:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6140000, rc 0) 00000100:00100000:0.0:1787384518.633234:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+17:11159:x1874208182275200:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 362us (562us total) trans 4294967315 rc 301/301 00000100:00100000:0.0:1787384518.633256:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 50 00000100:00100000:1.0:1787384518.638460:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384518.640222:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182275456 00000100:00100000:0.0:1787384518.640236:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182275456 00000100:00100000:0.0:1787384518.640299:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 7 00000100:00100000:0.0:1787384518.640309:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+17:11159:x1874208182275456:12345-192.168.203.45@tcp:35:lfs.0 00000100:00100000:0.0:1787384518.640523:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+18:11159:x1874208182275456:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 215us (2073us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1787384518.640530:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 7 00000100:00100000:3.0:1787384518.746159:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384518.746465:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182275584 00000100:00100000:0.0:1787384518.746474:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182275584 00000100:00100000:0.0:1787384518.746539:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 51 00000100:00100000:0.0:1787384518.746550:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+18:11165:x1874208182275584:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:0.0:1787384518.746574:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384518.746594:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2b9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3747 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.746672:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba2ba4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.746686:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba2ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.746697:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba2ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384518.746739:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787384518.746743:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787384518.746775:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba2ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.746841:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2b9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3747 expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.746858:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba2ba4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3747 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.746866:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f8fd1ea700) 00010000:00010000:0.0:1787384518.746869:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787384518.746873:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6141800, rc 0) 00000100:00100000:0.0:1787384518.746935:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+19:11165:x1874208182275584:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 387us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384518.746942:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 51 00000100:00100000:1.0:1787384518.773219:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384518.773458:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182275840 00000100:00100000:3.0:1787384518.773469:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182275840 00000100:00100000:3.0:1787384518.773554:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 52 00000100:00100000:3.0:1787384518.773567:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+19:11165:x1874208182275840:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:3.0:1787384518.773591:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384518.773613:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba2bab lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce374e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.773731:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba2bb2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.773745:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba2bb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.773760:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba2bb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384518.773771:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787384518.773912:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba2bab lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce374e expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.773931:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba2bb2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce374e expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.773940:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9c500) 00010000:00010000:3.0:1787384518.773957:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787384518.773963:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2091800, rc 0) 00000100:00100000:3.0:1787384518.774181:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+21:11165:x1874208182275840:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 617us (971us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1787384518.774189:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 52 00000100:00100000:1.0:1787384518.782764:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384518.785581:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182276096 00000100:00100000:3.0:1787384518.785597:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182276096 00000100:00100000:2.0:1787384518.786163:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 3 00000100:00100000:2.0:1787384518.786176:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+21:2415:x1874208182276096:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384518.786192:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384518.786216:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba2bb2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce374e expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384518.786238:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9c500) 00010000:00010000:2.0:1787384518.786243:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384518.786316:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+20:2415:x1874208182276096:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 142us (3561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384518.786325:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 3 00000100:00100000:0.0:1787384518.791384:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384518.791939:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182276224 00000100:00100000:3.0:1787384518.791951:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182276224 00000100:00100000:3.0:1787384518.792018:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 53 00000100:00100000:3.0:1787384518.792028:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+20:11165:x1874208182276224:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:3.0:1787384518.792053:0:8195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384518.792073:0:8195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba2bc0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3755 expref: -99 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.792182:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2bc7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.792196:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2bc7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.792206:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2bc7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384518.792232:0:8195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787384518.792331:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba2bc0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3755 expref: 23 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.792348:0:8195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2bc7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3755 expref: 22 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384518.792376:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9c500) 00010000:00010000:3.0:1787384518.792380:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787384518.792384:0:8195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2090400, rc 0) 00000100:00100000:3.0:1787384518.792506:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+22:11165:x1874208182276224:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 478us (1130us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1787384518.792514:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 53 00000100:00100000:1.0:1787384518.825029:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384518.825825:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182276352 00000100:00100000:0.0:1787384518.825836:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182276352 00000100:00100000:0.0:1787384518.825892:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 31 00000100:00100000:0.0:1787384518.825902:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:2415:x1874208182276352:12345-192.168.203.45@tcp:1:lfs.0 00010000:00010000:0.0:1787384518.825944:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b722f718/0x7ef423838fba2bd5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.825965:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000678a5ba/0x7ef423838fba2b88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3739 expref: 7 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.825973:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384518.825978:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787384518.825996:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b722f718/0x7ef423838fba2bd5 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.826047:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000678a5ba/0x7ef423838fba2b88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3739 expref: 7 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.826061:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000678a5ba/0x7ef423838fba2b88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3739 expref: 7 pid: 8890 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384518.826076:0:8435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9145c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874208203342208:192.168.203.45@tcp:104: 00000100:00100000:0.0:1787384518.826191:0:8435:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c72403c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384518.837320:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384518.837415:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182276480 00000100:00100000:2.0:1787384518.837439:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182276480 00002000:00100000:2.0:1787384518.837493:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff98f8d9b54380 x1874208182276480/t0(0) o4->55e96ad5-fd9d-44d4-856e-5db0c40b1329@192.168.203.45@tcp:549/0 lens 504/0 e 0 to 0 dl 1787384529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787384518.837505:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98f8d9b54380 with x1874208182276480 ext(0->12) 00010000:00010000:2.0:1787384518.837515:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000678a5ba/0x7ef423838fba2b88 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3739 expref: 8 pid: 8890 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384518.837536:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000678a5ba/0x7ef423838fba2b88 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3739 expref: 8 pid: 8890 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787384518.837544:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98f8d9b54380 00000100:00100000:2.0:1787384518.837594:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 0 00000100:00100000:2.0:1787384518.837604:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+8:2416:x1874208182276480:12345-192.168.203.45@tcp:4:lfs.0 00000100:00100000:0.0:1787384518.839299:0:8435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9145c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874208203342208:192.168.203.45@tcp:104: 00010000:00010000:0.0:1787384518.839332:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b722f718/0x7ef423838fba2bd5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1787384518.843604:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 55e96ad5-fd9d-44d4-856e-5db0c40b1329 00000100:00100000:2.0:1787384518.845156:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+9:2416:x1874208182276480:12345-192.168.203.45@tcp:4:lfs.0 Request processed in 7407us (7701us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787384518.845172:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 0 00002000:00100000:2.0:1787384518.845185:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff98f8d9b54380 x1874208182276480/t4294967300(0) o4->55e96ad5-fd9d-44d4-856e-5db0c40b1329@192.168.203.45@tcp:549/0 lens 504/448 e 0 to 0 dl 1787384529 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787384518.845197:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98f8d9b54380 with x1874208182276480 ext(0->12) 00010000:00010000:2.0:1787384518.845207:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000678a5ba/0x7ef423838fba2b88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3739 expref: 9 pid: 8890 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384518.845234:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000678a5ba/0x7ef423838fba2b88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3739 expref: 9 pid: 8890 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787384518.845260:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98f8d9b54380 00000100:00100000:3.0:1787384518.851983:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384518.852817:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182276608 00000100:00100000:1.0:1787384518.852827:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182276608 00010000:00010000:1.0:1787384518.852869:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000678a5ba/0x7ef423838fba2b88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3739 expref: 9 pid: 8890 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384518.852918:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 53 00000100:00100000:1.0:1787384518.852928:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb127b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+9:2413:x1874208182276608:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384518.852943:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787384518.852963:0:6509:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787384518.852966:0:6509:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1787384517 00002000:00010000:1.0:1787384518.852968:0:6509:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1787384518 00002000:00010000:1.0:1787384518.852971:0:6509:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1787384517 00002000:00010000:1.0:1787384518.852973:0:6509:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1787384518.852979:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000678a5ba/0x7ef423838fba2b88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3739 expref: 9 pid: 8890 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.852993:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000678a5ba/0x7ef423838fba2b88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3739 expref: 9 pid: 8890 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.853019:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000678a5ba/0x7ef423838fba2b88 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3739 expref: 9 pid: 8890 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.853036:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787384518.853054:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787384518.853059:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b722f718/0x7ef423838fba2bd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.853069:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b722f718/0x7ef423838fba2bd5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.853119:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384518.853178:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb127b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+8:2413:x1874208182276608:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 251us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384518.853186:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 53 00010000:00010000:2.0:1787384518.854013:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b722f718/0x7ef423838fba2bd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384518.854026:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b722f718/0x7ef423838fba2bd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384518.854049:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b722f718/0x7ef423838fba2bd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384518.854059:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b722f718/0x7ef423838fba2bd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384518.854067:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b722f718/0x7ef423838fba2bd5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384518.854073:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140200 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:2.0:1787384518.854078:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b722f718/0x7ef423838fba2bd5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384518.854087:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b722f718/0x7ef423838fba2bd5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384518.854115:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b722f718/0x7ef423838fba2bd5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384518.854139:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b722f718/0x7ef423838fba2bd5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384518.854209:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:2415:x1874208182276352:12345-192.168.203.45@tcp:1:lfs.0 Request processed in 28306us (29192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384518.854226:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 31 00000100:00100000:3.0:1787384518.857128:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384518.857222:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182276864 00000100:00100000:1.0:1787384518.857232:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182276864 00000100:00100000:1.0:1787384518.857292:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 8 00000100:00100000:1.0:1787384518.857303:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+22:11165:x1874208182276864:12345-192.168.203.45@tcp:35:lfs.0 00000004:00010000:1.0:1787384518.857367:0:6524:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2bc7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3755 expref: 22 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787384518.857663:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:1.0:1787384518.857711:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1787384518.858355:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:1.0:1787384518.858585:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba2bdc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.858608:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba2b6c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce372b expref: 26 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.858618:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba2bdc lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.858963:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba2b6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce372b expref: 26 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.858983:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba2b6c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce372b expref: 26 pid: 6522 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384518.859003:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9b57480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1874208203342336:192.168.203.45@tcp:104: 00000100:00100000:1.0:1787384518.859253:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d82c9480 going to sleep for 11 seconds 00000100:00100000:0.0:1787384518.862949:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9b57480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1874208203342336:192.168.203.45@tcp:104: 00000100:00100000:3.0:1787384518.863258:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384518.863324:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182276992 00000100:00100000:2.0:1787384518.863331:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182276992 00010000:00010000:2.0:1787384518.863375:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba2b6c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce372b expref: 27 pid: 6522 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384518.863432:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 54 00000100:00100000:2.0:1787384518.863442:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb127480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+27:2416:x1874208182276992:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384518.863456:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384518.863467:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba2b6c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce372b expref: 27 pid: 6522 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384518.863484:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba2b6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce372b expref: 27 pid: 6522 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384518.863512:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba2b6c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce372b expref: 27 pid: 6522 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384518.863532:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9c500) 00010000:00010000:2.0:1787384518.863537:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba2bdc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384518.863565:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba2bdc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384518.863576:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba2bdc lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384518.863598:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384518.863882:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb127480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+26:2416:x1874208182276992:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 440us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384518.863893:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 54 00010000:00010000:0.0:1787384518.864524:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba2bdc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.864537:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba2bdc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.864543:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba2bdc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787384518.864670:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:0.0:1787384518.864813:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:0.0:1787384518.864912:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9145c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1874208203342464:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787384518.864972:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384518.865754:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7240180 going to sleep for 11 seconds 00000100:00100000:3.0:1787384518.868278:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203342464 00000100:00100000:3.0:1787384518.868292:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203342464 00000100:00100000:3.0:1787384518.868458:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787384518.868469:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9146d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6524:x1874208203342464:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787384518.868618:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9146d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6524:x1874208203342464:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 152us (3645us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384518.868626:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787384518.868711:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9145c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1874208203342464:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787384518.869882:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:1.0:1787384518.869974:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9b54700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1874208203342592:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787384518.870577:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787384518.871121:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787384518.877415:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c41cbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787384518.879321:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203342592 00000100:00100000:0.0:1787384518.879335:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203342592 00000100:00100000:0.0:1787384518.879392:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787384518.880280:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6524:x1874208203342592:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787384518.880576:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6524:x1874208203342592:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 372us (9999us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787384518.880584:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787384518.880693:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9b54700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1874208203342592:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787384518.880806:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:1.0:1787384518.880856:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba2bdc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.880868:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba2bdc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.880875:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba2bdc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.880881:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3952000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384518.880886:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba2bdc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.880907:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba2bdc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.880923:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9c500) 00010000:00010000:1.0:1787384518.880926:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787384518.880930:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba2bdc lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.880937:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba2bdc lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787384518.881039:0:6524:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787384518.881115:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1787384518.881126:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 413961346393ns, next at 414961344567ns, rc = 0 00000001:00080000:1.0:1787384518.881132:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:1.0:1787384518.881154:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9c500) 00010000:00010000:1.0:1787384518.881156:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787384518.881162:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2bc7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3755 expref: 30 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384518.881734:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+29:11165:x1874208182276864:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 24430us (24612us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1787384518.882367:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 8 00000020:00080000:1.0:1787384518.882375:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787384518.885498:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384518.885642:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182277120 00000100:00100000:0.0:1787384518.885653:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182277120 00000100:00100000:0.0:1787384518.885727:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 54 00000100:00100000:0.0:1787384518.885738:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+29:11165:x1874208182277120:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:0.0:1787384518.885774:0:14031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384518.885831:0:14031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141000/0x7ef423838fba2be3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce375c expref: -99 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.885890:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141000/0x7ef423838fba2be3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce375c expref: 30 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.885906:0:14031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141000/0x7ef423838fba2be3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce375c expref: 30 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384518.885923:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9cc00) 00010000:00010000:0.0:1787384518.885926:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787384518.885929:0:14031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6141000, rc 0) 00000100:00100000:0.0:1787384518.886003:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+30:11165:x1874208182277120:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 267us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384518.886010:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 54 00000100:00100000:0.0:1787384518.890193:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384518.890276:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182277376 00000100:00100000:3.0:1787384518.890286:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182277376 00000100:00100000:3.0:1787384518.890343:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 9 00000100:00100000:3.0:1787384518.890354:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9504450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+30:11165:x1874208182277376:12345-192.168.203.45@tcp:35:lfs.0 00000100:00100000:3.0:1787384518.890688:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9504450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+31:11165:x1874208182277376:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 336us (504us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1787384518.890697:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 9 00000100:00100000:2.0:1787384519.014879:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384519.015213:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182277632 00000100:00100000:3.0:1787384519.015224:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182277632 00000100:00100000:3.0:1787384519.015297:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 55 00000100:00100000:3.0:1787384519.015309:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+31:11175:x1874208182277632:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:3.0:1787384519.015333:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384519.015355:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba2bea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3763 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384519.015459:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1787384519.015553:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba2bea lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3763 expref: 33 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.015567:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c294da00) 00010000:00010000:3.0:1787384519.015570:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787384519.015575:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba2bea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3763 expref: 33 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.015588:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2090c00, rc 0) 00000100:00100000:3.0:1787384519.015650:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+32:11175:x1874208182277632:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 344us (780us total) trans 4294967329 rc 301/301 00000100:00100000:3.0:1787384519.015666:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 55 00000100:00080000:2.0:1787384519.015727:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787384519.020540:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384519.020616:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182277760 00000100:00100000:3.0:1787384519.020627:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182277760 00000100:00100000:3.0:1787384519.020686:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 56 00000100:00100000:3.0:1787384519.020696:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9145880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+32:11175:x1874208182277760:12345-192.168.203.45@tcp:34:lfs.0 00010000:00010000:3.0:1787384519.020813:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2bf8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.020848:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2bf8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.020863:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2bf8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.020877:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba2bff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.020884:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba2bff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.020890:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba2bff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.020974:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba2c06 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.020982:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba2c06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.020989:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba2c06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787384519.021044:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba2c06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.021056:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2bf8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.021062:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2bf8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.021078:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2bf8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.021084:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2090400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384519.021088:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2bf8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.021104:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2bf8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.021116:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f8fd1ea700) 00010000:00010000:3.0:1787384519.021119:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384519.021123:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2bf8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.021129:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2bf8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.021142:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba2bff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.021148:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba2bff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.021154:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba2bff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.021159:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2090c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384519.021162:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba2bff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.021178:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba2bff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.021186:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f7c3a9c600) 00010000:00010000:3.0:1787384519.021188:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384519.021191:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba2bff lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.021196:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba2bff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.021204:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba2c06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.021210:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba2c06 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.021215:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba2c06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.021219:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2091800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384519.021221:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba2c06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.021226:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba2c06 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.021233:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9cc00) 00010000:00010000:3.0:1787384519.021235:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384519.021238:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba2c06 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.021251:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba2c06 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384519.021328:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9145880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+32:11175:x1874208182277760:12345-192.168.203.45@tcp:34:lfs.0 Request processed in 632us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384519.021337:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 56 00000100:00100000:0.0:1787384519.027297:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384519.027610:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182278016 00000100:00100000:1.0:1787384519.027622:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182278016 00000100:00100000:1.0:1787384519.028055:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 10 00000100:00100000:1.0:1787384519.028067:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9144380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+32:11175:x1874208182278016:12345-192.168.203.45@tcp:35:lfs.0 00000100:00100000:1.0:1787384519.028357:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9144380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+33:11175:x1874208182278016:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 289us (1066us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1787384519.028366:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 10 00000100:00100000:0.0:1787384519.097404:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203342720:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787384519.097506:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384519.098134:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203342720 00000100:00100000:1.0:1787384519.098143:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203342720 00000100:00100000:1.0:1787384519.098243:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787384519.098266:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9147480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203342720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787384519.098322:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:1.0:1787384519.098430:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9147480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203342720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 165us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384519.098437:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787384519.099080:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203342720:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787384519.101263:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384519.101355:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182278272 00000100:00100000:1.0:1787384519.101366:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182278272 00000100:00100000:1.0:1787384519.101441:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 57 00000100:00100000:1.0:1787384519.101452:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+33:11178:x1874208182278272:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:1.0:1787384519.101477:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384519.101500:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba2c0d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce376a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384519.101591:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba2c14 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384519.101614:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba2c14 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384519.101624:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba2c14 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384519.101654:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba2c1b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384519.101660:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba2c1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384519.101686:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba2c1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384519.103491:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba2c22 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384519.103512:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba2c22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384519.103523:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba2c22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384519.103535:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787384519.103639:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba2c14 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384519.103647:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba2c14 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384519.103652:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba2c14 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384519.103664:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3952400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384519.106194:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba2c14 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384519.106238:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba2c14 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384519.106259:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f8fd1ea700) 00010000:00010000:1.0:1787384519.106262:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384519.106268:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba2c14 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384519.106275:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba2c14 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384519.106295:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba2c1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384519.106302:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba2c1b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384519.106308:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba2c1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384519.106314:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3953400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384519.106317:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba2c1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384519.106322:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba2c1b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384519.106330:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f7c3a9c600) 00010000:00010000:1.0:1787384519.106332:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384519.106335:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba2c1b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384519.106350:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba2c1b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384519.106411:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba2c0d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce376a expref: 36 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384519.106425:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba2c22 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce376a expref: 35 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384519.106432:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9cc00) 00010000:00010000:1.0:1787384519.106434:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787384519.106436:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3952c00, rc 0) 00000100:00100000:1.0:1787384519.106507:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+35:11178:x1874208182278272:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 5057us (5252us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1787384519.106516:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 57 00000100:00100000:0.0:1787384519.115523:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384519.116002:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182278400 00000100:00100000:1.0:1787384519.116075:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182278400 00000100:00100000:0.0:1787384519.116270:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 58 00000100:00100000:0.0:1787384519.116297:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9144700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+35:11178:x1874208182278400:12345-192.168.203.45@tcp:54:lfs.0 00010000:00010000:0.0:1787384519.116417:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba2c30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384519.116434:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba2c30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384519.116445:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba2c30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384519.116479:0:8195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba2c30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384519.116485:0:8195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba2c30 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384519.116491:0:8195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba2c30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384519.116512:0:8195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6141400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384519.116517:0:8195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba2c30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384519.116523:0:8195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba2c30 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384519.116537:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9cc00) 00010000:00010000:0.0:1787384519.116540:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787384519.116544:0:8195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba2c30 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384519.116549:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba2c30 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384519.116888:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9144700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+35:11178:x1874208182278400:12345-192.168.203.45@tcp:54:lfs.0 Request processed in 591us (1372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384519.116897:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 58 00000100:00100000:0.0:1787384519.123507:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384519.123811:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182278656 00000100:00100000:2.0:1787384519.123821:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182278656 00000100:00100000:2.0:1787384519.123875:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 11 00000100:00100000:2.0:1787384519.123886:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9146680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+35:11178:x1874208182278656:12345-192.168.203.45@tcp:35:lfs.0 00000100:00100000:2.0:1787384519.124289:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9146680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+36:11178:x1874208182278656:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 404us (790us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1787384519.124297:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 11 00000100:00100000:2.0:1787384519.584195:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384519.584365:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182278912 00000100:00100000:0.0:1787384519.584376:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182278912 00000100:00100000:0.0:1787384519.584438:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 59 00000100:00100000:0.0:1787384519.584447:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+36:11209:x1874208182278912:12345-192.168.203.45@tcp:101:cat.0 00010000:00010000:0.0:1787384519.584471:0:14031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384519.584490:0:14031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba2c37 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3771 expref: -99 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384519.584589:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141600/0x7ef423838fba2c3e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384519.584614:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141600/0x7ef423838fba2c3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384519.584626:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141600/0x7ef423838fba2c3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384519.584639:0:14031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787384519.584770:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba2c37 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3771 expref: 39 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384519.584840:0:14031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141600/0x7ef423838fba2c3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3771 expref: 38 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384519.584850:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9cc00) 00010000:00010000:0.0:1787384519.584853:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787384519.584856:0:14031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6141600, rc 0) 00000100:00100000:0.0:1787384519.584933:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+38:11209:x1874208182278912:12345-192.168.203.45@tcp:101:cat.0 Request processed in 487us (749us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1787384519.584941:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 59 00000100:00100000:0.0:1787384519.592313:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384519.592402:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384519.592469:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182279296 00000100:00100000:1.0:1787384519.592480:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182279296 00000100:00100000:1.0:1787384519.592548:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 12 00000100:00100000:1.0:1787384519.592561:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+38:11209:x1874208182279296:12345-192.168.203.45@tcp:35:cat.0 00000100:00100000:1.0:1787384519.592880:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+39:11209:x1874208182279296:12345-192.168.203.45@tcp:35:cat.0 Request processed in 321us (476us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1787384519.592888:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 12 00000100:00100000:2.0:1787384519.593357:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182279040 00000100:00100000:2.0:1787384519.593362:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182279040 00000100:00100000:2.0:1787384519.593410:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 4 00000100:00100000:2.0:1787384519.593419:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9145500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+39:2414:x1874208182279040:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384519.593431:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384519.593470:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141600/0x7ef423838fba2c3e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3771 expref: 39 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384519.593489:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9cc00) 00010000:00010000:2.0:1787384519.593494:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384519.593540:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9145500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+38:2414:x1874208182279040:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 122us (1238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384519.593547:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 4 00010000:00010000:2.0:1787384519.608096:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384519.705017:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384519.705211:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182279552 00000100:00100000:1.0:1787384519.705224:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182279552 00000100:00100000:1.0:1787384519.705322:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 60 00000100:00100000:1.0:1787384519.705334:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+38:11215:x1874208182279552:12345-192.168.203.45@tcp:101:dd.0 00010000:00010000:1.0:1787384519.705367:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384519.705371:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787384519.705405:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba2ba4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3747 expref: 38 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384519.705427:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f8fd1ea700) 00010000:00010000:1.0:1787384519.705433:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787384519.705449:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba2c4c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3778 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384519.705587:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba2c53 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384519.705603:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba2c22 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce376a expref: 38 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384519.705613:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba2c53 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384519.705656:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba2c22 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce376a expref: 38 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384519.705671:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba2c22 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce376a expref: 38 pid: 6523 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384519.705686:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9b55500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874208203342848:192.168.203.45@tcp:104: 00000100:00100000:1.0:1787384519.705888:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c41cbcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384519.712595:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9b55500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874208203342848:192.168.203.45@tcp:104: 00010000:00010000:1.0:1787384519.712642:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba2c53 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384519.715988:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384519.716107:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182279680 00000100:00100000:1.0:1787384519.716122:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182279680 00010000:00010000:1.0:1787384519.716182:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba2c22 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce376a expref: 39 pid: 6523 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384519.716237:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 55 00000100:00100000:1.0:1787384519.716250:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9144000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+39:2415:x1874208182279680:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384519.716278:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384519.716286:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba2c22 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce376a expref: 39 pid: 6523 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384519.716301:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba2c22 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce376a expref: 39 pid: 6523 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384519.717182:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba2c22 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce376a expref: 39 pid: 6523 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384519.717209:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9cc00) 00010000:00010000:1.0:1787384519.717215:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba2c53 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384519.717226:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba2c53 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384519.717260:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba2c53 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384519.717293:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384519.717371:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9144000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+38:2415:x1874208182279680:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 1123us (1395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384519.717381:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 55 00010000:00010000:0.0:1787384519.717870:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba2c53 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384519.717880:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba2c53 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384519.717921:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787384519.718133:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba2c4c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3778 expref: 39 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384519.718155:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba2c53 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3778 expref: 38 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384519.718163:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9cc00) 00010000:00010000:0.0:1787384519.718167:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787384519.718170:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3952400, rc 0) 00000100:00100000:0.0:1787384519.718224:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+38:11215:x1874208182279552:12345-192.168.203.45@tcp:101:dd.0 Request processed in 12893us (13222us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1787384519.718232:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 60 00000100:00100000:0.0:1787384519.724480:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384519.724730:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182279808 00000100:00100000:3.0:1787384519.724743:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182279808 00000100:00100000:3.0:1787384519.724846:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 61 00000100:00100000:3.0:1787384519.724858:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+38:11215:x1874208182279808:12345-192.168.203.45@tcp:101:dd.0 00010000:00010000:3.0:1787384519.724889:0:8195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384519.724915:0:8195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba2c61 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce377f expref: -99 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.724973:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba2c68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.724989:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba2c68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.725000:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba2c68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.725163:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba2c61 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce377f expref: 40 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.725185:0:8195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba2c68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce377f expref: 39 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.725208:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9cc00) 00010000:00010000:3.0:1787384519.725211:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787384519.725216:0:8195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2090c00, rc 0) 00000100:00100000:3.0:1787384519.725299:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+39:11215:x1874208182279808:12345-192.168.203.45@tcp:101:dd.0 Request processed in 443us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384519.725306:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 61 00000100:00100000:1.0:1787384519.728639:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384519.728847:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182280064 00000100:00100000:3.0:1787384519.728861:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182280064 00000100:00100000:3.0:1787384519.728931:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 62 00000100:00100000:3.0:1787384519.728955:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+39:11215:x1874208182280064:12345-192.168.203.45@tcp:36:dd.0 00010000:00010000:3.0:1787384519.729264:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2c6f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.729285:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2c6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.729299:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2c6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787384519.729348:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:3.0:1787384519.729372:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009ba38cb2 reply state 00000000b15efb2c transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2c6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.729387:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2c6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384519.729396:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9cc00) 00010000:00010000:3.0:1787384519.729398:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787384519.729417:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787384519.729533:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+42:11215:x1874208182280064:12345-192.168.203.45@tcp:36:dd.0 Request processed in 591us (914us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1787384519.729542:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 62 00000020:00080000:3.0:1787384519.729547:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787384520.066516:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384520.066632:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182280192 00000100:00100000:0.0:1787384520.066645:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182280192 00000100:00100000:0.0:1787384520.066726:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 63 00000100:00100000:0.0:1787384520.066738:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3559880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+42:11229:x1874208182280192:12345-192.168.203.45@tcp:101:stat.0 00010000:00010000:0.0:1787384520.066802:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384520.066829:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba2c76 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3786 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.066959:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba2c7d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.066977:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba2c7d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.067191:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba2c7d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.067217:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141600/0x7ef423838fba2c84 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.067226:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141600/0x7ef423838fba2c84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.067234:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141600/0x7ef423838fba2c84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.067328:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba2c8b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.067340:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba2c53 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3778 expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.067348:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba2c8b lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.067390:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba2c53 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3778 expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.067407:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba2c53 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3778 expref: 43 pid: 6523 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384520.067424:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9147100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874208203342976:192.168.203.45@tcp:104: 00000100:00100000:0.0:1787384520.067745:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7240b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787384520.072323:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9147100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874208203342976:192.168.203.45@tcp:104: 00010000:00010000:1.0:1787384520.072372:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba2c8b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384520.072974:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384520.073466:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182280448 00000100:00100000:1.0:1787384520.073477:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182280448 00000100:00100000:1.0:1787384520.073561:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 13 00000100:00100000:1.0:1787384520.073572:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c355b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+44:6184:x1874208182280448:12345-192.168.203.45@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787384520.074669:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c355b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+45:6184:x1874208182280448:12345-192.168.203.45@tcp:35:ldlm_bl.0 Request processed in 1081us (1681us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1787384520.074680:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 13 00000100:00100000:0.0:1787384520.077936:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384520.078288:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182280576 00000100:00100000:3.0:1787384520.078302:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182280576 00010000:00010000:3.0:1787384520.078356:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba2c53 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3778 expref: 45 pid: 6523 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384520.078405:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 56 00000100:00100000:3.0:1787384520.078418:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9146a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+45:2416:x1874208182280576:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384520.078437:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384520.078445:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba2c53 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3778 expref: 45 pid: 6523 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.078463:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba2c53 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3778 expref: 45 pid: 6523 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.078492:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba2c53 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3778 expref: 45 pid: 6523 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.078514:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9cc00) 00010000:00010000:3.0:1787384520.078520:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba2c8b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.078532:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba2c8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.078565:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba2c8b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.078606:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787384520.078966:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba2c8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.078977:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba2c8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384520.079133:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787384520.079139:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787384520.079204:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba2c8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384520.079415:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9146a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+44:2416:x1874208182280576:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 995us (1490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384520.079424:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 56 00010000:00010000:1.0:1787384520.079496:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba2c8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.079509:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba2c7d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.079516:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba2c7d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.079524:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba2c7d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.079530:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6141800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384520.079536:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba2c7d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.079545:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba2c7d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.079557:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f8fd1ea700) 00010000:00010000:1.0:1787384520.079561:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384520.079566:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba2c7d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.079573:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba2c7d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.079590:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141600/0x7ef423838fba2c84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.079596:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141600/0x7ef423838fba2c84 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.079608:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141600/0x7ef423838fba2c84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.079613:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6141600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384520.079616:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141600/0x7ef423838fba2c84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.079622:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141600/0x7ef423838fba2c84 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.079631:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f7c3a9c600) 00010000:00010000:1.0:1787384520.079634:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384520.079637:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141600/0x7ef423838fba2c84 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.079643:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141600/0x7ef423838fba2c84 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.079704:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba2c76 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3786 expref: 44 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.079721:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba2c8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3786 expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.079729:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9cc00) 00010000:00010000:1.0:1787384520.079731:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787384520.079734:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6140e00, rc 0) 00000100:00100000:1.0:1787384520.079820:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3559880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+43:11229:x1874208182280192:12345-192.168.203.45@tcp:101:stat.0 Request processed in 13084us (13320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384520.079838:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 63 00000100:00100000:2.0:1787384520.179238:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384520.187989:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182280832 00000100:00100000:0.0:1787384520.188012:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182280832 00000100:00100000:0.0:1787384520.188140:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 64 00000100:00100000:0.0:1787384520.188153:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+43:11235:x1874208182280832:12345-192.168.203.45@tcp:36:truncate.0 00010000:00010000:0.0:1787384520.188236:0:14031:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384520.188274:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba2c8b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3786 expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.188301:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9cc00) 00010000:00010000:0.0:1787384520.188307:0:14031:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787384520.188557:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba2c92 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.188574:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba2c92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.188585:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba2c92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787384520.188640:0:14031:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:0.0:1787384520.188664:0:14031:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002e3c1a6c reply state 000000007c13f862 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba2c92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.188678:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba2c92 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.188685:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9cc00) 00010000:00010000:0.0:1787384520.188688:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787384520.188690:0:14031:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787384520.188916:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+45:11235:x1874208182280832:12345-192.168.203.45@tcp:36:truncate.0 Request processed in 763us (9693us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1787384520.188944:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 64 00000020:00080000:0.0:1787384520.188950:0:14031:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787384520.294049:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384520.294249:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182280960 00000100:00100000:3.0:1787384520.294264:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182280960 00000100:00100000:3.0:1787384520.294356:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 65 00000100:00100000:3.0:1787384520.294370:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+45:11249:x1874208182280960:12345-192.168.203.45@tcp:101:stat.0 00010000:00010000:3.0:1787384520.294404:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384520.294434:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba2c99 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce378d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.294537:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2ca0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.294555:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2ca0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.294568:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2ca0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.294581:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2ca7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.294589:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.294617:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.294717:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba2cae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.294726:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba2cae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.294734:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba2cae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384520.294848:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1787384520.294854:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787384520.294885:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba2cae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.294900:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba2cae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.294909:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2ca0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.294916:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2ca0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.294923:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2ca0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.294931:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cd800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384520.294936:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2ca0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.294952:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2ca0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.294967:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f8fd1ea700) 00010000:00010000:3.0:1787384520.294971:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384520.294976:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2ca0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.294983:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2ca0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.295013:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.295020:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2ca7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.295026:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2ca7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.295031:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cc000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384520.295034:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2ca7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.295040:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2ca7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.295048:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f7c3a9c600) 00010000:00010000:3.0:1787384520.295051:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384520.295054:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2ca7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.295071:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2ca7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.295116:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba2c99 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce378d expref: 47 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.295131:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba2cae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce378d expref: 46 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.295138:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9cc00) 00010000:00010000:3.0:1787384520.295140:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787384520.295143:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cda00, rc 0) 00000100:00100000:3.0:1787384520.295228:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+46:11249:x1874208182280960:12345-192.168.203.45@tcp:101:stat.0 Request processed in 861us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384520.295237:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 65 00000100:00100000:3.0:1787384520.407130:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384520.409401:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182281216 00000100:00100000:1.0:1787384520.409420:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182281216 00000100:00100000:1.0:1787384520.409521:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 66 00000100:00100000:1.0:1787384520.409533:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+46:11259:x1874208182281216:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:1.0:1787384520.409560:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384520.409587:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba2cb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3794 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384520.409749:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1787384520.409916:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba2cb5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3794 expref: 48 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.409933:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c294da00) 00010000:00010000:1.0:1787384520.409937:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787384520.409942:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba2cb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3794 expref: 48 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.409958:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3953000, rc 0) 00000100:00100000:1.0:1787384520.410045:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+47:11259:x1874208182281216:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 514us (2930us total) trans 4294967341 rc 301/301 00000100:00100000:1.0:1787384520.410053:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 66 00000100:00100000:2.0:1787384520.423278:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384520.423403:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182281472 00000100:00100000:1.0:1787384520.423418:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182281472 00000100:00100000:1.0:1787384520.423504:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 14 00000100:00100000:1.0:1787384520.423517:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d915a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+47:11259:x1874208182281472:12345-192.168.203.45@tcp:35:lfs.0 00000100:00100000:1.0:1787384520.423906:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d915a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+48:11259:x1874208182281472:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 390us (644us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1787384520.423916:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 14 00000100:00100000:0.0:1787384520.546926:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384520.547044:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182281728 00000100:00100000:3.0:1787384520.547060:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182281728 00000100:00100000:3.0:1787384520.547154:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 67 00000100:00100000:3.0:1787384520.547167:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+48:11265:x1874208182281728:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:3.0:1787384520.547203:0:14031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384520.547232:0:14031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2cc3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce379b expref: -99 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.547679:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2cca lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.547722:0:14031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba2cae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce378d expref: 49 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.547733:0:14031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2cca lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.548077:0:14031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba2cae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce378d expref: 49 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.548107:0:14031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba2cae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce378d expref: 49 pid: 6522 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384520.548128:0:14031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb127800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14031:1874208203343104:192.168.203.45@tcp:104: 00000100:00100000:3.0:1787384520.548372:0:14031:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2aac540 going to sleep for 11 seconds 00000100:00100000:0.0:1787384520.561075:0:14031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb127800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14031:1874208203343104:192.168.203.45@tcp:104: 00010000:00010000:0.0:1787384520.561131:0:14031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2cca lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384520.561623:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384520.562411:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182281856 00000100:00100000:1.0:1787384520.562436:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182281856 00010000:00010000:1.0:1787384520.562501:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba2cae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce378d expref: 50 pid: 6522 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384520.562553:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 57 00000100:00100000:1.0:1787384520.562563:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b45450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+50:2415:x1874208182281856:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384520.562612:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384520.562620:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba2cae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce378d expref: 50 pid: 6522 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.562633:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba2cae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce378d expref: 50 pid: 6522 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.562659:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba2cae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce378d expref: 50 pid: 6522 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.562682:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9cc00) 00010000:00010000:1.0:1787384520.562687:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2cca lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.562700:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2cca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.562709:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2cca lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.562753:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384520.562892:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b45450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+49:2415:x1874208182281856:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 329us (1271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384520.562901:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 57 00010000:00010000:0.0:1787384520.564025:0:14031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2cca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.564042:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2cca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384520.564071:0:14031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1787384520.564316:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2cc3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce379b expref: 50 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.564338:0:14031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2cca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce379b expref: 49 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.564348:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9cc00) 00010000:00010000:0.0:1787384520.564351:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787384520.564355:0:14031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cd800, rc 0) 00000100:00100000:0.0:1787384520.564428:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+49:11265:x1874208182281728:12345-192.168.203.45@tcp:101:bash.0 Request processed in 17255us (17508us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1787384520.564437:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 67 00000100:00100000:1.0:1787384520.574336:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384520.574524:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182282112 00000100:00100000:0.0:1787384520.574538:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182282112 00000100:00100000:0.0:1787384520.574647:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 68 00000100:00100000:0.0:1787384520.574659:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+49:11265:x1874208182282112:12345-192.168.203.45@tcp:36:bash.0 00010000:00010000:0.0:1787384520.575047:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba2cd8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.575075:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba2cd8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.575095:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba2cd8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787384520.575141:0:8195:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:0.0:1787384520.575163:0:8195:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e722cdca reply state 00000000ce03ad84 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba2cd8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.575176:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba2cd8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.575183:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9cc00) 00010000:00010000:0.0:1787384520.575186:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787384520.575189:0:8195:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787384520.576184:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+52:11265:x1874208182282112:12345-192.168.203.45@tcp:36:bash.0 Request processed in 1520us (1855us total) trans 4294967345 rc 0/0 00000100:00100000:0.0:1787384520.576194:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 68 00000020:00080000:0.0:1787384520.576200:0:8195:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:3.0:1787384520.580325:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967343 is committed 00000004:00080000:3.0:1787384520.580368:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1787384520.580393:0:6501:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98f8d82c9480 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1787384520.580403:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff98f7c3b20800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98f8d82c9540 00000020:00080000:3.0:1787384520.580406:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff98f7c3b20500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98f8cb3c3200 00000020:00080000:0.0:1787384520.580426:0:6553:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00010000:00010000:2.0:1787384520.580553:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953a00/0x7ef423838fba2b1f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.580566:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953a00/0x7ef423838fba2b1f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.580574:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953a00/0x7ef423838fba2b1f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.580582:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3953a00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384520.580588:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953a00/0x7ef423838fba2b1f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.580596:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953a00/0x7ef423838fba2b1f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787384520.580602:0:6553:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:2.0:1787384520.580616:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98f8fd1ea000) 00010000:00010000:2.0:1787384520.580628:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384520.580633:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953a00/0x7ef423838fba2b1f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.580640:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953a00/0x7ef423838fba2b1f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384520.580644:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787384520.580666:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9b57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203343232:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787384520.580676:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953e00/0x7ef423838fba2b26 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.580684:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953e00/0x7ef423838fba2b26 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.580690:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953e00/0x7ef423838fba2b26 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.580695:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3953e00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384520.580697:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953e00/0x7ef423838fba2b26 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.580703:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953e00/0x7ef423838fba2b26 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.580712:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f8fd1ea700) 00010000:00010000:2.0:1787384520.580715:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384520.580718:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953e00/0x7ef423838fba2b26 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.580723:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953e00/0x7ef423838fba2b26 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.580738:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba2b65 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.580754:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba2b65 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.580761:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba2b65 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.580765:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b05a00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384520.580769:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba2b65 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.580814:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba2b65 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.580827:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f7c3a9c600) 00000100:00100000:0.0:1787384520.580827:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787384520.580833:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384520.580837:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba2b65 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.580843:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba2b65 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.580861:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2c6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.580868:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2c6f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.580888:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2c6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.580893:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2090400 already unused, calling callback (ffffffffc18c74f0) 00000100:00100000:1.0:1787384520.580902:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203343232 00010000:00010000:2.0:1787384520.580903:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2c6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384520.580912:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203343232 00010000:00010000:2.0:1787384520.580913:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2c6f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.580924:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9cc00) 00010000:00010000:2.0:1787384520.580927:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384520.580930:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2c6f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.580936:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba2c6f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.580949:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba2c92 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.580955:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba2c92 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.580960:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba2c92 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384520.580975:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1787384520.580982:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6141c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384520.580986:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba2c92 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384520.580988:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3651:x1874208203343232:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787384520.581000:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba2c92 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.581009:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9cc00) 00010000:00010000:2.0:1787384520.581012:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00080000:1.0:1787384520.581017:0:8436:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00010000:00010000:2.0:1787384520.581021:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba2c92 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.581029:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba2c92 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787384520.581048:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a8952c5, atime: 0x6a8952c6, ctime: 0x6a8952c5, blocks: 0x8 00010000:00010000:1.0:1787384520.581057:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000492804b8/0x7ef423838fba2cdf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.581072:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=415s v=(0 0) 00010000:00010000:1.0:1787384520.581077:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384520.581153:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000492804b8/0x7ef423838fba2cdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.581169:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000492804b8/0x7ef423838fba2cdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.581178:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000492804b8/0x7ef423838fba2cdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.581186:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000492804b8/0x7ef423838fba2cdf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.581218:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787384520.581338:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3651:x1874208203343232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 353us (512us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787384520.581345:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000004:00080000:1.0:1787384520.581386:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98f8d9b57800/2, rc 0, transno 4294967302 00000100:00100000:1.0:1787384520.581392:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9b57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203343232:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787384520.581575:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384520.581581:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000492804b8/0x7ef423838fba2cdf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.581590:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3953000 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:2.0:1787384520.581594:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000492804b8/0x7ef423838fba2cdf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.581602:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000492804b8/0x7ef423838fba2cdf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.581615:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000492804b8/0x7ef423838fba2cdf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.581621:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000492804b8/0x7ef423838fba2cdf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.581638:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384520.581640:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384520.581641:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787384520.582035:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787384520.587511:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384520.587616:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182282240 00000100:00100000:3.0:1787384520.587629:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182282240 00000100:00100000:3.0:1787384520.587707:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 69 00000100:00100000:3.0:1787384520.587717:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d915b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+15:11265:x1874208182282240:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:3.0:1787384520.587743:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384520.587768:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba2ce6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce37a2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.587958:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba2ced lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.587978:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2cca lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce379b expref: 16 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.587988:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba2ced lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.588028:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2cca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce379b expref: 16 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.588045:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2cca lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce379b expref: 16 pid: 14031 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384520.588096:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb127b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1874208203343360:192.168.203.45@tcp:104: 00000100:00100000:1.0:1787384520.588246:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2aac540 going to sleep for 11 seconds 00000100:00100000:3.0:1787384520.591540:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384520.591725:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182282368 00000100:00100000:0.0:1787384520.591737:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182282368 00010000:00010000:0.0:1787384520.591811:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2cca lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce379b expref: 17 pid: 14031 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384520.591856:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 58 00000100:00100000:0.0:1787384520.591870:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb127480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+17:2416:x1874208182282368:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787384520.591888:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384520.591896:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2cca lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce379b expref: 17 pid: 14031 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.591913:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2cca lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce379b expref: 17 pid: 14031 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.591939:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9cc00) 00010000:00010000:0.0:1787384520.591946:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba2ced lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.591959:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba2ced lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.591967:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba2ced lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.591990:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384520.592094:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb127480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+17:2416:x1874208182282368:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 228us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384520.592124:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 58 00010000:00010000:1.0:1787384520.592451:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2cca lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce379b expref: 16 pid: 14031 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384520.592468:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb127b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1874208203343360:192.168.203.45@tcp:104: 00010000:00010000:1.0:1787384520.592488:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba2ced lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.592499:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba2ced lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.592505:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba2ced lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384520.592556:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787384520.592560:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787384520.592873:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba2ced lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.592909:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba2ce6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37a2 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.592938:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba2ced lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37a2 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.592946:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9cc00) 00010000:00010000:1.0:1787384520.592950:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787384520.592953:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cc800, rc 0) 00000100:00100000:1.0:1787384520.592989:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d915b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+15:11265:x1874208182282240:12345-192.168.203.45@tcp:101:bash.0 Request processed in 5274us (5490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384520.592996:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 69 00000100:00100000:2.0:1787384520.610940:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384520.611188:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182282624 00000100:00100000:1.0:1787384520.611207:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182282624 00000100:00100000:1.0:1787384520.611321:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 15 00000100:00100000:1.0:1787384520.611354:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9506050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+15:11265:x1874208182282624:12345-192.168.203.45@tcp:35:bash.0 00000100:00100000:1.0:1787384520.611648:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9506050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+16:11265:x1874208182282624:12345-192.168.203.45@tcp:35:bash.0 Request processed in 313us (720us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1787384520.611658:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 15 00010000:00010000:1.0:1787384520.635210:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384520.717728:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384520.718090:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182282880 00000100:00100000:0.0:1787384520.718105:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182282880 00000100:00100000:0.0:1787384520.718194:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 70 00000100:00100000:0.0:1787384520.718274:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+16:11275:x1874208182282880:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:0.0:1787384520.718310:0:14031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384520.718342:0:14031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba2cf4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce37a9 expref: -99 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384520.718491:0:14031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1787384520.718638:0:14031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba2cf4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37a9 expref: 18 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.718657:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c294da00) 00010000:00010000:0.0:1787384520.718662:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787384520.718667:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba2cf4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37a9 expref: 18 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.718685:0:14031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6141a00, rc 0) 00000100:00100000:0.0:1787384520.719133:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+17:11275:x1874208182282880:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 926us (1417us total) trans 4294967347 rc 301/301 00000100:00100000:0.0:1787384520.719143:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 70 00000100:00100000:1.0:1787384520.738369:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384520.740117:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182283008 00000100:00100000:0.0:1787384520.740143:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182283008 00000100:00100000:0.0:1787384520.740267:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 71 00000100:00100000:0.0:1787384520.740280:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+17:11275:x1874208182283008:12345-192.168.203.45@tcp:34:lfs.0 00010000:00010000:0.0:1787384520.740447:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba2d02 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.740472:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba2d02 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.740488:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba2d02 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.740507:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba2d09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.740515:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba2d09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.740523:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba2d09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.740636:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba2d10 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.740647:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba2d10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.740654:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba2d10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787384520.740729:0:8195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba2d10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.740746:0:8195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba2d02 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.740763:0:8195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba2d02 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.740771:0:8195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba2d02 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.740843:0:8195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6141a00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384520.740850:0:8195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba2d02 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.740859:0:8195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba2d02 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.740874:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f8fd1ea700) 00010000:00010000:0.0:1787384520.740878:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384520.740884:0:8195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba2d02 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.740890:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba2d02 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.740907:0:8195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba2d09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.740923:0:8195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba2d09 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.740930:0:8195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba2d09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.740936:0:8195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6141e00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384520.740946:0:8195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba2d09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.740953:0:8195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba2d09 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.740960:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f7c3a9c200) 00010000:00010000:0.0:1787384520.740963:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384520.740966:0:8195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba2d09 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.740971:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba2d09 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.740988:0:8195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba2d10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.740994:0:8195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba2d10 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.741000:0:8195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba2d10 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.741004:0:8195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6141200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384520.741007:0:8195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba2d10 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.741012:0:8195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba2d10 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.741019:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9cc00) 00010000:00010000:0.0:1787384520.741021:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384520.741030:0:8195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba2d10 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.741036:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba2d10 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384520.741162:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+17:11275:x1874208182283008:12345-192.168.203.45@tcp:34:lfs.0 Request processed in 882us (2808us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384520.741173:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 71 00000100:00100000:2.0:1787384520.744984:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384520.756887:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182283264 00000100:00100000:1.0:1787384520.756910:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182283264 00000100:00100000:1.0:1787384520.759381:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 16 00000100:00100000:1.0:1787384520.759399:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d915aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+17:11275:x1874208182283264:12345-192.168.203.45@tcp:35:lfs.0 00000100:00100000:1.0:1787384520.759805:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d915aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+18:11275:x1874208182283264:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 408us (14904us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1787384520.759836:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 16 00000100:00100000:3.0:1787384520.830032:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384520.831109:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182283520 00000100:00100000:1.0:1787384520.831127:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182283520 00000100:00100000:1.0:1787384520.831226:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 72 00000100:00100000:1.0:1787384520.831238:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+18:11278:x1874208182283520:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:1.0:1787384520.831275:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384520.831304:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953600/0x7ef423838fba2d17 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce37b0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.831407:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952e00/0x7ef423838fba2d1e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.831569:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952e00/0x7ef423838fba2d1e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.831583:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952e00/0x7ef423838fba2d1e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.831602:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba2d25 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.831671:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba2d25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.831682:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba2d25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.831963:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba2d2c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.832981:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba2d2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.833168:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba2d2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384520.833188:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787384520.837140:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952e00/0x7ef423838fba2d1e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.837162:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952e00/0x7ef423838fba2d1e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.837171:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952e00/0x7ef423838fba2d1e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.837177:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3952e00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384520.837183:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952e00/0x7ef423838fba2d1e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.837191:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952e00/0x7ef423838fba2d1e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.837213:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f8fd1ea700) 00010000:00010000:2.0:1787384520.837216:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384520.837221:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952e00/0x7ef423838fba2d1e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.837227:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952e00/0x7ef423838fba2d1e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.837244:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba2d25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.837251:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba2d25 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.837257:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba2d25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.837285:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3953c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384520.837288:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba2d25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.837294:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba2d25 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.837302:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f8fd1ead00) 00010000:00010000:2.0:1787384520.837305:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384520.837308:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba2d25 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.837314:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba2d25 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.837393:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953600/0x7ef423838fba2d17 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37b0 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.837410:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba2d2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37b0 expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.837424:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9cc00) 00010000:00010000:2.0:1787384520.837427:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787384520.837429:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3953000, rc 0) 00000100:00100000:2.0:1787384520.837539:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+20:11278:x1874208182283520:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 6301us (7520us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1787384520.837549:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 72 00000100:00100000:3.0:1787384520.846393:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384520.847414:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384520.847545:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182283648 00000100:00100000:1.0:1787384520.847558:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182283648 00000100:00100000:1.0:1787384520.847646:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 5 00000100:00100000:1.0:1787384520.847657:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9174e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+20:2414:x1874208182283648:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384520.847678:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384520.847709:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba2d2c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37b0 expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384520.847733:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9cc00) 00010000:00010000:1.0:1787384520.847739:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384520.847875:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9174e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+19:2414:x1874208182283648:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 218us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384520.847884:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 5 00000100:00100000:0.0:1787384520.848535:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182283776 00000100:00100000:0.0:1787384520.848545:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182283776 00000100:00100000:0.0:1787384520.848595:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 73 00000100:00100000:0.0:1787384520.848603:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+19:11278:x1874208182283776:12345-192.168.203.45@tcp:54:lfs.0 00010000:00010000:0.0:1787384520.848694:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba2d3a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.848712:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba2d3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.848725:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba2d3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.848828:0:14031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba2d3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.848837:0:14031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba2d3a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.848845:0:14031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba2d3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.848853:0:14031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6141e00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384520.848875:0:14031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba2d3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.848884:0:14031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba2d3a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.848897:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9cc00) 00010000:00010000:0.0:1787384520.848901:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787384520.848905:0:14031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba2d3a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384520.848911:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba2d3a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384520.849003:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+19:11278:x1874208182283776:12345-192.168.203.45@tcp:54:lfs.0 Request processed in 390us (2632us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384520.849011:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 73 00000100:00100000:3.0:1787384520.872132:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384520.873008:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182284032 00000100:00100000:1.0:1787384520.873024:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182284032 00000100:00100000:1.0:1787384520.873122:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 17 00000100:00100000:1.0:1787384520.873135:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9175c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+19:11278:x1874208182284032:12345-192.168.203.45@tcp:35:lfs.0 00000100:00100000:1.0:1787384520.873769:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9175c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+20:11278:x1874208182284032:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 625us (1639us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1787384520.873853:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 17 00000100:00100000:3.0:1787384521.134711:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384521.135106:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182284288 00000100:00100000:0.0:1787384521.135120:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182284288 00000100:00100000:0.0:1787384521.135243:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 74 00000100:00100000:0.0:1787384521.135256:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9176d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+20:11296:x1874208182284288:12345-192.168.203.45@tcp:101:cat.0 00010000:00010000:0.0:1787384521.135288:0:8195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384521.135313:0:8195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba2d41 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce37b7 expref: -99 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.135454:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba2d48 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.135473:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba2d48 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.135510:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba2d48 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384521.135526:0:8195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787384521.135698:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba2d41 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37b7 expref: 23 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.135722:0:8195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba2d48 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37b7 expref: 22 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.135731:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9cc00) 00010000:00010000:0.0:1787384521.135734:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787384521.135738:0:8195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6140400, rc 0) 00000100:00080000:2.0:1787384521.135953:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787384521.136642:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9176d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+22:11296:x1874208182284288:12345-192.168.203.45@tcp:101:cat.0 Request processed in 1384us (1943us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1787384521.136652:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 74 00000100:00100000:0.0:1787384521.155545:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203343488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787384521.155641:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384521.155756:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203343488 00000100:00100000:0.0:1787384521.155810:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203343488 00000100:00100000:0.0:1787384521.155886:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787384521.155898:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203343488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787384521.155935:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787384521.156004:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203343488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384521.156012:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787384521.156768:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203343488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787384521.156819:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384521.156829:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9b54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203343616:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787384521.156893:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384521.156947:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203343616 00000100:00100000:1.0:1787384521.156955:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203343616 00000100:00100000:1.0:1787384521.157013:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787384521.157023:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9175880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203343616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787384521.157041:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787384521.157309:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9175880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203343616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 287us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384521.157319:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:2.0:1787384521.157432:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787384521.157980:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9b54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203343616:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787384521.196701:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384521.196856:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182284416 00000100:00100000:2.0:1787384521.196870:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182284416 00000100:00100000:2.0:1787384521.196956:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 75 00000100:00100000:2.0:1787384521.196967:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9146680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+22:11297:x1874208182284416:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:2.0:1787384521.197011:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384521.197322:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba2d56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce37be expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.197425:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba2d5d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.197445:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba2d5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.197460:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba2d5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384521.197530:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1787384521.197535:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787384521.197562:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba2d5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.197595:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba2d56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37be expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.197620:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba2d5d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37be expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.197630:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f8fd1ea700) 00010000:00010000:2.0:1787384521.197654:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787384521.197669:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965ac00, rc 0) 00000100:00100000:2.0:1787384521.197763:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9146680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+23:11297:x1874208182284416:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 797us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384521.197772:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 75 00000100:00100000:2.0:1787384521.208005:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384521.208090:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182284800 00000100:00100000:0.0:1787384521.208105:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182284800 00000100:00100000:0.0:1787384521.208192:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 18 00000100:00100000:0.0:1787384521.208205:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9159f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+23:11297:x1874208182284800:12345-192.168.203.45@tcp:35:lfs.0 00000100:00100000:0.0:1787384521.209027:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9159f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+24:11297:x1874208182284800:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 820us (1040us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1787384521.209037:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 18 00000100:00100000:3.0:1787384521.211447:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384521.212011:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182284928 00000100:00100000:2.0:1787384521.212024:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182284928 00000100:00100000:2.0:1787384521.212124:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 6 00000100:00100000:2.0:1787384521.212136:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9174380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+24:11297:x1874208182284928:12345-192.168.203.45@tcp:103:lfs.0 00010000:00010000:2.0:1787384521.212154:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787384521.212185:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba2ced lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37a2 expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.212209:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba2d48 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37b7 expref: 23 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.212222:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141000/0x7ef423838fba2be3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce375c expref: 22 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.212233:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9cc00) 00010000:00010000:2.0:1787384521.212238:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384521.212305:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9174380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+21:11297:x1874208182284928:12345-192.168.203.45@tcp:103:lfs.0 Request processed in 172us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384521.212313:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 6 00000100:00100000:2.0:1787384521.217845:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384521.218007:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182285056 00000100:00100000:0.0:1787384521.218020:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182285056 00000100:00100000:0.0:1787384521.218221:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 76 00000100:00100000:0.0:1787384521.218234:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+21:11297:x1874208182285056:12345-192.168.203.45@tcp:58:lfs.0 00010000:00010000:0.0:1787384521.218419:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba2d64 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.218442:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba2d64 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.218459:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba2d64 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787384521.219345:0:14031:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787384521.219872:0:14031:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1787384521.219983:0:14031:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1787384521.220165:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+21:11297:x1874208182285056:12345-192.168.203.45@tcp:58:lfs.0 Request processed in 1927us (2329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384521.220178:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 76 00000100:00100000:3.0:1787384521.265623:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384521.265836:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182285184 00000100:00100000:0.0:1787384521.265851:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182285184 00000100:00100000:0.0:1787384521.265950:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 77 00000100:00100000:0.0:1787384521.265962:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9177480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+21:11299:x1874208182285184:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:0.0:1787384521.265989:0:8195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384521.266028:0:8195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2d6b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce37c5 expref: -99 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.266126:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2d72 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.266144:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2d72 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.266160:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2d72 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.266178:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2d79 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.266186:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2d79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.266192:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2d79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.266304:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140600/0x7ef423838fba2d80 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.266314:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140600/0x7ef423838fba2d80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.266322:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140600/0x7ef423838fba2d80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384521.266391:0:8195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787384521.266396:0:8195:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787384521.266419:0:8195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140600/0x7ef423838fba2d80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.266433:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140600/0x7ef423838fba2d80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.266443:0:8195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2d72 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.266450:0:8195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2d72 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.266458:0:8195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2d72 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.266464:0:8195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384521.266469:0:8195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2d72 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.266477:0:8195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2d72 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.266492:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f8fd1ea700) 00010000:00010000:0.0:1787384521.266495:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384521.266500:0:8195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2d72 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.266507:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2d72 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.266538:0:8195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2d79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.266543:0:8195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2d79 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.266549:0:8195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2d79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.266554:0:8195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384521.266557:0:8195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2d79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.266563:0:8195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2d79 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.266570:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f7c3a9c200) 00010000:00010000:0.0:1787384521.266575:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384521.266579:0:8195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2d79 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.266584:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2d79 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.266622:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2d6b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37c5 expref: 23 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.266636:0:8195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140600/0x7ef423838fba2d80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37c5 expref: 22 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.266654:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9cc00) 00010000:00010000:0.0:1787384521.266657:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787384521.266660:0:8195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6140600, rc 0) 00000100:00100000:1.0:1787384521.266936:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9177480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+22:11299:x1874208182285184:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 974us (1327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384521.266948:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 77 00000040:00080000:0.0:1787384521.271173:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787384521.271188:0:13801:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787384521.271245:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787384521.271256:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787384521.271442:0:13801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9147800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1874208203343744:192.168.203.45@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787384521.271859:0:13801:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c72406c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384521.275610:0:13801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9147800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1874208203343744:192.168.203.45@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787384521.275683:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384521.275969:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182285312 00000100:00100000:3.0:1787384521.275979:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182285312 00000100:00100000:3.0:1787384521.276601:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 78 00000100:00100000:3.0:1787384521.276614:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9158a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+22:11301:x1874208182285312:12345-192.168.203.45@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787384521.276658:0:6521:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787384521.278630:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9158a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+22:11301:x1874208182285312:12345-192.168.203.45@tcp:53:lhsmtool_posix.0 Request processed in 2002us (2931us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384521.278648:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 78 00000100:00100000:3.0:1787384521.284984:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384521.285257:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182285440 00000100:00100000:0.0:1787384521.285273:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182285440 00000100:00100000:0.0:1787384521.285349:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 79 00000100:00100000:0.0:1787384521.285359:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9174700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+22:11301:x1874208182285440:12345-192.168.203.45@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787384521.285463:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2d87 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.285483:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2d87 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.285497:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2d87 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.285665:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2d8e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.285688:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2d8e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.285716:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2d8e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.285756:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2d95 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.285765:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2d95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.285772:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2d95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384521.285886:0:14031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787384521.285891:0:14031:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787384521.285905:0:14031:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2d95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.285917:0:14031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2d87 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.285937:0:14031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2d87 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.285944:0:14031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2d87 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.285951:0:14031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384521.285955:0:14031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2d87 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.285962:0:14031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2d87 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.285981:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98f7c3a9cf00) 00010000:00010000:0.0:1787384521.285992:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384521.285997:0:14031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2d87 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.286004:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2d87 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.286018:0:14031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2d8e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.286025:0:14031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2d8e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.286037:0:14031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2d8e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.286043:0:14031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384521.286046:0:14031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2d8e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.286052:0:14031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2d8e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.286059:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff98f7c3a9c200) 00010000:00010000:0.0:1787384521.286061:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384521.286064:0:14031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2d8e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.286069:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2d8e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.286100:0:14031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2d95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.286107:0:14031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2d95 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.286113:0:14031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2d95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.286118:0:14031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384521.286120:0:14031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2d95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.286126:0:14031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2d95 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.286133:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9cc00) 00010000:00010000:0.0:1787384521.286135:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384521.286138:0:14031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2d95 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.286143:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2d95 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384521.286229:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9174700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+22:11301:x1874208182285440:12345-192.168.203.45@tcp:34:lhsmtool_posix.0 Request processed in 867us (1257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384521.286239:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 79 00000100:00100000:1.0:1787384521.302158:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384521.302341:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182285696 00000100:00100000:3.0:1787384521.302352:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182285696 00000100:00100000:3.0:1787384521.302415:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 80 00000100:00100000:3.0:1787384521.302425:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+22:11301:x1874208182285696:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787384521.302445:0:8195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384521.302466:0:8195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba2d9c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce37cc expref: -99 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.302564:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba2da3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.302579:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba2da3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.302610:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba2da3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384521.302622:0:8195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787384521.302697:0:8195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba2da3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.302704:0:8195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba2da3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.302709:0:8195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba2da3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.302713:0:8195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cce00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384521.302717:0:8195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba2da3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.302723:0:8195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba2da3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.302733:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9cc00) 00010000:00010000:3.0:1787384521.302735:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787384521.302739:0:8195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba2da3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.302744:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba2da3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.302846:0:8195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba2d9c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37cc expref: 24 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.302867:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98f7c3a9cf00) 00010000:00010000:3.0:1787384521.302870:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787384521.302874:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba2d9c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37cc expref: 24 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.302884:0:8195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cd600, rc 0) 00000100:00100000:3.0:1787384521.302956:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+23:11301:x1874208182285696:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 532us (808us total) trans 4294967353 rc 301/301 00000100:00100000:3.0:1787384521.302963:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 80 00000100:00100000:2.0:1787384521.313099:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384521.313210:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182285824 00000100:00100000:3.0:1787384521.313231:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182285824 00000100:00100000:3.0:1787384521.313289:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 81 00000100:00100000:3.0:1787384521.313300:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+23:11301:x1874208182285824:12345-192.168.203.45@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787384521.313337:0:6521:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787384521.313487:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+23:11301:x1874208182285824:12345-192.168.203.45@tcp:53:lhsmtool_posix.0 Request processed in 189us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384521.313495:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 81 00000100:00100000:0.0:1787384521.322765:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384521.323910:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182286080 00000100:00100000:3.0:1787384521.323935:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182286080 00000100:00100000:3.0:1787384521.324009:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 82 00000100:00100000:3.0:1787384521.324019:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+23:11301:x1874208182286080:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787384521.324050:0:14031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384521.324053:0:14031:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787384521.324092:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba2d5d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37be expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.324131:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f8fd1ea700) 00010000:00010000:3.0:1787384521.324137:0:14031:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787384521.324152:0:14031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba2db1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce37d3 expref: -99 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787384521.324933:0:14031:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:3.0:1787384521.325115:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba2db8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.325129:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba2db8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.325138:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba2db8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.325194:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba2db1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37d3 expref: 25 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.326853:0:14031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba2db8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37d3 expref: 24 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.326864:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98f7c2950600) 00010000:00010000:3.0:1787384521.326868:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787384521.326871:0:14031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cce00, rc 0) 00000100:00100000:3.0:1787384521.327227:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+24:11301:x1874208182286080:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 3206us (4468us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1787384521.327239:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 82 00000100:00100000:1.0:1787384521.337279:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384521.337411:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182286336 00000100:00100000:0.0:1787384521.337422:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182286336 00000100:00100000:0.0:1787384521.337505:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 83 00000100:00100000:0.0:1787384521.337515:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+24:11301:x1874208182286336:12345-192.168.203.45@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787384521.337575:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384521.337602:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba2db8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37d3 expref: 24 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.337621:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98f7c2950600) 00010000:00010000:0.0:1787384521.337632:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787384521.337667:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2dc6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.337682:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2dc6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.337692:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2dc6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.337753:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2dcd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xf0b009f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.337761:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2dcd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xf0b009f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.337768:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2dcd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xf0b009f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.337870:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2dc6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.337878:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2dc6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.337894:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2dc6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.337900:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384521.337904:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2dc6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.337911:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2dc6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.337920:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f8fd1ea700) 00010000:00010000:0.0:1787384521.337923:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384521.337926:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2dc6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.337932:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2dc6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.337942:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2dcd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xf0b009f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.337949:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2dcd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xf0b009f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.337954:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2dcd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xf0b009f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.337958:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384521.337961:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2dcd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xf0b009f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.337975:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2dcd lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xf0b009f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.337983:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xf0b009f (ffff98f7c3a9c200) 00010000:00010000:0.0:1787384521.337985:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384521.337987:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2dcd lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xf0b009f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.337993:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2dcd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xf0b009f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384521.338068:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+23:11301:x1874208182286336:12345-192.168.203.45@tcp:36:lhsmtool_posix.0 Request processed in 554us (798us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787384521.338088:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 83 00000100:00100000:2.0:1787384521.340604:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384521.340809:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182286464 00000100:00100000:0.0:1787384521.340817:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182286464 00000100:00100000:0.0:1787384521.340864:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 84 00000100:00100000:0.0:1787384521.340872:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+23:11301:x1874208182286464:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787384521.340889:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384521.340910:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2dd4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce37da expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.340953:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141000/0x7ef423838fba2ddb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.340965:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141000/0x7ef423838fba2ddb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.340975:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141000/0x7ef423838fba2ddb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.341112:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2dd4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37da expref: 25 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.341129:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141000/0x7ef423838fba2ddb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37da expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.341138:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98f7c3a9cd00) 00010000:00010000:0.0:1787384521.341141:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787384521.341144:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6141000, rc 0) 00000100:00100000:0.0:1787384521.341212:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+24:11301:x1874208182286464:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 340us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384521.341218:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 84 00000100:00100000:1.0:1787384521.352978:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384521.353314:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182286720 00000100:00100000:3.0:1787384521.353323:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182286720 00000100:00100000:3.0:1787384521.353382:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 85 00000100:00100000:3.0:1787384521.353391:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+24:11301:x1874208182286720:12345-192.168.203.45@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787384521.353482:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba2de2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.353499:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba2de2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.353512:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba2de2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787384521.353680:0:14031:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1787384521.353690:0:14031:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 416433910933ns, next at 417433908070ns, rc = 0 00000004:00010000:3.0:1787384521.353745:0:14031:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d71c3717 reply state 000000000bf5cef1 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba2de2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.353759:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba2de2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.353767:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98f7c3a9cd00) 00010000:00010000:3.0:1787384521.353770:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787384521.353774:0:14031:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787384521.353914:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+26:11301:x1874208182286720:12345-192.168.203.45@tcp:36:lhsmtool_posix.0 Request processed in 524us (944us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1787384521.353922:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 85 00000100:00100000:3.0:1787384521.363730:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384521.364105:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182286848 00000100:00100000:2.0:1787384521.364117:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182286848 00000100:00100000:2.0:1787384521.364187:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 86 00000100:00100000:2.0:1787384521.364198:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9176680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+26:11301:x1874208182286848:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787384521.364226:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384521.364249:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2de9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce37e1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.364316:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2de9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37e1 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.364331:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2de9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37e1 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.364352:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98f7c3a9cd00) 00010000:00010000:2.0:1787384521.364356:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787384521.364360:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965aa00, rc 0) 00000100:00100000:2.0:1787384521.364426:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9176680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+27:11301:x1874208182286848:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 230us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384521.364433:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 86 00000100:00100000:2.0:1787384521.368718:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384521.369768:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182286976 00000100:00100000:1.0:1787384521.369804:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182286976 00000100:00100000:1.0:1787384521.369872:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 33 00000100:00100000:1.0:1787384521.369880:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d915ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2412:x1874208182286976:12345-192.168.203.45@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1787384521.369914:0:8438:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 55e96ad5-fd9d-44d4-856e-5db0c40b1329@192.168.203.45@tcp t0 exp 0000000000000000 cur 416 last 0 00000020:00000080:1.0:1787384521.369945:0:8438:0:(genops.c:1406:class_connect()) connect: client 55e96ad5-fd9d-44d4-856e-5db0c40b1329, cookie 0x7ef423838fba2df0 00002000:00100000:1.0:1787384521.370225:0:8438:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 55e96ad5-fd9d-44d4-856e-5db0c40b1329/ffff98f8d8047800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113671 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787384521.370239:0:8438:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b7, return b7 00002000:00080000:1.0:1787384521.370327:0:8438:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787384521.370366:0:8438:0:(import.c:65:import_set_state_nolock()) ffff98f8d8046000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787384521.370462:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d915ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2412:x1874208182286976:12345-192.168.203.45@tcp:8:lhsmtool_posix.0 Request processed in 581us (1754us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384521.370472:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 33 00000100:00100000:1.0:1787384521.375971:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384521.377370:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182287104 00000100:00100000:2.0:1787384521.377385:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182287104 00000100:00100000:2.0:1787384521.377488:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 34 00000100:00100000:2.0:1787384521.377502:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:0:x1874208182287104:12345-192.168.203.45@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1787384521.377525:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1787384521.387028:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:3.0:1787384521.387041:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 55e96ad5-fd9d-44d4-856e-5db0c40b1329 00000100:00100000:2.0:1787384521.393502:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:0:x1874208182287104:12345-192.168.203.45@tcp:2:lhsmtool_posix.0 Request processed in 15993us (17528us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787384521.393516:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 34 00000100:00100000:3.0:1787384521.404303:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384521.404492:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182287360 00000100:00100000:0.0:1787384521.404503:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182287360 00000100:00100000:0.0:1787384521.404572:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 19 00000100:00100000:0.0:1787384521.404583:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9175500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+27:11301:x1874208182287360:12345-192.168.203.45@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787384521.404833:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9175500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+28:11301:x1874208182287360:12345-192.168.203.45@tcp:35:lhsmtool_posix.0 Request processed in 251us (541us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1787384521.404841:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 19 00000100:00100000:0.0:1787384521.414559:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384521.414670:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182287616 00000100:00100000:3.0:1787384521.414683:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182287616 00000100:00100000:3.0:1787384521.414754:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 87 00000100:00100000:3.0:1787384521.414764:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+28:11301:x1874208182287616:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787384521.414920:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+28:11301:x1874208182287616:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 Request processed in 157us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384521.414929:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 87 00000100:00100000:3.0:1787384521.424964:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384521.425254:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182287744 00000100:00100000:0.0:1787384521.425264:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182287744 00000100:00100000:0.0:1787384521.425325:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 88 00000100:00100000:0.0:1787384521.425337:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9177800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+28:11301:x1874208182287744:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787384521.425365:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384521.425395:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2df7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce37e8 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.425481:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2dfe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.425498:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2dfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.425509:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2dfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384521.425554:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787384521.425571:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2dfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.425599:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2df7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37e8 expref: 30 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.425615:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2dfe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37e8 expref: 29 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.425624:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98f7c3a9cd00) 00010000:00010000:0.0:1787384521.425627:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787384521.425630:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6140000, rc 0) 00000100:00100000:0.0:1787384521.425864:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9177800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+29:11301:x1874208182287744:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 528us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384521.425872:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 88 00000100:00100000:2.0:1787384521.433225:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384521.433303:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182287872 00000100:00100000:0.0:1787384521.433313:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182287872 00000100:00100000:0.0:1787384521.433377:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 35 00000100:00100000:0.0:1787384521.433393:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9159880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2413:x1874208182287872:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787384521.433412:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384521.433437:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000678a5ba/0x7ef423838fba2e05 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce37ef expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787384521.433463:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8952c8, blocks: 0x0 00010000:00010000:0.0:1787384521.433481:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1787384521.433486:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384521.433495:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000678a5ba/0x7ef423838fba2e05 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37ef expref: 6 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.433516:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000678a5ba/0x7ef423838fba2e05 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37ef expref: 6 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.433530:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6140400, rc 0) 00000100:00100000:0.0:1787384521.433585:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9159880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2413:x1874208182287872:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 193us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384521.433593:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 35 00000100:00100000:0.0:1787384521.443245:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384521.443386:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182288128 00000100:00100000:3.0:1787384521.443398:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182288128 00000100:00100000:3.0:1787384521.443464:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 89 00000100:00100000:3.0:1787384521.443475:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9144000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+29:11301:x1874208182288128:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787384521.443582:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9144000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+29:11301:x1874208182288128:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 Request processed in 108us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384521.443590:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 89 00000100:00100000:3.0:1787384521.449449:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384521.449586:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182288256 00000100:00100000:1.0:1787384521.449596:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182288256 00000100:00100000:1.0:1787384521.449661:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 36 00000100:00100000:1.0:1787384521.449672:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9177b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:11301:x1874208182288256:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787384521.449692:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384521.449712:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007505a175/0x7ef423838fba2e0c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce37f6 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384521.449747:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000678a5ba/0x7ef423838fba2e05 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37ef expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384521.449767:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384521.449772:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384521.450170:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007505a175/0x7ef423838fba2e0c lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37f6 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.450971:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000678a5ba/0x7ef423838fba2e05 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37ef expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.450999:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000678a5ba/0x7ef423838fba2e05 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37ef expref: 7 pid: 8435 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384521.452308:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9146a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874208203343872:192.168.203.45@tcp:104: 00000100:00100000:0.0:1787384521.452439:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7240c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787384521.457472:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9146a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874208203343872:192.168.203.45@tcp:104: 00010000:00010000:0.0:1787384521.457511:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007505a175/0x7ef423838fba2e0c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37f6 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.457531:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3952200, rc 0) 00000100:00100000:0.0:1787384521.457587:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9177b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:11301:x1874208182288256:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 7917us (8149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384521.457597:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 36 00000100:00100000:2.0:1787384521.469970:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384521.470112:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182288384 00000100:00100000:1.0:1787384521.470123:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182288384 00010000:00010000:1.0:1787384521.470165:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000678a5ba/0x7ef423838fba2e05 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37ef expref: 7 pid: 8435 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384521.470216:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 59 00000100:00100000:1.0:1787384521.470226:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9158380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:2416:x1874208182288384:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384521.470256:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384521.470281:0:10399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000678a5ba/0x7ef423838fba2e05 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37ef expref: 7 pid: 8435 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384521.470297:0:10399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000678a5ba/0x7ef423838fba2e05 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37ef expref: 7 pid: 8435 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384521.470325:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000678a5ba/0x7ef423838fba2e05 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37ef expref: 7 pid: 8435 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384521.470342:0:10399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384521.470347:0:10399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384521.470355:0:10399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007505a175/0x7ef423838fba2e0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37f6 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384521.470365:0:10399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007505a175/0x7ef423838fba2e0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37f6 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384521.470404:0:10399:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007505a175/0x7ef423838fba2e0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37f6 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384521.470418:0:10399:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9b54000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10399:1874208203344000:192.168.203.45@tcp:105: 00000100:00100000:1.0:1787384521.470494:0:10399:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c41cb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384521.492024:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384521.496352:0:10399:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9b54000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10399:1874208203344000:192.168.203.45@tcp:105: 00010000:00010000:1.0:1787384521.496378:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384521.496496:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9158380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2416:x1874208182288384:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 26271us (26535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384521.496508:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 59 00000100:00100000:3.0:1787384521.502286:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182288512 00000100:00100000:3.0:1787384521.502305:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182288512 00002000:00100000:3.0:1787384521.502366:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff98f8d915b480 x1874208182288512/t0(0) o4->55e96ad5-fd9d-44d4-856e-5db0c40b1329@192.168.203.45@tcp:552/0 lens 504/0 e 0 to 0 dl 1787384532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787384521.502523:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98f8d915b480 with x1874208182288512 ext(0->8) 00002000:00010000:3.0:1787384521.502531:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98f8d915b480 00000100:00100000:3.0:1787384521.502628:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 0 00000100:00100000:3.0:1787384521.502638:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d915b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2413:x1874208182288512:12345-192.168.203.45@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787384521.506314:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d915b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+8:2413:x1874208182288512:12345-192.168.203.45@tcp:4:lhsmtool_posix.0 Request processed in 3666us (14295us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787384521.506328:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 0 00002000:00100000:3.0:1787384521.506342:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff98f8d915b480 x1874208182288512/t4294967303(0) o4->55e96ad5-fd9d-44d4-856e-5db0c40b1329@192.168.203.45@tcp:552/0 lens 504/448 e 0 to 0 dl 1787384532 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787384521.506352:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98f8d915b480 with x1874208182288512 ext(0->8) 00002000:00010000:3.0:1787384521.506359:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98f8d915b480 00000100:00100000:3.0:1787384521.526061:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384521.526207:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182288640 00000100:00100000:1.0:1787384521.526216:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182288640 00000100:00100000:1.0:1787384521.526272:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 90 00000100:00100000:1.0:1787384521.526283:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9174000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+29:11301:x1874208182288640:12345-192.168.203.45@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787384521.532707:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:3.0:1787384521.532729:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1787384521.532772:0:6501:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:3.0:1787384521.533010:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9174000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+16:11301:x1874208182288640:12345-192.168.203.45@tcp:44:lhsmtool_posix.0 Request processed in 6724us (6955us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384521.533021:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 90 00000100:00100000:3.0:1787384521.533667:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9176300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203344128:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787384521.533731:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787384521.537850:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba2cd8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.537868:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba2cd8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.537876:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba2cd8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.537883:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384521.537888:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba2cd8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.537896:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba2cd8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.537914:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9cc00) 00010000:00010000:0.0:1787384521.537931:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384521.537937:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba2cd8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.537943:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba2cd8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.537965:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba2de2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.537971:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba2de2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.537977:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba2de2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.537982:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cd600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384521.537985:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba2de2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.537991:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba2de2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.538001:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98f7c3a9cd00) 00010000:00010000:0.0:1787384521.538003:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787384521.538006:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba2de2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.538189:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba2de2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787384521.538209:0:6553:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1787384521.538219:0:6553:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1787384521.538244:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203344128 00000100:00100000:0.0:1787384521.538253:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203344128 00000100:00100000:0.0:1787384521.538353:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787384521.538363:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9177100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203344128:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787384521.538502:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787384521.538506:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787384520 00002000:00010000:0.0:1787384521.538508:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787384521.538511:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1787384520 -> 1787384520 00002000:00010000:0.0:1787384521.538513:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1787384521.538588:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9177100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1874208203344128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 226us (4856us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787384521.538595:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:3.0:1787384521.546393:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98f8d9176300/2, rc 0, transno 4294967304 00000100:00100000:3.0:1787384521.546408:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9176300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203344128:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787384521.553983:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384521.554116:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182288768 00000100:00100000:2.0:1787384521.554125:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182288768 00000100:00100000:2.0:1787384521.554187:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 38 00000100:00100000:2.0:1787384521.554197:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+8:2414:x1874208182288768:12345-192.168.203.45@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1787384521.562774:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1787384521.562807:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:0.0:1787384521.562950:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2414:x1874208182288768:12345-192.168.203.45@tcp:16:lhsmtool_posix.0 Request processed in 8749us (8971us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384521.562962:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 38 00000100:00100000:3.0:1787384521.586867:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384521.586905:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182289024 00000100:00100000:3.0:1787384521.586915:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182289024 00000100:00100000:3.0:1787384521.586976:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 91 00000100:00100000:3.0:1787384521.586987:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9176a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+14:11301:x1874208182289024:12345-192.168.203.45@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787384521.587049:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384521.587082:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2dfe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37e8 expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.587100:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98f7c3a9cd00) 00010000:00010000:3.0:1787384521.587104:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787384521.587132:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba2e13 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.587145:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba2e13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.587154:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba2e13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787384521.587281:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000086413fb2 reply state 000000006d38fc63 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba2e13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.587294:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba2e13 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.587301:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98f7c3a9cd00) 00010000:00010000:3.0:1787384521.587304:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787384521.587307:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787384521.587404:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9176a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+15:11301:x1874208182289024:12345-192.168.203.45@tcp:36:lhsmtool_posix.0 Request processed in 418us (545us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1787384521.587412:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 91 00000100:00100000:0.0:1787384521.605773:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384521.606177:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182289152 00000100:00100000:1.0:1787384521.606187:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182289152 00000100:00100000:1.0:1787384521.606269:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 39 00000100:00100000:1.0:1787384521.606281:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2416:x1874208182289152:12345-192.168.203.45@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787384521.606511:0:8438:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787384521.606515:0:8438:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1787384520 -> 1787384519 00002000:00010000:1.0:1787384521.606517:0:8438:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787384518 00002000:00010000:1.0:1787384521.606519:0:8438:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1787384520 -> 1787384519 00002000:00010000:1.0:1787384521.606521:0:8438:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1787384521.606582:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:2416:x1874208182289152:12345-192.168.203.45@tcp:2:lhsmtool_posix.0 Request processed in 301us (827us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787384521.606590:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 39 00000100:00100000:0.0:1787384521.614650:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384521.614714:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182289408 00000100:00100000:3.0:1787384521.614722:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182289408 00000100:00100000:3.0:1787384521.614805:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 92 00000100:00100000:3.0:1787384521.614822:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9145c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+15:11301:x1874208182289408:12345-192.168.203.45@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787384521.614886:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba2e1a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.614901:0:8195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141000/0x7ef423838fba2ddb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37da expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.614910:0:8195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba2e1a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.614945:0:8195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141000/0x7ef423838fba2ddb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37da expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.614958:0:8195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141000/0x7ef423838fba2ddb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37da expref: 15 pid: 6522 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384521.614972:0:8195:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9175f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8195:1874208203344256:192.168.203.45@tcp:104: 00000100:00100000:3.0:1787384521.615220:0:8195:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d931d480 going to sleep for 11 seconds 00000100:00100000:1.0:1787384521.623630:0:8195:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9175f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8195:1874208203344256:192.168.203.45@tcp:104: 00010000:00010000:1.0:1787384521.623659:0:8195:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba2e1a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384521.630891:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384521.630982:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182289536 00000100:00100000:2.0:1787384521.630991:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182289536 00010000:00010000:2.0:1787384521.631039:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141000/0x7ef423838fba2ddb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37da expref: 16 pid: 6522 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384521.631088:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 60 00000100:00100000:2.0:1787384521.631098:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+16:2415:x1874208182289536:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384521.631112:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384521.631119:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141000/0x7ef423838fba2ddb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37da expref: 16 pid: 6522 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.631133:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141000/0x7ef423838fba2ddb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37da expref: 16 pid: 6522 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.631156:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141000/0x7ef423838fba2ddb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37da expref: 16 pid: 6522 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.631189:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98f7c3a9cd00) 00010000:00010000:2.0:1787384521.631194:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba2e1a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.631216:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba2e1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.631224:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba2e1a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.631255:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384521.631305:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+15:2415:x1874208182289536:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 208us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384521.631312:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 60 00010000:00010000:1.0:1787384521.631557:0:8195:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba2e1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384521.631576:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba2e1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384521.631613:0:8195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba2e1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384521.631621:0:8195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba2e1a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384521.631628:0:8195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba2e1a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384521.631634:0:8195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cc800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384521.631639:0:8195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba2e1a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384521.631646:0:8195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba2e1a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384521.631656:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98f7c3a9cd00) 00010000:00010000:1.0:1787384521.631658:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787384521.631662:0:8195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba2e1a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384521.631668:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba2e1a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384521.631714:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9145c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+14:11301:x1874208182289408:12345-192.168.203.45@tcp:55:lhsmtool_posix.0 Request processed in 16892us (17071us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787384521.631722:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 92 00000100:00100000:3.0:1787384521.635198:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384521.635347:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182289664 00000100:00100000:0.0:1787384521.635357:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182289664 00000100:00100000:0.0:1787384521.635415:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 40 00000100:00100000:0.0:1787384521.635425:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9175180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:2416:x1874208182289664:12345-192.168.203.45@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787384521.635467:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000075dd50c5/0x7ef423838fba2e21 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.635488:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007505a175/0x7ef423838fba2e0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37f6 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.635514:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384521.635519:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787384521.635524:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075dd50c5/0x7ef423838fba2e21 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.635559:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007505a175/0x7ef423838fba2e0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37f6 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.635573:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007505a175/0x7ef423838fba2e0c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37f6 expref: 7 pid: 8436 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384521.635587:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9144e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874208203344384:192.168.203.45@tcp:104: 00000100:00100000:0.0:1787384521.635665:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7240c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787384521.640700:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9144e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874208203344384:192.168.203.45@tcp:104: 00010000:00010000:2.0:1787384521.640738:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000075dd50c5/0x7ef423838fba2e21 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384521.648955:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384521.652376:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182289792 00000100:00100000:1.0:1787384521.652544:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182289792 00010000:00010000:1.0:1787384521.652591:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007505a175/0x7ef423838fba2e0c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37f6 expref: 8 pid: 8436 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384521.653512:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 61 00000100:00100000:1.0:1787384521.653528:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9158700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+8:2416:x1874208182289792:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384521.653546:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384521.653570:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007505a175/0x7ef423838fba2e0c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37f6 expref: 8 pid: 8436 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384521.653588:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007505a175/0x7ef423838fba2e0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37f6 expref: 8 pid: 8436 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384521.653613:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007505a175/0x7ef423838fba2e0c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37f6 expref: 8 pid: 8436 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384521.653631:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787384521.653635:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787384521.653642:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000075dd50c5/0x7ef423838fba2e21 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384521.653652:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075dd50c5/0x7ef423838fba2e21 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384521.653682:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384521.653741:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9158700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:2416:x1874208182289792:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 218us (4795us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384521.653771:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 61 00010000:00010000:1.0:1787384521.656982:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000075dd50c5/0x7ef423838fba2e21 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384521.657446:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075dd50c5/0x7ef423838fba2e21 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384521.657483:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000075dd50c5/0x7ef423838fba2e21 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384521.657492:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075dd50c5/0x7ef423838fba2e21 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384521.657500:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075dd50c5/0x7ef423838fba2e21 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384521.657507:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140e00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384521.657511:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075dd50c5/0x7ef423838fba2e21 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384521.657520:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075dd50c5/0x7ef423838fba2e21 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384521.657539:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075dd50c5/0x7ef423838fba2e21 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384521.657568:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075dd50c5/0x7ef423838fba2e21 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384521.657666:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9175180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2416:x1874208182289664:12345-192.168.203.45@tcp:1:lhsmtool_posix.0 Request processed in 22238us (22473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384521.657677:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 40 00000100:00100000:3.0:1787384521.657831:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d915a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203344512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787384521.657892:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787384521.657963:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384521.658696:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d915b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874208203344768:0@lo:400:kworker.0 00000100:00100000:2.0:1787384521.658733:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384521.658764:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874208203345280:0@lo:400:kworker.0 00000100:00100000:2.0:1787384521.658807:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384521.658824:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203345792:0@lo:400:kworker.0 00000100:00100000:2.0:1787384521.658844:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384521.658874:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787384521.658879:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203344640:0@lo:400:kworker.0 00000100:00100000:2.0:1787384521.658903:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384521.658923:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203345152:0@lo:400:kworker.0 00000100:00100000:2.0:1787384521.658941:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384521.658956:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874208203345664:0@lo:400:kworker.0 00000100:00100000:2.0:1787384521.658972:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384521.659294:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203344768 00000100:00100000:1.0:1787384521.659301:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203344768 00000100:00100000:1.0:1787384521.659335:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203345280 00000100:00100000:1.0:1787384521.659337:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203345280 00000100:00100000:1.0:1787384521.659357:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203345664 00000100:00100000:1.0:1787384521.659360:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203345664 00000100:00100000:1.0:1787384521.659374:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1787384521.659542:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874208203344768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384521.659602:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874208203344768:12345-0@lo:400:kworker.0 Request processed in 66us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384521.659609:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1787384521.659625:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1787384521.659631:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874208203345280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384521.659653:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874208203345280:12345-0@lo:400:kworker.0 Request processed in 23us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384521.659658:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1787384521.659666:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1787384521.659671:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874208203345664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384521.659691:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874208203345664:12345-0@lo:400:kworker.0 Request processed in 20us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384521.659704:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00010000:00080000:1.0:1787384521.659737:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c42ebb80 x1874208203345664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384521.659750:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874208203345664:0@lo:400:kworker.0 00000100:00100000:1.0:1787384521.659892:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d915b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874208203344768:0@lo:400:kworker.0 00000100:00100000:1.0:1787384521.659901:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874208203345280:0@lo:400:kworker.0 00000100:00100000:2.0:1787384521.659987:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203345152 00000100:00100000:2.0:1787384521.659992:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203345152 00000100:00100000:2.0:1787384521.660098:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787384521.660106:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203345152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384521.660143:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203345152:12345-0@lo:400:kworker.0 Request processed in 38us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384521.660149:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787384521.660478:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203345152:0@lo:400:kworker.0 00000100:00100000:0.0:1787384521.661640:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203345792 00000100:00100000:0.0:1787384521.661649:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203345792 00000100:00100000:0.0:1787384521.661727:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787384521.661738:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203345792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384521.661834:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203345792:12345-0@lo:400:kworker.0 Request processed in 98us (2986us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384521.661841:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787384521.661865:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203344640 00000100:00100000:0.0:1787384521.661869:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203344640 00000100:00100000:0.0:1787384521.661901:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1787384521.661908:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d945a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3654:x1874208203344640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384521.661949:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d945a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3654:x1874208203344640:12345-0@lo:400:kworker.0 Request processed in 41us (3044us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384521.661956:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00080000:0.0:1787384521.661983:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787384521.661988:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787384521.661991:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787384521.662017:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203344640:0@lo:400:kworker.0 00000100:00100000:0.0:1787384521.662033:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203345792:0@lo:400:kworker.0 00000100:00100000:1.0:1787384521.663965:0:13608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203344512 00000100:00100000:1.0:1787384521.663976:0:13608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203344512 00000100:00100000:3.0:1787384521.664015:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d915a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874208203345024:0@lo:400:kworker.0 00000100:00100000:1.0:1787384521.664037:0:13608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787384521.664049:0:13608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9174a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1874208203344512:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787384521.664070:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1787384521.664089:0:13608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787384521.664107:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874208203345536:0@lo:400:kworker.0 00000100:00100000:1.0:1787384521.664143:0:13608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9174a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1874208203344512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (6252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384521.664150:0:13608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787384521.664161:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384521.664186:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203345024 00000100:00100000:1.0:1787384521.664191:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203345024 00000100:00100000:3.0:1787384521.664213:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d915a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203344512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787384521.664240:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787384521.664248:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d915bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203344896:0@lo:400:kworker.0 00000100:00100000:3.0:1787384521.664272:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384521.664290:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874208203345408:0@lo:400:kworker.0 00000100:00100000:3.0:1787384521.664311:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384521.664325:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203345920:0@lo:400:kworker.0 00000100:00100000:1.0:1787384521.664338:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203345536 00000100:00100000:1.0:1787384521.664343:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203345536 00000100:00100000:3.0:1787384521.664347:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384521.664375:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203345408 00000100:00100000:1.0:1787384521.664388:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203345408 00000100:00100000:3.0:1787384521.664403:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203344896 00000100:00100000:3.0:1787384521.664408:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203344896 00000100:00100000:1.0:1787384521.664412:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1787384521.664421:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874208203345024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384521.664443:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787384521.664453:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203344896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384521.664465:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874208203345024:12345-0@lo:400:kworker.0 Request processed in 45us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384521.664482:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1787384521.664495:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1787384521.664501:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c426bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874208203345536:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787384521.664584:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787384521.664589:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787384521.670843:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384521.670877:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182290048 00000100:00100000:0.0:1787384521.670884:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182290048 00000100:00100000:0.0:1787384521.670930:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1787384521.670939:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c426a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874208203345408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384521.671010:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c426a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874208203345408:12345-0@lo:400:kworker.0 Request processed in 71us (6696us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384521.671018:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1787384521.671035:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 93 00000100:00100000:0.0:1787384521.671041:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+14:11301:x1874208182290048:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787384521.671115:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba2e28 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.671132:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba2c68 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce377f expref: 14 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.671153:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba2e28 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.671201:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba2c68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce377f expref: 14 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.671215:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba2c68 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce377f expref: 14 pid: 8195 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384521.671229:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4305880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1874208203346048:192.168.203.45@tcp:104: 00000100:00100000:0.0:1787384521.671316:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7240780 going to sleep for 11 seconds 00000100:00100000:1.0:1787384521.671323:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d915bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203344896:0@lo:400:kworker.0 00010000:00080000:1.0:1787384521.671349:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c42e9500 x1874208203345408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384521.671360:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874208203345408:0@lo:400:kworker.0 00000100:00100000:1.0:1787384521.671371:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d915a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874208203345024:0@lo:400:kworker.0 00000100:00100000:3.0:1787384521.671401:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203344896:12345-0@lo:400:kworker.0 Request processed in 6948us (7125us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384521.671411:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787384521.671441:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203345920 00000100:00100000:3.0:1787384521.671447:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203345920 00000100:00100000:3.0:1787384521.671525:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787384521.671532:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c426b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3652:x1874208203345920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384521.671573:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c426bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874208203345536:12345-0@lo:400:kworker.0 Request processed in 7070us (7412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384521.671579:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c426b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3652:x1874208203345920:12345-0@lo:400:kworker.0 Request processed in 46us (7230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384521.671585:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1787384521.671592:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787384521.672137:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203345920:0@lo:400:kworker.0 00000100:00100000:1.0:1787384521.672156:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874208203345536:0@lo:400:kworker.0 00000100:00100000:1.0:1787384521.684228:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384521.684333:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4305880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1874208203346048:192.168.203.45@tcp:104: 00010000:00010000:0.0:1787384521.684366:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba2e28 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384521.685219:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182290176 00000100:00100000:3.0:1787384521.685229:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182290176 00010000:00010000:3.0:1787384521.685265:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba2c68 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce377f expref: 15 pid: 8195 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384521.685308:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 62 00000100:00100000:3.0:1787384521.685329:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b47050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+15:2416:x1874208182290176:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384521.685343:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384521.685349:0:10399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba2c68 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce377f expref: 15 pid: 8195 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.685362:0:10399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba2c68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce377f expref: 15 pid: 8195 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.685384:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba2c68 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce377f expref: 15 pid: 8195 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.685399:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9cc00) 00010000:00010000:3.0:1787384521.685404:0:10399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba2e28 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.685415:0:10399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba2e28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.685422:0:10399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba2e28 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.685442:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787384521.685478:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba2e28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.685489:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba2e28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384521.685495:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b47050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+14:2416:x1874208182290176:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 165us (1275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384521.685505:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 62 00010000:00010000:0.0:1787384521.685665:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141600/0x7ef423838fba2e2f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.685677:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2de9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37e1 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.685686:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141600/0x7ef423838fba2e2f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.685719:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2de9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37e1 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.685733:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2de9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37e1 expref: 14 pid: 6521 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384521.685747:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4305880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1874208203346176:192.168.203.45@tcp:104: 00000100:00100000:0.0:1787384521.685821:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7240c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787384521.690929:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4305880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1874208203346176:192.168.203.45@tcp:104: 00010000:00010000:0.0:1787384521.690958:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141600/0x7ef423838fba2e2f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384521.691798:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384521.691894:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182290304 00000100:00100000:0.0:1787384521.691901:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182290304 00010000:00010000:0.0:1787384521.691936:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2de9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37e1 expref: 15 pid: 6521 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384521.691976:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 63 00000100:00100000:0.0:1787384521.691992:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c426aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+15:2415:x1874208182290304:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787384521.692007:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384521.692015:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2de9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37e1 expref: 15 pid: 6521 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.692027:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2de9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37e1 expref: 15 pid: 6521 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.692068:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2de9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37e1 expref: 15 pid: 6521 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.692096:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98f7c3a9cd00) 00010000:00010000:0.0:1787384521.692101:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141600/0x7ef423838fba2e2f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.692111:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141600/0x7ef423838fba2e2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.692119:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141600/0x7ef423838fba2e2f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384521.692147:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384521.692210:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c426aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+14:2415:x1874208182290304:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 224us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384521.692218:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 63 00010000:00010000:2.0:1787384521.692747:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141600/0x7ef423838fba2e2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.692768:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141600/0x7ef423838fba2e2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787384521.693035:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:2.0:1787384521.693148:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:2.0:1787384521.693180:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:2.0:1787384521.693246:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42e8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6522:1874208203346304:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787384521.693293:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384521.693326:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8e8ab9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384521.693341:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203346304 00000100:00100000:0.0:1787384521.693348:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203346304 00000100:00100000:0.0:1787384521.693393:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787384521.693402:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6522:x1874208203346304:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787384521.693487:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6522:x1874208203346304:12345-0@lo:1000:mdt00_001.0 Request processed in 85us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384521.693494:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787384521.694009:0:6522:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1787384521.694015:0:6522:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98f8d9176300, transno 4294967304 00000100:00100000:2.0:1787384521.695176:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42e8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6522:1874208203346304:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1787384521.695359:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:2.0:1787384521.695433:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42e8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6522:1874208203346432:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787384521.695492:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384521.695530:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203346432 00000100:00100000:2.0:1787384521.695537:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203346432 00000100:00100000:2.0:1787384521.695592:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787384521.695602:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6522:x1874208203346432:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787384521.695719:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6522:x1874208203346432:12345-0@lo:1000:mdt00_001.0 Request processed in 118us (227us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787384521.695727:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787384521.695751:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c6361d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787384521.695774:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42e8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6522:1874208203346432:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1787384521.695835:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141600/0x7ef423838fba2e2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.695846:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141600/0x7ef423838fba2e2f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.695854:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141600/0x7ef423838fba2e2f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.695860:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6141600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384521.695865:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141600/0x7ef423838fba2e2f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.695873:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141600/0x7ef423838fba2e2f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.695904:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98f7c3a9cd00) 00010000:00010000:2.0:1787384521.695907:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787384521.695912:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141600/0x7ef423838fba2e2f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.695918:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141600/0x7ef423838fba2e2f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.695946:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba2d64 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.695954:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba2d64 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.695960:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba2d64 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.695965:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6141a00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384521.695968:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba2d64 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.695974:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba2d64 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.695984:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9cc00) 00010000:00010000:2.0:1787384521.695986:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787384521.695990:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba2d64 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.695994:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba2d64 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.696048:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2e36 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.696063:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140600/0x7ef423838fba2d80 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37c5 expref: 17 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.696079:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2e36 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.696105:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140600/0x7ef423838fba2d80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37c5 expref: 17 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.696119:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140600/0x7ef423838fba2d80 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37c5 expref: 17 pid: 8195 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384521.696131:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42e9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1874208203346560:192.168.203.45@tcp:104: 00000100:00100000:2.0:1787384521.696194:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3a5e300 going to sleep for 11 seconds 00000100:00100000:3.0:1787384521.703414:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384521.705146:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182290432 00000100:00100000:1.0:1787384521.705160:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182290432 00010000:00010000:1.0:1787384521.705200:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140600/0x7ef423838fba2d80 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37c5 expref: 18 pid: 8195 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384521.705235:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 64 00000100:00100000:1.0:1787384521.705246:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4269f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+18:2415:x1874208182290432:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384521.705261:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384521.705268:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140600/0x7ef423838fba2d80 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37c5 expref: 18 pid: 8195 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384521.705290:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140600/0x7ef423838fba2d80 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37c5 expref: 18 pid: 8195 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384521.705313:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9cc00) 00010000:00010000:1.0:1787384521.705318:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2e36 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384521.705328:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2e36 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384521.705335:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2e36 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384521.705355:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384521.705420:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4269f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+18:2415:x1874208182290432:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 175us (2014us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384521.705427:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 64 00010000:00010000:3.0:1787384521.708177:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140600/0x7ef423838fba2d80 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37c5 expref: 17 pid: 8195 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384521.708215:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42e9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1874208203346560:192.168.203.45@tcp:104: 00010000:00010000:3.0:1787384521.708242:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2e36 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.708251:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2e36 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.708257:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2e36 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.708269:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2e36 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.708275:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2e36 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.708283:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2e36 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.708288:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965b600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384521.708293:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2e36 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.708300:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2e36 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.708317:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9cc00) 00010000:00010000:3.0:1787384521.708320:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384521.708324:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2e36 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.708341:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2e36 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.708354:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba2e28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.708359:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba2e28 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.708365:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba2e28 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.708371:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140a00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384521.708374:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba2e28 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.708379:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba2e28 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.708387:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c3a9cc00) 00010000:00010000:3.0:1787384521.708390:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787384521.708393:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba2e28 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.708399:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba2e28 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384521.708572:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+16:11301:x1874208182290048:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 Request processed in 37529us (37736us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1787384521.708582:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 93 00000020:00080000:3.0:1787384521.708598:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787384521.708833:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787384521.708839:0:13801:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787384521.708853:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787384521.708865:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787384521.717815:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384521.717930:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182290688 00000100:00100000:2.0:1787384521.717941:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182290688 00000100:00100000:2.0:1787384521.718012:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 20 00000100:00100000:2.0:1787384521.718023:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+16:11301:x1874208182290688:12345-192.168.203.45@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787384521.718318:0:6525:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787384521.718358:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:2.0:1787384521.718418:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba2e3d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.718435:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba2e3d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.718461:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba2e3d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.718471:0:6525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba2e3d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.718478:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba2e3d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.718484:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba2e3d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384521.718499:0:6525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787384521.718600:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+18:11301:x1874208182290688:12345-192.168.203.45@tcp:35:lhsmtool_posix.0 Request processed in 577us (833us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1787384521.718609:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 20 00000020:00080000:2.0:1787384521.718613:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787384521.721142:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384521.721156:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba2e3d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.721167:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965ae00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:3.0:1787384521.721172:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba2e3d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.721181:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba2e3d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.721200:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98f7c3a9cd00) 00010000:00010000:3.0:1787384521.721204:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787384521.721208:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba2e3d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.721214:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba2e3d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384521.721231:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384521.721233:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384521.721235:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384522.167597:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787384522.167623:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4304380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203346688:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787384522.167693:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384522.168558:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203346688 00000100:00100000:0.0:1787384522.168567:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203346688 00000100:00100000:0.0:1787384522.168631:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787384522.168642:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203346688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787384522.168668:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787384522.168734:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203346688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384522.168741:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787384522.168832:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4304380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203346688:0@lo:13:osp-pre-1-1.0 00000040:00080000:0.0:1787384522.211718:0:14217:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787384522.211728:0:14217:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787384522.211759:0:14217:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787384522.211765:0:14217:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787384522.364477:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384522.365102:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182290944 00000100:00100000:1.0:1787384522.365114:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182290944 00000100:00100000:1.0:1787384522.365177:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 94 00000100:00100000:1.0:1787384522.365187:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4269180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+18:11320:x1874208182290944:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:1.0:1787384522.365511:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384522.365533:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952800/0x7ef423838fba2e44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce37fd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384522.365901:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952200/0x7ef423838fba2e4b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384522.365925:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952200/0x7ef423838fba2e4b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384522.365938:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952200/0x7ef423838fba2e4b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384522.365950:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1787384522.366126:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952800/0x7ef423838fba2e44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37fd expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384522.366143:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952200/0x7ef423838fba2e4b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37fd expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384522.366152:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f8fd1ea700) 00010000:00010000:1.0:1787384522.366155:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787384522.366158:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3952200, rc 0) 00000100:00100000:1.0:1787384522.366923:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4269180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+20:11320:x1874208182290944:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 1733us (2452us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1787384522.366933:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 94 00000100:00100000:0.0:1787384522.383136:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384522.383504:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182291072 00000100:00100000:3.0:1787384522.383515:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182291072 00000100:00100000:3.0:1787384522.383579:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 95 00000100:00100000:3.0:1787384522.383590:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+20:11320:x1874208182291072:12345-192.168.203.45@tcp:34:lfs.0 00010000:00010000:3.0:1787384522.383980:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2e59 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.385305:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2e59 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.385327:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2e59 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.385350:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba2e60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.385359:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba2e60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.385366:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba2e60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.385452:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2e67 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.385461:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2e67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.385467:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2e67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787384522.385515:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2e67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.385528:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2e59 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.385535:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2e59 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.385542:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2e59 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.385560:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cd800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384522.385565:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2e59 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.385573:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2e59 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.385585:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f8fd1ea700) 00010000:00010000:3.0:1787384522.385588:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384522.385593:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2e59 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.385600:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2e59 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.385613:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba2e60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.385619:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba2e60 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.385625:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba2e60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.385630:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cdc00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384522.385632:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba2e60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.385639:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba2e60 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.385659:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f7c294f900) 00010000:00010000:3.0:1787384522.385662:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384522.385665:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba2e60 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.385672:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba2e60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.385687:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2e67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.385694:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2e67 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.385699:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2e67 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.385703:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cc000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384522.385706:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2e67 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.385711:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2e67 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.385719:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c294fb00) 00010000:00010000:3.0:1787384522.385721:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384522.385724:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2e67 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.385729:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2e67 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384522.386825:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+20:11320:x1874208182291072:12345-192.168.203.45@tcp:34:lfs.0 Request processed in 3231us (3692us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384522.386846:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 95 00000100:00100000:3.0:1787384522.511457:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384522.511567:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182291328 00000100:00100000:2.0:1787384522.511577:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182291328 00000100:00100000:2.0:1787384522.511636:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 96 00000100:00100000:2.0:1787384522.511646:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4268a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+20:11323:x1874208182291328:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:2.0:1787384522.511665:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384522.511685:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba2e6e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3804 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.513356:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba2e75 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.513378:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba2e75 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.513392:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba2e75 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.513586:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2e7c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.513596:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2e7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.513604:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2e7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.513721:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba2e83 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.513730:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba2e83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.513737:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba2e83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384522.513748:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787384522.516625:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba2e75 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.516642:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba2e75 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.516649:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba2e75 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.516675:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965a200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384522.516680:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba2e75 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.516687:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba2e75 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.516703:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f8fd1ea700) 00010000:00010000:3.0:1787384522.516706:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384522.516710:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba2e75 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.516716:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba2e75 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.516731:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2e7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.516737:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2e7c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.516744:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2e7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.516749:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cc000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384522.516752:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2e7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.516758:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2e7c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.516821:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f7c294fb00) 00010000:00010000:3.0:1787384522.516825:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384522.516828:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2e7c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.516835:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2e7c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.516887:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba2e6e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3804 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.516901:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba2e83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3804 expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.516908:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c294f900) 00010000:00010000:3.0:1787384522.516910:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787384522.516912:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cdc00, rc 0) 00000100:00100000:3.0:1787384522.516975:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4268a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+22:11323:x1874208182291328:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 5329us (5528us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1787384522.516983:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 96 00000100:00100000:0.0:1787384522.524895:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384522.525131:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182291456 00000100:00100000:1.0:1787384522.525140:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182291456 00000100:00100000:1.0:1787384522.525206:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 97 00000100:00100000:1.0:1787384522.525217:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+22:11323:x1874208182291456:12345-192.168.203.45@tcp:54:lfs.0 00010000:00010000:1.0:1787384522.525281:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952600/0x7ef423838fba2e91 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384522.525311:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952600/0x7ef423838fba2e91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384522.525341:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952600/0x7ef423838fba2e91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384522.525375:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952600/0x7ef423838fba2e91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384522.525382:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952600/0x7ef423838fba2e91 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384522.525387:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952600/0x7ef423838fba2e91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384522.525393:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3952600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384522.525397:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952600/0x7ef423838fba2e91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384522.525404:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952600/0x7ef423838fba2e91 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384522.525428:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c294f900) 00010000:00010000:1.0:1787384522.525431:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787384522.525436:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952600/0x7ef423838fba2e91 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384522.525441:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952600/0x7ef423838fba2e91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384522.525514:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+22:11323:x1874208182291456:12345-192.168.203.45@tcp:54:lfs.0 Request processed in 299us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384522.525522:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 97 00000100:00100000:3.0:1787384522.529711:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384522.531608:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182291712 00000100:00100000:2.0:1787384522.531624:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182291712 00000100:00100000:2.0:1787384522.531703:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 21 00000100:00100000:2.0:1787384522.531716:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9504050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+22:11323:x1874208182291712:12345-192.168.203.45@tcp:35:lfs.0 00000100:00100000:2.0:1787384522.532013:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9504050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+23:11323:x1874208182291712:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 300us (2311us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1787384522.532021:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 21 00000100:00100000:3.0:1787384522.599710:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384522.601848:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182291840 00000100:00100000:0.0:1787384522.601864:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182291840 00000100:00100000:0.0:1787384522.601936:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 381 00000100:00100000:0.0:1787384522.601948:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9458c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+13:2414:x1874208182291840:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384522.602195:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384522.602284:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384522.602323:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9458c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+13:2414:x1874208182291840:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 377us (2625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384522.602332:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 381 00000100:00100000:3.0:1787384522.602342:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182292352 00000100:00100000:3.0:1787384522.602346:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182292352 00000100:00080000:0.0:1787384522.602374:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787384522.602391:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 303 00000100:00100000:3.0:1787384522.602399:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182292352:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384522.602577:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182292096 00000100:00100000:1.0:1787384522.602598:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182292096 00000100:00100000:1.0:1787384522.602639:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 106 00000100:00100000:1.0:1787384522.602647:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2414:x1874208182292096:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384522.603768:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384522.603819:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384522.603853:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384522.603908:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182291968 00000100:00100000:2.0:1787384522.603913:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182291968 00000100:00100000:2.0:1787384522.603950:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182292480 00000100:00100000:2.0:1787384522.603953:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182292480 00000100:00100000:2.0:1787384522.603968:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 304 00000100:00100000:0.0:1787384522.604451:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182292224 00000100:00100000:0.0:1787384522.604457:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182292224 00000100:00100000:0.0:1787384522.604495:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 107 00000100:00100000:0.0:1787384522.604504:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:2414:x1874208182292224:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384522.604573:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:2414:x1874208182292224:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 70us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384522.604580:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 107 00000100:00080000:0.0:1787384522.604605:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787384522.604608:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787384522.604682:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2414:x1874208182291968:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384522.604722:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2414:x1874208182291968:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 44us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384522.604745:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 305 00000100:00100000:0.0:1787384522.604754:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182292480:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384522.604798:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182292480:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 45us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384522.604804:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 305 00000100:00100000:2.0:1787384522.605427:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 304 00000100:00100000:3.0:1787384522.605486:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182292352:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 3085us (3199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384522.605502:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 303 00000100:00100000:1.0:1787384522.605556:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2414:x1874208182292096:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 2908us (3369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384522.605565:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 106 00000100:00100000:2.0:1787384522.613144:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384522.613304:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182292736 00000100:00100000:0.0:1787384522.613314:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182292736 00000100:00100000:0.0:1787384522.613420:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 98 00000100:00100000:0.0:1787384522.613431:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+23:10848:x1874208182292736:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:0.0:1787384522.613455:0:14031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384522.613474:0:14031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba2e98 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce380b expref: -99 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.613574:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2e9f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.613589:0:14031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba2e83 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3804 expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.613597:0:14031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2e9f lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.613648:0:14031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba2e83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3804 expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.613661:0:14031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba2e83 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3804 expref: 24 pid: 6522 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384522.613675:0:14031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4306680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14031:1874208203346816:192.168.203.45@tcp:104: 00000100:00100000:0.0:1787384522.613821:0:14031:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2aac300 going to sleep for 11 seconds 00000100:00100000:0.0:1787384522.619948:0:14031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4306680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14031:1874208203346816:192.168.203.45@tcp:104: 00010000:00010000:0.0:1787384522.619990:0:14031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2e9f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384522.621681:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384522.622134:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182292864 00000100:00100000:1.0:1787384522.622144:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182292864 00010000:00010000:1.0:1787384522.622183:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba2e83 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3804 expref: 25 pid: 6522 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384522.622235:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 65 00000100:00100000:1.0:1787384522.622246:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+25:2415:x1874208182292864:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384522.622260:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384522.622267:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba2e83 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3804 expref: 25 pid: 6522 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384522.622280:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba2e83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3804 expref: 25 pid: 6522 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384522.622300:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba2e83 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3804 expref: 25 pid: 6522 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384522.622317:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c294f900) 00010000:00010000:1.0:1787384522.622322:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2e9f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384522.622348:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2e9f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384522.622355:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2e9f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384522.622387:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384522.622451:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+24:2415:x1874208182292864:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 207us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384522.622459:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 65 00010000:00010000:0.0:1787384522.622699:0:14031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2e9f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.622708:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2e9f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384522.622728:0:14031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787384522.622917:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba2e98 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce380b expref: 25 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.622933:0:14031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2e9f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce380b expref: 24 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.622940:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c294f900) 00010000:00010000:0.0:1787384522.622943:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787384522.622953:0:14031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6140000, rc 0) 00000100:00100000:0.0:1787384522.623218:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+24:10848:x1874208182292736:12345-192.168.203.45@tcp:101:bash.0 Request processed in 9788us (10084us total) trans 4294967368 rc 0/0 00000100:00100000:0.0:1787384522.623228:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 98 00000100:00100000:2.0:1787384522.628542:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384522.632318:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182292992 00000100:00100000:0.0:1787384522.632334:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182292992 00000100:00100000:0.0:1787384522.632405:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 99 00000100:00100000:0.0:1787384522.632415:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+24:10848:x1874208182292992:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:0.0:1787384522.632443:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384522.632463:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba2ead lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3812 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.632496:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba2eb4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.632510:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba2eb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.632522:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba2eb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.632635:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba2ead lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3812 expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.632654:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba2eb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3812 expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.632663:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c294f900) 00010000:00010000:0.0:1787384522.632666:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787384522.632678:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6141e00, rc 0) 00000100:00100000:0.0:1787384522.633015:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+25:10848:x1874208182292992:12345-192.168.203.45@tcp:101:bash.0 Request processed in 600us (4482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384522.633022:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 99 00000100:00100000:2.0:1787384522.637654:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384522.638077:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182293248 00000100:00100000:3.0:1787384522.638086:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182293248 00000100:00100000:3.0:1787384522.638148:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 100 00000100:00100000:3.0:1787384522.638158:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+25:10848:x1874208182293248:12345-192.168.203.45@tcp:36:bash.0 00010000:00010000:3.0:1787384522.638414:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2ebb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.638432:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2ebb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.638445:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2ebb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787384522.638488:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:3.0:1787384522.638511:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005ced1460 reply state 000000009af0f408 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2ebb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.638524:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2ebb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.638531:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c294f900) 00010000:00010000:3.0:1787384522.638535:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787384522.638538:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787384522.638578:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:3.0:1787384522.638680:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+29:10848:x1874208182293248:12345-192.168.203.45@tcp:36:bash.0 Request processed in 522us (1033us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1787384522.638687:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 100 00000020:00080000:3.0:1787384522.638692:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787384522.641347:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384522.641481:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182293376 00000100:00100000:0.0:1787384522.641491:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182293376 00000100:00100000:0.0:1787384522.641548:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 101 00000100:00100000:0.0:1787384522.641557:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4268e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+29:10848:x1874208182293376:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:0.0:1787384522.641581:0:14031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384522.641601:0:14031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba2ec2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3819 expref: -99 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.641657:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba2ec2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3819 expref: 30 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.641672:0:14031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba2ec2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3819 expref: 30 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.641690:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c294f900) 00010000:00010000:0.0:1787384522.641694:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787384522.641697:0:14031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6140c00, rc 0) 00000100:00100000:0.0:1787384522.641761:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4268e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+30:10848:x1874208182293376:12345-192.168.203.45@tcp:101:bash.0 Request processed in 204us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384522.642233:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 101 00000100:00100000:2.0:1787384522.645606:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384522.645988:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182293504 00000100:00100000:0.0:1787384522.645999:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182293504 00000100:00100000:0.0:1787384522.646061:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 41 00000100:00100000:0.0:1787384522.646081:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:10848:x1874208182293504:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:0.0:1787384522.646107:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384522.646130:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016504a0a/0x7ef423838fba2ec9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3820 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787384522.646157:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a8952c7, atime: 0x6a8952c6, ctime: 0x6a8952c7, blocks: 0x8 00010000:00010000:0.0:1787384522.646181:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=417s v=(0 0) 00010000:00010000:0.0:1787384522.646185:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384522.646440:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016504a0a/0x7ef423838fba2ec9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3820 expref: 7 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.646459:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000016504a0a/0x7ef423838fba2ec9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3820 expref: 7 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.646473:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6141200, rc 0) 00000100:00100000:0.0:1787384522.646542:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:10848:x1874208182293504:12345-192.168.203.45@tcp:101:bash.0 Request processed in 464us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384522.646549:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 41 00000100:00100000:2.0:1787384522.649451:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384522.649600:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182293632 00000100:00100000:0.0:1787384522.649609:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182293632 00002000:00010000:0.0:1787384522.649648:0:8442:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1787384522.649653:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98f8f7f04a80 with x1874208182293632 ext(0->18446744073709551615) 00002000:00010000:0.0:1787384522.649664:0:8442:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98f8f7f04a80. 00000100:00100000:0.0:1787384522.649702:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 1 00000100:00100000:0.0:1787384522.649711:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:2416:x1874208182293632:12345-192.168.203.45@tcp:10:bash.0 00002000:00010000:0.0:1787384522.650214:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787384522.650227:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1787384519 -> 1787384521 00002000:00010000:0.0:1787384522.650230:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1787384518 -> 1787384518 00002000:00010000:0.0:1787384522.650232:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1787384519 -> 1787384521 00002000:00010000:0.0:1787384522.650235:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1787384522.650299:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+8:2416:x1874208182293632:12345-192.168.203.45@tcp:10:bash.0 Request processed in 587us (856us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787384522.650306:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 1 00002000:00010000:0.0:1787384522.650309:0:8442:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1787384522.650311:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98f8f7f04a80 with x1874208182293632 ext(0->18446744073709551615) 00002000:00010000:0.0:1787384522.650316:0:8442:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98f8f7f04a80. 00010000:00010000:1.0:1787384522.679527:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384522.763274:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384522.764516:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182293760 00000100:00100000:2.0:1787384522.764530:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182293760 00000100:00100000:2.0:1787384522.764613:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 102 00000100:00100000:2.0:1787384522.764623:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4269c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+30:11337:x1874208182293760:12345-192.168.203.45@tcp:34:lfs.0 00010000:00010000:2.0:1787384522.764706:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2ed0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.764724:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2ed0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.764736:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2ed0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.764751:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2ed7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.764758:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.764763:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.764895:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba2ede lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.764905:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba2ede lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.764912:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba2ede lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787384522.764957:0:8195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba2ede lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.764969:0:8195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2ed0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.764976:0:8195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2ed0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.764983:0:8195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2ed0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.764990:0:8195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965b600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384522.764994:0:8195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2ed0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.765001:0:8195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2ed0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.765013:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f8fd1ea700) 00010000:00010000:2.0:1787384522.765016:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384522.765020:0:8195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2ed0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.765033:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2ed0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.765048:0:8195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.765054:0:8195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2ed7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.765059:0:8195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2ed7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.765073:0:8195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965aa00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384522.765077:0:8195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2ed7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.765083:0:8195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2ed7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.765092:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f8e8aa4200) 00010000:00010000:2.0:1787384522.765095:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384522.765098:0:8195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2ed7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.765104:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2ed7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.765119:0:8195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba2ede lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.765125:0:8195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba2ede lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.765137:0:8195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba2ede lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.765142:0:8195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965a600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384522.765146:0:8195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba2ede lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.765152:0:8195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba2ede lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.765161:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c294f900) 00010000:00010000:2.0:1787384522.765163:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384522.765166:0:8195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba2ede lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.765172:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba2ede lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384522.765257:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4269c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+30:11337:x1874208182293760:12345-192.168.203.45@tcp:34:lfs.0 Request processed in 635us (1991us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384522.765266:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 102 00000100:00100000:2.0:1787384522.843927:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384522.844266:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182294016 00000100:00100000:0.0:1787384522.844276:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182294016 00000100:00100000:0.0:1787384522.844340:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 103 00000100:00100000:0.0:1787384522.844349:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+30:11340:x1874208182294016:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:0.0:1787384522.844369:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384522.844389:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba2ee5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3827 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.844456:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2eec lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.844470:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2eec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.844480:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2eec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.844494:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2ef3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.844514:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2ef3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.844521:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2ef3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.844642:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba2efa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.844651:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba2efa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.844658:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba2efa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384522.844667:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787384522.844748:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2eec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.844756:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2eec lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.844763:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2eec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.844770:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384522.844774:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2eec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.844823:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2eec lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.844846:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f8fd1ea700) 00010000:00010000:0.0:1787384522.844849:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384522.844854:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2eec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.844861:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2eec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.844874:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2ef3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.844880:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2ef3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.844886:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2ef3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.844892:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384522.844895:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2ef3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.844901:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2ef3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.844908:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f7c3a9cc00) 00010000:00010000:0.0:1787384522.844910:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384522.844913:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2ef3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.844919:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2ef3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.844965:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba2ee5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3827 expref: 33 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.844977:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba2efa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3827 expref: 32 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.844984:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c294f900) 00010000:00010000:0.0:1787384522.844986:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787384522.844988:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6141c00, rc 0) 00000100:00100000:0.0:1787384522.846652:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+32:11340:x1874208182294016:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 2293us (2723us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1787384522.846664:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 103 00000100:00100000:0.0:1787384522.851773:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384522.851903:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182294144 00000100:00100000:2.0:1787384522.851914:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182294144 00000100:00100000:2.0:1787384522.851976:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 104 00000100:00100000:2.0:1787384522.851987:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+32:11340:x1874208182294144:12345-192.168.203.45@tcp:54:lfs.0 00010000:00010000:2.0:1787384522.852078:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba2f08 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.852111:0:14031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2e9f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce380b expref: 32 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.852120:0:14031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba2f08 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.852156:0:14031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2e9f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce380b expref: 32 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.852171:0:14031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2e9f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce380b expref: 32 pid: 14031 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384522.852186:0:14031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7f05c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14031:1874208203346944:192.168.203.45@tcp:104: 00000100:00100000:2.0:1787384522.852285:0:14031:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c6361d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787384522.860198:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384522.860295:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182294400 00000100:00100000:1.0:1787384522.860305:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182294400 00000100:00100000:1.0:1787384522.860369:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 22 00000100:00100000:1.0:1787384522.860381:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+33:6183:x1874208182294400:12345-192.168.203.45@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787384522.860704:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+34:6183:x1874208182294400:12345-192.168.203.45@tcp:35:ldlm_bl.0 Request processed in 324us (515us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1787384522.860712:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 22 00000100:00100000:3.0:1787384522.863850:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384522.863950:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182294528 00000100:00100000:0.0:1787384522.863959:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182294528 00010000:00010000:0.0:1787384522.864009:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2e9f lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce380b expref: 34 pid: 14031 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384522.864049:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 66 00000100:00100000:0.0:1787384522.864058:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c426ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+34:2413:x1874208182294528:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787384522.864083:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384522.864091:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2e9f lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce380b expref: 34 pid: 14031 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.864104:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2e9f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce380b expref: 34 pid: 14031 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.864140:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c294f900) 00010000:00010000:0.0:1787384522.864145:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba2f08 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.864154:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba2f08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.864162:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba2f08 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.864180:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384522.864246:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c426ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+34:2413:x1874208182294528:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 189us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384522.864254:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 66 00010000:00010000:2.0:1787384522.867427:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba2e9f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce380b expref: 33 pid: 14031 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384522.867457:0:14031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7f05c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14031:1874208203346944:192.168.203.45@tcp:104: 00010000:00010000:2.0:1787384522.867483:0:14031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba2f08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.867494:0:14031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba2f08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.867499:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba2f08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.867547:0:14031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba2f08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.867584:0:14031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba2f08 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.867591:0:14031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba2f08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.867597:0:14031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965a600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384522.867601:0:14031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba2f08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.867609:0:14031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba2f08 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.867626:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c294f900) 00010000:00010000:2.0:1787384522.867630:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787384522.867634:0:14031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba2f08 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.867639:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba2f08 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384522.867724:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+32:11340:x1874208182294144:12345-192.168.203.45@tcp:54:lfs.0 Request processed in 15738us (15961us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384522.867734:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 104 00000100:00100000:3.0:1787384522.884991:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384522.888203:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182294784 00000100:00100000:1.0:1787384522.888219:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182294784 00000100:00100000:1.0:1787384522.888291:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 23 00000100:00100000:1.0:1787384522.888301:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4269880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+32:11340:x1874208182294784:12345-192.168.203.45@tcp:35:lfs.0 00000100:00100000:1.0:1787384522.888526:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4269880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+33:11340:x1874208182294784:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 226us (3555us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1787384522.888534:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 23 00000100:00100000:3.0:1787384523.024046:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384523.024160:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182295040 00000100:00100000:2.0:1787384523.024169:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182295040 00000100:00100000:2.0:1787384523.024247:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 105 00000100:00100000:2.0:1787384523.024260:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4268380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+33:11351:x1874208182295040:12345-192.168.203.45@tcp:101:cat.0 00010000:00010000:2.0:1787384523.024287:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384523.024321:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba2f0f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce382e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.024389:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2f16 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.024404:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2f16 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.024417:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2f16 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.024431:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2f1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.024437:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2f1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.024443:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2f1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.024551:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba2f24 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.024559:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba2f24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.024566:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba2f24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384523.024576:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1787384523.024648:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2f16 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.025030:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2f16 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.025036:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2f16 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.025041:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965aa00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384523.025046:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2f16 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.025053:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2f16 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.025075:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f8fd1ea700) 00010000:00010000:2.0:1787384523.025078:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384523.025084:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2f16 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.025091:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2f16 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.025111:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2f1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.025119:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2f1d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.025126:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2f1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.025132:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965b600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384523.025149:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2f1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.025158:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2f1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.025170:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f8e8aa4200) 00010000:00010000:2.0:1787384523.025173:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384523.025177:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2f1d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.025185:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2f1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.025231:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba2f0f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce382e expref: 36 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.025246:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba2f24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce382e expref: 35 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.025252:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c294f900) 00010000:00010000:2.0:1787384523.025256:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787384523.025259:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965b200, rc 0) 00000100:00080000:0.0:1787384523.025451:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384523.029427:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4268380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+35:11351:x1874208182295040:12345-192.168.203.45@tcp:101:cat.0 Request processed in 5158us (5378us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1787384523.029439:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 105 00000100:00100000:3.0:1787384523.036957:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384523.039170:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182295296 00000100:00100000:0.0:1787384523.039186:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182295296 00000100:00100000:0.0:1787384523.039262:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 24 00000100:00100000:0.0:1787384523.039273:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c426b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+35:11351:x1874208182295296:12345-192.168.203.45@tcp:35:cat.0 00000100:00100000:0.0:1787384523.039564:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c426b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+36:11351:x1874208182295296:12345-192.168.203.45@tcp:35:cat.0 Request processed in 292us (2624us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1787384523.039572:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 24 00000100:00100000:3.0:1787384523.075766:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384523.075897:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182295552 00000100:00100000:0.0:1787384523.075906:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182295552 00000100:00100000:0.0:1787384523.075956:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 106 00000100:00100000:0.0:1787384523.075964:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4268700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+36:11352:x1874208182295552:12345-192.168.203.45@tcp:36:rm.0 00010000:00010000:0.0:1787384523.076014:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1787384523.076049:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba2ec2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3819 expref: 36 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.076079:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba2f24 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce382e expref: 35 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.076092:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba2efa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3827 expref: 34 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.076102:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba2eb4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3812 expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.076111:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c294f900) 00010000:00010000:0.0:1787384523.076115:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787384523.076135:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba2f32 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.076147:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba2f32 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.076155:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba2f32 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.076167:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2f39 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.076174:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2f39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.076180:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2f39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.076267:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2f40 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.076275:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2f40 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.076281:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2f40 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787384523.076486:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:0.0:1787384523.076495:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 418156715663ns, next at 419156713357ns, rc = 0 00010000:00010000:0.0:1787384523.076533:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba2f47 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.076541:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba2f47 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.076549:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba2f47 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.076555:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba2f47 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.076562:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba2f47 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.076568:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba2f47 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.076593:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787384523.076608:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2f40 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.076619:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2f40 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.076625:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2f40 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.076631:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384523.076636:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2f40 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.076643:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2f40 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.076651:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c294f900) 00010000:00010000:0.0:1787384523.076654:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787384523.076657:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2f40 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.076663:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba2f40 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.076676:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba2f32 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.076682:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba2f32 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.076688:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba2f32 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.076693:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384523.076699:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba2f32 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.076706:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba2f32 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.076713:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f8fd1ea700) 00010000:00010000:0.0:1787384523.076715:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384523.076717:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba2f32 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.076723:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba2f32 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787384523.076731:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000049cd0a1c reply state 00000000dbefa734 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2f39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.076740:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2f39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.076746:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f7c3a9cc00) 00010000:00010000:0.0:1787384523.076748:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787384523.076750:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787384523.076840:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1787384523.076845:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4268700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+34:11352:x1874208182295552:12345-192.168.203.45@tcp:36:rm.0 Request processed in 881us (1098us total) trans 4294967377 rc 0/0 00010000:00010000:2.0:1787384523.076847:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba2f47 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384523.076853:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 106 00010000:00010000:2.0:1787384523.076862:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6141400 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:2.0:1787384523.076865:0:8453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba2f47 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.076871:0:8453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba2f47 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.076879:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c294f900) 00010000:00010000:2.0:1787384523.076881:0:8453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787384523.076884:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba2f47 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.076890:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba2f47 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.076905:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384523.076907:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384523.076909:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384523.146048:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384523.146163:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182295808 00000100:00100000:2.0:1787384523.146172:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182295808 00000100:00100000:2.0:1787384523.146246:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 107 00000100:00100000:2.0:1787384523.146255:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c426a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+34:11358:x1874208182295808:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:2.0:1787384523.146277:0:14031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384523.146297:0:14031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba2f4e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3835 expref: -99 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.146411:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2f55 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.146448:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2f55 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.146461:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2f55 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.146475:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2f5c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.146483:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2f5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.146489:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2f5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787384523.146861:0:14031:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:2.0:1787384523.147000:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba2f63 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.147011:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba2f63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.147019:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba2f63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.147050:0:14031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2f55 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.147057:0:14031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2f55 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.147073:0:14031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2f55 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.147087:0:14031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965b600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384523.147091:0:14031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2f55 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.147099:0:14031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2f55 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.147111:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f8fd1ea700) 00010000:00010000:2.0:1787384523.147115:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384523.147119:0:14031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2f55 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.147125:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2f55 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787384523.147138:0:14031:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001c9bfdac reply state 00000000a9dd2558 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2f5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.147148:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2f5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.147155:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f7c3a9cc00) 00010000:00010000:2.0:1787384523.147157:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787384523.147159:0:14031:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787384523.147186:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba2f4e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3835 expref: 37 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.147201:0:14031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba2f63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3835 expref: 36 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.147219:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f8e8aa4200) 00010000:00010000:2.0:1787384523.147222:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787384523.147224:0:14031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965a800, rc 0) 00000100:00100000:2.0:1787384523.147292:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c426a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+37:11358:x1874208182295808:12345-192.168.203.45@tcp:101:bash.0 Request processed in 1037us (1254us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1787384523.147301:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 107 00000100:00100000:3.0:1787384523.151581:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384523.151761:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182295936 00000100:00100000:0.0:1787384523.151772:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182295936 00000100:00100000:0.0:1787384523.151863:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 42 00000100:00100000:0.0:1787384523.151873:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4269500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:2416:x1874208182295936:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:0.0:1787384523.151891:0:8890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384523.151925:0:8890:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000678a5ba/0x7ef423838fba2f71 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce383c expref: -99 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787384523.151950:0:8890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384523.151967:0:8890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=418s v=(0 0) 00010000:00010000:0.0:1787384523.151972:0:8890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384523.151993:0:8890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000678a5ba/0x7ef423838fba2f71 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce383c expref: 8 pid: 8890 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.152011:0:8890:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000678a5ba/0x7ef423838fba2f71 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce383c expref: 8 pid: 8890 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.152024:0:8890:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6140400, rc 0) 00000100:00100000:0.0:1787384523.152298:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4269500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+8:2416:x1874208182295936:12345-192.168.203.45@tcp:101:bash.0 Request processed in 425us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384523.152306:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 42 00000100:00100000:3.0:1787384523.158912:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384523.159018:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182296064 00000100:00100000:2.0:1787384523.159027:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182296064 00000100:00100000:2.0:1787384523.159097:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 43 00000100:00100000:2.0:1787384523.159107:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c426b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+8:11358:x1874208182296064:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:2.0:1787384523.159124:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384523.159143:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a34b8689/0x7ef423838fba2f78 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3843 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.159175:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000678a5ba/0x7ef423838fba2f71 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce383c expref: 9 pid: 8890 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.159184:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384523.159199:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384523.159206:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a34b8689/0x7ef423838fba2f78 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3843 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.159243:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000678a5ba/0x7ef423838fba2f71 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce383c expref: 9 pid: 8890 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.159279:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000678a5ba/0x7ef423838fba2f71 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce383c expref: 9 pid: 8890 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384523.159294:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7f05c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1874208203347072:192.168.203.45@tcp:104: 00000100:00100000:2.0:1787384523.159387:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fc1d8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384523.163417:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384523.163567:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182296192 00000100:00100000:1.0:1787384523.163590:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182296192 00010000:00010000:1.0:1787384523.163631:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000678a5ba/0x7ef423838fba2f71 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce383c expref: 10 pid: 8890 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384523.163678:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 67 00000100:00100000:1.0:1787384523.163688:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb127480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+10:2415:x1874208182296192:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384523.163704:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384523.163725:0:10399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000678a5ba/0x7ef423838fba2f71 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce383c expref: 10 pid: 8890 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384523.163739:0:10399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000678a5ba/0x7ef423838fba2f71 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce383c expref: 10 pid: 8890 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384523.163767:0:10399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384523.163772:0:10399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384523.163812:0:10399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a34b8689/0x7ef423838fba2f78 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3843 expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384523.163823:0:10399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a34b8689/0x7ef423838fba2f78 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3843 expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384523.163863:0:10399:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a34b8689/0x7ef423838fba2f78 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3843 expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384523.163878:0:10399:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9b54e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10399:1874208203347200:192.168.203.45@tcp:105: 00000100:00100000:1.0:1787384523.163978:0:10399:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8e8ab9180 going to sleep for 11 seconds 00010000:00010000:2.0:1787384523.165769:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000678a5ba/0x7ef423838fba2f71 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce383c expref: 10 pid: 8890 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384523.165932:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7f05c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1874208203347072:192.168.203.45@tcp:104: 00010000:00010000:2.0:1787384523.165970:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a34b8689/0x7ef423838fba2f78 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3843 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.165985:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965a600, rc 0) 00000100:00100000:2.0:1787384523.169412:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c426b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+9:11358:x1874208182296064:12345-192.168.203.45@tcp:101:bash.0 Request processed in 10293us (10496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384523.169426:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 43 00000100:00100000:0.0:1787384523.169738:0:10399:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9b54e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10399:1874208203347200:192.168.203.45@tcp:105: 00010000:00010000:0.0:1787384523.169759:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384523.169821:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb127480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+8:2415:x1874208182296192:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 6135us (6415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384523.169831:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 67 00000100:00100000:3.0:1787384523.177042:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384523.177222:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182296448 00000100:00100000:0.0:1787384523.177233:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182296448 00000100:00100000:0.0:1787384523.177295:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 25 00000100:00100000:0.0:1787384523.177305:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9175c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+37:11358:x1874208182296448:12345-192.168.203.45@tcp:35:bash.0 00000100:00100000:0.0:1787384523.177602:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9175c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+38:11358:x1874208182296448:12345-192.168.203.45@tcp:35:bash.0 Request processed in 298us (570us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1787384523.177625:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 25 00000100:00100000:3.0:1787384523.472998:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384523.473305:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182296576 00000100:00100000:2.0:1787384523.473315:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182296576 00000100:00100000:2.0:1787384523.473379:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 108 00000100:00100000:2.0:1787384523.473389:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9175500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+38:11374:x1874208182296576:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:2.0:1787384523.473414:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384523.473436:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba2f7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce384a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.473523:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a000/0x7ef423838fba2f86 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.473537:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a000/0x7ef423838fba2f86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.473548:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a000/0x7ef423838fba2f86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384523.473665:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1787384523.473669:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787384523.473689:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a000/0x7ef423838fba2f86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.473714:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba2f7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce384a expref: 40 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.473731:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a000/0x7ef423838fba2f86 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce384a expref: 39 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.473740:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f8fd1ea700) 00010000:00010000:2.0:1787384523.474194:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787384523.474201:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965a000, rc 0) 00000100:00100000:2.0:1787384523.474275:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9175500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+39:11374:x1874208182296576:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 887us (1284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384523.474283:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 108 00000100:00100000:2.0:1787384523.483375:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384523.484093:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182296832 00000100:00100000:3.0:1787384523.484105:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182296832 00000100:00100000:3.0:1787384523.484178:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 109 00000100:00100000:3.0:1787384523.484197:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+39:11374:x1874208182296832:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:3.0:1787384523.484224:0:8195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384523.484251:0:8195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2f8d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3851 expref: -99 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.484379:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba2f94 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.484393:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba2f94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.484404:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba2f94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384523.484435:0:8195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787384523.484871:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2f8d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3851 expref: 42 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.484890:0:8195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba2f94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3851 expref: 41 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.484899:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f8e8aa4200) 00010000:00010000:3.0:1787384523.484902:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787384523.484904:0:8195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cda00, rc 0) 00000100:00100000:3.0:1787384523.486041:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+41:11374:x1874208182296832:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 1846us (2669us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1787384523.486053:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 109 00000100:00100000:3.0:1787384523.492160:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384523.495321:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182297088 00000100:00100000:0.0:1787384523.495337:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182297088 00000100:00100000:0.0:1787384523.495419:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 110 00000100:00100000:0.0:1787384523.495430:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9176300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+41:11374:x1874208182297088:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:0.0:1787384523.495455:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384523.495476:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba2fa2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3858 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.495593:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba2fa9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.495608:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba2fa9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.495619:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba2fa9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384523.495631:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787384523.495739:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba2fa2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3858 expref: 44 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.495760:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba2fa9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3858 expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.495769:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f8e8aa4200) 00010000:00010000:0.0:1787384523.495773:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787384523.495816:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6140c00, rc 0) 00000100:00100000:0.0:1787384523.495903:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9176300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+43:11374:x1874208182297088:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 474us (3753us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1787384523.495912:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 110 00000100:00100000:3.0:1787384523.496014:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384523.496042:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182297216 00000100:00100000:3.0:1787384523.496045:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182297216 00000100:00100000:3.0:1787384523.496085:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 7 00000100:00100000:3.0:1787384523.496092:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9174e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+43:2413:x1874208182297216:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384523.496102:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384523.496116:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba2f94 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3851 expref: 43 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.496128:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f8e8aa4200) 00010000:00010000:3.0:1787384523.496132:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384523.496149:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9174e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+42:2413:x1874208182297216:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 58us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384523.496161:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 7 00000100:00100000:3.0:1787384523.503321:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384523.503548:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182297344 00000100:00100000:1.0:1787384523.503559:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182297344 00000100:00100000:1.0:1787384523.503612:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 44 00000100:00100000:1.0:1787384523.503622:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9174380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+8:2414:x1874208182297344:12345-192.168.203.45@tcp:1:lfs.0 00010000:00010000:1.0:1787384523.503699:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000502a05d1/0x7ef423838fba2fb7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384523.503719:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a34b8689/0x7ef423838fba2f78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3843 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384523.503727:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384523.503731:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787384523.503735:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000502a05d1/0x7ef423838fba2fb7 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384523.503771:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a34b8689/0x7ef423838fba2f78 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3843 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384523.503815:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a34b8689/0x7ef423838fba2f78 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3843 expref: 8 pid: 8436 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384523.503832:0:8435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9b57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874208203347328:192.168.203.45@tcp:104: 00000100:00100000:1.0:1787384523.503915:0:8435:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8e8ab9180 going to sleep for 11 seconds 00000100:00100000:0.0:1787384523.507305:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384523.507441:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182297472 00000100:00100000:3.0:1787384523.507451:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182297472 00002000:00100000:3.0:1787384523.507513:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff98f7c4307800 x1874208182297472/t0(0) o4->55e96ad5-fd9d-44d4-856e-5db0c40b1329@192.168.203.45@tcp:554/0 lens 504/0 e 0 to 0 dl 1787384534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787384523.507523:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98f7c4307800 with x1874208182297472 ext(0->8) 00010000:00010000:3.0:1787384523.507533:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a34b8689/0x7ef423838fba2f78 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3843 expref: 9 pid: 8436 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.507550:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a34b8689/0x7ef423838fba2f78 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3843 expref: 9 pid: 8436 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787384523.507558:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98f7c4307800 00000100:00100000:3.0:1787384523.507598:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 1 00000100:00100000:3.0:1787384523.507607:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+9:2415:x1874208182297472:12345-192.168.203.45@tcp:4:lfs.0 00000100:00100000:1.0:1787384523.510354:0:8435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9b57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874208203347328:192.168.203.45@tcp:104: 00010000:00010000:1.0:1787384523.510386:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000502a05d1/0x7ef423838fba2fb7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384523.510718:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+11:2415:x1874208182297472:12345-192.168.203.45@tcp:4:lfs.0 Request processed in 3109us (3419us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787384523.510731:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 1 00002000:00100000:3.0:1787384523.510745:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff98f7c4307800 x1874208182297472/t4294967303(0) o4->55e96ad5-fd9d-44d4-856e-5db0c40b1329@192.168.203.45@tcp:554/0 lens 504/448 e 0 to 0 dl 1787384534 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787384523.510755:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98f7c4307800 with x1874208182297472 ext(0->8) 00010000:00010000:3.0:1787384523.510765:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a34b8689/0x7ef423838fba2f78 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3843 expref: 11 pid: 8436 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.510835:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a34b8689/0x7ef423838fba2f78 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3843 expref: 11 pid: 8436 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787384523.510843:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98f7c4307800 00000100:00100000:3.0:1787384523.516547:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384523.517503:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182297600 00000100:00100000:1.0:1787384523.517515:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182297600 00010000:00010000:2.0:1787384523.522747:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a34b8689/0x7ef423838fba2f78 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3843 expref: 11 pid: 8436 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384523.522907:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 68 00000100:00100000:2.0:1787384523.522919:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b47450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+11:2416:x1874208182297600:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384523.522935:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787384523.522953:0:8463:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787384523.522956:0:8463:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787384522 00002000:00010000:2.0:1787384523.522958:0:8463:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787384522 00002000:00010000:2.0:1787384523.522961:0:8463:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1787384522 00002000:00010000:2.0:1787384523.522963:0:8463:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1787384523.522969:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a34b8689/0x7ef423838fba2f78 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3843 expref: 11 pid: 8436 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.522984:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a34b8689/0x7ef423838fba2f78 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3843 expref: 11 pid: 8436 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.523009:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a34b8689/0x7ef423838fba2f78 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3843 expref: 11 pid: 8436 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.523026:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787384523.523031:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787384523.523037:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000502a05d1/0x7ef423838fba2fb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.523048:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000502a05d1/0x7ef423838fba2fb7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.523108:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384523.523169:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b47450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+10:2416:x1874208182297600:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 253us (6632us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384523.523177:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 68 00010000:00010000:1.0:1787384523.524414:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000502a05d1/0x7ef423838fba2fb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384523.524434:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000502a05d1/0x7ef423838fba2fb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384523.524466:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000502a05d1/0x7ef423838fba2fb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384523.524476:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000502a05d1/0x7ef423838fba2fb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384523.524487:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000502a05d1/0x7ef423838fba2fb7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384523.524496:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3953800 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384523.524502:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000502a05d1/0x7ef423838fba2fb7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384523.524512:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000502a05d1/0x7ef423838fba2fb7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384523.524531:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000502a05d1/0x7ef423838fba2fb7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384523.524554:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000502a05d1/0x7ef423838fba2fb7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384523.524670:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9174380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+9:2414:x1874208182297344:12345-192.168.203.45@tcp:1:lfs.0 Request processed in 21045us (21354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384523.524680:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 44 00000100:00100000:0.0:1787384523.537421:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384523.537707:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182297856 00000100:00100000:3.0:1787384523.537717:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182297856 00000100:00100000:3.0:1787384523.537805:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 26 00000100:00100000:3.0:1787384523.537817:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9505850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+42:11374:x1874208182297856:12345-192.168.203.45@tcp:35:lfs.0 00000004:00010000:3.0:1787384523.537881:0:6525:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba2fa9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3858 expref: 42 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787384523.538112:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:3.0:1787384523.538140:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1787384523.538695:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:3.0:1787384523.538733:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba2fbe lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.538746:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba2f63 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3835 expref: 46 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.538755:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba2fbe lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.538805:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba2f63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3835 expref: 46 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.538829:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba2f63 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3835 expref: 46 pid: 14031 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384523.538844:0:6525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9174e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1874208203347456:192.168.203.45@tcp:104: 00000100:00100000:3.0:1787384523.538926:0:6525:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d829ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1787384523.544846:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384523.544999:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182297984 00000100:00100000:2.0:1787384523.545008:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182297984 00010000:00010000:2.0:1787384523.545048:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba2f63 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3835 expref: 47 pid: 14031 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384523.545090:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 69 00000100:00100000:2.0:1787384523.545101:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d8530e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+47:2415:x1874208182297984:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384523.545118:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384523.545124:0:10399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba2f63 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3835 expref: 47 pid: 14031 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.545138:0:10399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba2f63 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3835 expref: 47 pid: 14031 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.545162:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f8e8aa4200) 00010000:00010000:2.0:1787384523.545167:0:10399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba2fbe lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.545177:0:10399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba2fbe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.545185:0:10399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba2fbe lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.545211:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384523.545276:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d8530e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+47:2415:x1874208182297984:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 176us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384523.545285:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 69 00010000:00010000:1.0:1787384523.545771:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba2f63 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3835 expref: 46 pid: 14031 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384523.545823:0:6525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9174e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1874208203347456:192.168.203.45@tcp:104: 00010000:00010000:1.0:1787384523.545848:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba2fbe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384523.545857:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba2fbe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384523.545862:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba2fbe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787384523.545981:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:1.0:1787384523.546102:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:1.0:1787384523.546206:0:6525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9b57480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1874208203347584:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787384523.546255:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384523.546287:0:6525:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f1ab0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384523.546865:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203347584 00000100:00100000:2.0:1787384523.546873:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203347584 00000100:00100000:2.0:1787384523.546922:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787384523.546931:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6525:x1874208203347584:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787384523.547014:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6525:x1874208203347584:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 83us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384523.547021:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787384523.547542:0:6525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9b57480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1874208203347584:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:3.0:1787384523.547697:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1787384523.547843:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:1.0:1787384523.547921:0:6525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9b57480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1874208203347712:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787384523.547962:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384523.548038:0:6525:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d139c780 going to sleep for 11 seconds 00000100:00100000:3.0:1787384523.551522:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203347712 00000100:00100000:3.0:1787384523.551538:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203347712 00000100:00100000:0.0:1787384523.553719:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787384523.553735:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6525:x1874208203347712:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787384523.553974:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6525:x1874208203347712:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 243us (6010us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787384523.553982:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787384523.554085:0:6525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9b57480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1874208203347712:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787384523.554150:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1787384523.554197:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba2fbe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384523.554208:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba2fbe lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384523.554215:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba2fbe lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384523.554221:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cda00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384523.554226:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba2fbe lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384523.554235:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba2fbe lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384523.554251:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f8e8aa4200) 00010000:00010000:1.0:1787384523.554254:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787384523.554258:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba2fbe lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384523.554263:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba2fbe lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787384523.554388:0:6525:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787384523.554454:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1787384523.554482:0:6525:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 418634703186ns, next at 419634701156ns, rc = 0 00000001:00080000:1.0:1787384523.554490:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1787384523.554514:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f8e8aa4200) 00010000:00010000:1.0:1787384523.554517:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787384523.554525:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba2fa9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3858 expref: 50 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384523.554642:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9505850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+49:11374:x1874208182297856:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 16828us (17233us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1787384523.554652:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 26 00000020:00080000:1.0:1787384523.554655:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787384523.567328:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384523.567514:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182298112 00000100:00100000:0.0:1787384523.567526:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182298112 00000100:00100000:0.0:1787384523.567588:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 111 00000100:00100000:0.0:1787384523.567672:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d8531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+49:11374:x1874208182298112:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:0.0:1787384523.567697:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384523.567723:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba2fc5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce385f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.567825:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba2fc5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce385f expref: 50 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.567841:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba2fc5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce385f expref: 50 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384523.567861:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f7c3a9c600) 00010000:00010000:0.0:1787384523.567864:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787384523.567883:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6141a00, rc 0) 00000100:00100000:0.0:1787384523.569420:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d8531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+50:11374:x1874208182298112:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 1743us (2094us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384523.569431:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 111 00000100:00100000:3.0:1787384523.579051:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384523.582705:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182298368 00000100:00100000:0.0:1787384523.582720:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182298368 00000100:00100000:0.0:1787384523.582860:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 27 00000100:00100000:0.0:1787384523.582871:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d8532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+50:11374:x1874208182298368:12345-192.168.203.45@tcp:35:lfs.0 00000100:00100000:0.0:1787384523.583118:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d8532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+51:11374:x1874208182298368:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 249us (4076us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1787384523.583127:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 27 00000100:00100000:2.0:1787384523.703892:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787384523.703918:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d8531880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203347840:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787384523.703990:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787384523.704360:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384523.704981:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203347840 00000100:00100000:3.0:1787384523.704990:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203347840 00000100:00100000:3.0:1787384523.705037:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787384523.705045:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203347840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787384523.705088:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787384523.705143:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203347840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384523.705151:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787384523.705378:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d8531880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203347840:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787384523.705438:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384523.706688:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182298496 00000100:00100000:3.0:1787384523.706697:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182298496 00000100:00100000:3.0:1787384523.706762:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 112 00000100:00100000:3.0:1787384523.706772:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+51:11384:x1874208182298496:12345-192.168.203.45@tcp:34:lfs.0 00010000:00010000:3.0:1787384523.706890:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2fcc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.706925:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2fcc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.706936:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2fcc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.706949:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba2fd3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.706956:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba2fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.706963:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba2fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.707040:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba2fda lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.707048:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba2fda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.707055:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba2fda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787384523.707443:0:8195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba2fda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.707456:0:8195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2fcc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.707463:0:8195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2fcc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.707483:0:8195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2fcc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.707490:0:8195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cc000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384523.707495:0:8195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2fcc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.707503:0:8195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2fcc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.707517:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f8fd1ea700) 00010000:00010000:3.0:1787384523.707521:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384523.707525:0:8195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2fcc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.707531:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba2fcc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.707545:0:8195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba2fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.707552:0:8195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba2fd3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.707556:0:8195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba2fd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.707561:0:8195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cdc00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384523.707564:0:8195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba2fd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.707579:0:8195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba2fd3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.708228:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f7c3a9cc00) 00010000:00010000:3.0:1787384523.708234:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384523.708240:0:8195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba2fd3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.708248:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba2fd3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.708261:0:8195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba2fda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.708267:0:8195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba2fda lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.708273:0:8195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba2fda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.708278:0:8195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cc800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384523.708282:0:8195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba2fda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.708288:0:8195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba2fda lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.708299:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f7c3a9c600) 00010000:00010000:3.0:1787384523.708301:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384523.708304:0:8195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba2fda lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.708322:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba2fda lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384523.708417:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+51:11384:x1874208182298496:12345-192.168.203.45@tcp:34:lfs.0 Request processed in 1643us (2976us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384523.708425:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 112 00000100:00100000:3.0:1787384523.785907:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384523.786034:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182298752 00000100:00100000:2.0:1787384523.786045:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182298752 00000100:00100000:2.0:1787384523.786120:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 113 00000100:00100000:2.0:1787384523.786130:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d8530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+51:11387:x1874208182298752:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:2.0:1787384523.786150:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384523.786171:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba2fe1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3866 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.786245:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba2fe8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.786273:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba2fe8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.786284:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba2fe8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.786297:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba2fef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.786304:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba2fef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.786311:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba2fef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.786432:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2ff6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.786441:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.786449:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384523.786458:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787384523.786541:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba2fe8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.786549:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba2fe8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.786555:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba2fe8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.786566:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965a400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384523.786570:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba2fe8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.786577:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba2fe8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.786727:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f8fd1ea700) 00010000:00010000:2.0:1787384523.786731:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384523.786737:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba2fe8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.786744:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba2fe8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.786759:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba2fef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.786765:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba2fef lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.786771:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba2fef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.786776:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965a800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384523.786840:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba2fef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.786847:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba2fef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.786866:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f7c3a9cc00) 00010000:00010000:2.0:1787384523.786868:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384523.786871:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba2fef lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.786878:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba2fef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.786914:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba2fe1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3866 expref: 54 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.786927:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2ff6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3866 expref: 53 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384523.786935:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f7c3a9c600) 00010000:00010000:2.0:1787384523.786937:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787384523.786939:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965b600, rc 0) 00000100:00100000:2.0:1787384523.787011:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d8530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+53:11387:x1874208182298752:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 882us (1113us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1787384523.787020:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 113 00000100:00100000:0.0:1787384523.789889:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384523.789992:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182298880 00000100:00100000:1.0:1787384523.790003:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182298880 00000100:00100000:1.0:1787384523.790068:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 114 00000100:00100000:1.0:1787384523.790080:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+53:11387:x1874208182298880:12345-192.168.203.45@tcp:54:lfs.0 00010000:00010000:1.0:1787384523.790149:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba3004 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384523.790167:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba3004 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384523.790179:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba3004 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384523.790450:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba3004 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384523.790459:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba3004 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384523.790466:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba3004 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384523.790486:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3952000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384523.790491:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba3004 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384523.790500:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba3004 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384523.790514:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f7c3a9c600) 00010000:00010000:1.0:1787384523.790517:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787384523.790522:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba3004 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384523.790529:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba3004 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384523.791000:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+53:11387:x1874208182298880:12345-192.168.203.45@tcp:54:lfs.0 Request processed in 917us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384523.791011:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 114 00000100:00100000:3.0:1787384523.807995:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384523.808110:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182299136 00000100:00100000:1.0:1787384523.808120:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182299136 00000100:00100000:1.0:1787384523.808174:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 28 00000100:00100000:1.0:1787384523.808197:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d8533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+53:11387:x1874208182299136:12345-192.168.203.45@tcp:35:lfs.0 00000100:00100000:1.0:1787384523.808419:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d8533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+54:11387:x1874208182299136:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 235us (433us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1787384523.808427:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 28 00000100:00100000:0.0:1787384523.976442:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384523.977293:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182299392 00000100:00100000:3.0:1787384523.977305:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182299392 00000100:00100000:3.0:1787384523.977508:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 115 00000100:00100000:3.0:1787384523.977520:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+54:11397:x1874208182299392:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:3.0:1787384523.977556:0:8195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384523.977560:0:8195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787384523.977594:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a000/0x7ef423838fba2f86 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce384a expref: 54 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.977615:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f8fd1ea700) 00010000:00010000:3.0:1787384523.977620:0:8195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787384523.977634:0:8195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba300b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce386d expref: -99 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.977734:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba3012 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.977748:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba3012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.977772:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba3012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384523.977828:0:8195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787384523.977937:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba300b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce386d expref: 56 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.977951:0:8195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba3012 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce386d expref: 55 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384523.977958:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f7c3a9c600) 00010000:00010000:3.0:1787384523.977960:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787384523.977963:0:8195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cdc00, rc 0) 00000100:00100000:3.0:1787384523.978030:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+55:11397:x1874208182299392:12345-192.168.203.45@tcp:101:bash.0 Request processed in 513us (1599us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1787384523.978038:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 115 00000100:00100000:0.0:1787384523.992857:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384523.992949:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384523.996231:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182299648 00000100:00100000:1.0:1787384523.996246:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182299648 00000100:00100000:1.0:1787384523.996339:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 8 00000100:00100000:1.0:1787384523.996368:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4307100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+55:2414:x1874208182299648:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384523.996385:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384523.996409:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba3012 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce386d expref: 55 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384523.996429:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f7c3a9c600) 00010000:00010000:1.0:1787384523.996434:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384523.996512:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4307100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+54:2414:x1874208182299648:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 147us (3562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384524.000140:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182299520 00000100:00100000:2.0:1787384524.000156:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182299520 00000100:00100000:1.0:1787384524.002439:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 8 00000100:00100000:0.0:1787384524.008433:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 116 00000100:00100000:0.0:1787384524.008446:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+54:11397:x1874208182299520:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:0.0:1787384524.008470:0:14031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384524.008489:0:14031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140600/0x7ef423838fba3020 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3874 expref: -99 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.008522:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba3027 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.008535:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba3027 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.008547:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba3027 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.008672:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140600/0x7ef423838fba3020 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3874 expref: 56 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.008689:0:14031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba3027 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3874 expref: 55 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.008698:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f7c3a9c600) 00010000:00010000:0.0:1787384524.008701:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787384524.008704:0:14031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6140a00, rc 0) 00000100:00100000:0.0:1787384524.008774:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+55:11397:x1874208182299520:12345-192.168.203.45@tcp:101:bash.0 Request processed in 330us (15926us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384524.008808:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 116 00000100:00100000:0.0:1787384524.016170:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384524.016305:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182299904 00000100:00100000:1.0:1787384524.016315:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182299904 00000100:00100000:1.0:1787384524.016383:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 117 00000100:00100000:1.0:1787384524.016394:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+55:11397:x1874208182299904:12345-192.168.203.45@tcp:36:bash.0 00010000:00010000:1.0:1787384524.016449:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384524.016476:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba2ff6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3866 expref: 55 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384524.016494:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f7c3a9c600) 00010000:00010000:1.0:1787384524.016499:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787384524.016687:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba302e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384524.016701:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba302e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384524.016711:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba302e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787384524.016768:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:1.0:1787384524.016824:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000078b25fc1 reply state 000000005b8032a9 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba302e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384524.016837:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba302e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384524.016843:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f7c3a9c600) 00010000:00010000:1.0:1787384524.016846:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787384524.016849:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787384524.016936:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+57:11397:x1874208182299904:12345-192.168.203.45@tcp:36:bash.0 Request processed in 543us (774us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1787384524.016943:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 117 00000020:00080000:1.0:1787384524.016948:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787384524.021967:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384524.022125:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182300032 00000100:00100000:2.0:1787384524.022134:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182300032 00000100:00100000:2.0:1787384524.022194:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 118 00000100:00100000:2.0:1787384524.022202:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d8530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+57:11397:x1874208182300032:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:2.0:1787384524.022223:0:8195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384524.022252:0:8195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba3035 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce387b expref: -99 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.022344:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba303c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.022358:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba303c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.022369:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba303c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384524.022396:0:8195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787384524.022399:0:8195:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787384524.022414:0:8195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba303c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.022437:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba3035 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce387b expref: 59 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.022453:0:8195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba303c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce387b expref: 58 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.022461:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f7c3a9c600) 00010000:00010000:2.0:1787384524.022464:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787384524.022467:0:8195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965a800, rc 0) 00000100:00100000:2.0:1787384524.022525:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d8530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+58:11397:x1874208182300032:12345-192.168.203.45@tcp:101:bash.0 Request processed in 324us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384524.022533:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 118 00000100:00100000:0.0:1787384524.035324:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384524.035405:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182300288 00000100:00100000:1.0:1787384524.035414:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182300288 00000100:00100000:1.0:1787384524.035464:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 29 00000100:00100000:1.0:1787384524.035473:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+58:11397:x1874208182300288:12345-192.168.203.45@tcp:35:bash.0 00000100:00100000:1.0:1787384524.035684:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+59:11397:x1874208182300288:12345-192.168.203.45@tcp:35:bash.0 Request processed in 211us (368us total) trans 4294967397 rc 0/0 00000100:00100000:1.0:1787384524.035692:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 29 00000100:00100000:3.0:1787384524.139547:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384524.139729:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182300416 00000100:00100000:1.0:1787384524.139741:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182300416 00000100:00100000:1.0:1787384524.139847:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 119 00000100:00100000:1.0:1787384524.139858:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d8532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+59:11403:x1874208182300416:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:1.0:1787384524.139881:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384524.139901:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba3043 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3882 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384524.139980:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba304a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384524.139995:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba304a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384524.140006:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba304a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384524.140049:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1787384524.140053:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787384524.140087:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba304a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384524.140111:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba3043 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3882 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384524.140127:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba304a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3882 expref: 60 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384524.140136:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f8fd1ea700) 00010000:00010000:1.0:1787384524.140139:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787384524.140142:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3952c00, rc 0) 00000100:00100000:1.0:1787384524.140365:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d8532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+60:11403:x1874208182300416:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 508us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384524.140374:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 119 00000100:00100000:0.0:1787384524.143771:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384524.143906:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182300544 00000100:00100000:2.0:1787384524.143928:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182300544 00000100:00100000:2.0:1787384524.143992:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 120 00000100:00100000:2.0:1787384524.144003:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+60:11403:x1874208182300544:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:2.0:1787384524.144023:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384524.144043:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba3051 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3889 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.144114:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba3058 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.144128:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba3058 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.144138:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba3058 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.144150:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba305f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.144157:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba305f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.144163:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba305f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.144230:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3066 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.144240:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3066 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.144246:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3066 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384524.144294:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787384524.144298:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787384524.144315:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3066 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.144326:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3066 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.144335:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba3058 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.144342:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba3058 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.144348:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba3058 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.144353:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965a400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384524.144357:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba3058 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.144364:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba3058 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.144376:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f8fd1ea700) 00010000:00010000:2.0:1787384524.144379:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384524.144382:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba3058 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.144388:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba3058 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.144409:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba305f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.144415:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba305f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.144421:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba305f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.144426:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965b200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384524.144429:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba305f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.144434:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba305f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.144442:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f7c3a9cc00) 00010000:00010000:2.0:1787384524.144443:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384524.144446:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba305f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.144451:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba305f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.144475:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba3051 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3889 expref: 62 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.144486:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3066 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3889 expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.144502:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f7c3a9c600) 00010000:00010000:2.0:1787384524.144505:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787384524.144507:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965ae00, rc 0) 00000100:00100000:2.0:1787384524.144570:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+61:11403:x1874208182300544:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 569us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384524.144578:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 120 00000100:00100000:0.0:1787384524.150296:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384524.150415:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182300928 00000100:00100000:2.0:1787384524.150425:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182300928 00000100:00100000:2.0:1787384524.150495:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 9 00000100:00100000:2.0:1787384524.150505:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4304a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+61:2416:x1874208182300928:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384524.150522:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384524.150549:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3066 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3889 expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.150568:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f7c3a9c600) 00010000:00010000:2.0:1787384524.150574:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384524.150746:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4304a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+60:2416:x1874208182300928:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 242us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384524.150756:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 9 00000100:00100000:0.0:1787384524.165151:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384524.165284:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182300800 00000100:00100000:2.0:1787384524.165292:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182300800 00000100:00100000:2.0:1787384524.165353:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 121 00000100:00100000:2.0:1787384524.165364:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+60:11403:x1874208182300800:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:2.0:1787384524.165384:0:14031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384524.165405:0:14031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba306d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3890 expref: -99 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.165530:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba3074 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.165546:0:14031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba303c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce387b expref: 61 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.165555:0:14031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba3074 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.165602:0:14031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba303c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce387b expref: 61 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.165617:0:14031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba303c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce387b expref: 61 pid: 8195 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384524.165631:0:14031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7f04380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14031:1874208203347968:192.168.203.45@tcp:104: 00000100:00100000:2.0:1787384524.165732:0:14031:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c41cb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384524.169816:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384524.170743:0:14031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7f04380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14031:1874208203347968:192.168.203.45@tcp:104: 00010000:00010000:2.0:1787384524.170810:0:14031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba3074 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384524.177322:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182301056 00000100:00100000:3.0:1787384524.177338:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182301056 00010000:00010000:0.0:1787384524.177479:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba303c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce387b expref: 62 pid: 8195 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384524.177525:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 70 00000100:00100000:0.0:1787384524.177536:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4305c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+62:2415:x1874208182301056:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787384524.177548:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384524.177554:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba303c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce387b expref: 62 pid: 8195 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.177579:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba303c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce387b expref: 62 pid: 8195 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.177609:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba303c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce387b expref: 62 pid: 8195 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.177625:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f7c3a9c600) 00010000:00010000:0.0:1787384524.177630:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba3074 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.177640:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba3074 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.177647:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba3074 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.177676:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384524.177744:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4305c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+61:2415:x1874208182301056:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 210us (7937us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384524.177751:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 70 00010000:00010000:2.0:1787384524.178212:0:14031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba3074 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.178221:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba3074 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384524.178241:0:14031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787384524.178385:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba306d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3890 expref: 62 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.178402:0:14031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba3074 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3890 expref: 61 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.178409:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f7c3a9c600) 00010000:00010000:2.0:1787384524.178412:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787384524.178414:0:14031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965b200, rc 0) 00000100:00100000:2.0:1787384524.178459:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+61:11403:x1874208182300800:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 13098us (13318us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1787384524.178467:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 121 00000100:00100000:0.0:1787384524.186943:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384524.187131:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182301312 00000100:00100000:1.0:1787384524.187140:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182301312 00000100:00100000:1.0:1787384524.187232:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 10 00000100:00100000:1.0:1787384524.187243:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4306d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+61:11403:x1874208182301312:12345-192.168.203.45@tcp:103:lfs.0 00010000:00010000:1.0:1787384524.187259:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384524.187287:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba2fc5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce385f expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384524.187307:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f7c3a9c600) 00010000:00010000:1.0:1787384524.187312:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384524.187375:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4306d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+60:11403:x1874208182301312:12345-192.168.203.45@tcp:103:lfs.0 Request processed in 134us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384524.187383:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 10 00000100:00100000:0.0:1787384524.197615:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384524.197702:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182301440 00000100:00100000:1.0:1787384524.197713:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182301440 00000100:00100000:1.0:1787384524.197806:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 122 00000100:00100000:1.0:1787384524.197817:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+60:11403:x1874208182301440:12345-192.168.203.45@tcp:58:lfs.0 00010000:00010000:1.0:1787384524.197935:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba3082 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384524.197952:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba3082 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384524.197964:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba3082 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787384524.198076:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1787384524.198158:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+60:11403:x1874208182301440:12345-192.168.203.45@tcp:58:lfs.0 Request processed in 342us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384524.198167:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 122 00000100:00100000:2.0:1787384524.204438:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384524.204527:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182301568 00000100:00100000:3.0:1787384524.204537:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182301568 00000100:00100000:3.0:1787384524.204606:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 123 00000100:00100000:3.0:1787384524.204615:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+60:11403:x1874208182301568:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:3.0:1787384524.204634:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384524.204652:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba3089 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3897 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.204722:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba3082 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.204733:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba3089 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3897 expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.204752:0:6523:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba3082 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.204771:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba3089 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3897 expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.204825:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f7c3a9c600) 00010000:00010000:3.0:1787384524.204829:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787384524.204833:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba3089 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3897 expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.204840:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cc800, rc 0) 00000100:00100000:3.0:1787384524.204893:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+61:11403:x1874208182301568:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 280us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384524.204900:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 123 00000100:00100000:0.0:1787384524.215893:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787384524.215917:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d8531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203348096:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787384524.215995:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384524.216303:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203348096 00000100:00100000:1.0:1787384524.216312:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203348096 00000100:00100000:1.0:1787384524.216361:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787384524.216369:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203348096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787384524.216400:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1787384524.216452:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203348096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384524.216460:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787384524.218374:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d8531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203348096:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787384524.726981:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787384524.729602:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:3.0:1787384524.729615:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000040:00080000:0.0:1787384524.791009:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787384524.791024:0:13801:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787384524.791062:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1787384524.791071:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787384524.791196:0:13801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4304380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1874208203348224:192.168.203.45@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787384524.791558:0:13801:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2aac900 going to sleep for 11 seconds 00000100:00100000:0.0:1787384524.799504:0:13801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4304380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1874208203348224:192.168.203.45@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787384524.804385:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384524.806654:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182301696 00000100:00100000:2.0:1787384524.806668:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182301696 00000100:00100000:2.0:1787384524.806741:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 124 00000100:00100000:2.0:1787384524.806752:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+61:11404:x1874208182301696:12345-192.168.203.45@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787384524.806843:0:14031:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787384524.806975:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+61:11404:x1874208182301696:12345-192.168.203.45@tcp:53:lhsmtool_posix.0 Request processed in 224us (2598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384524.806983:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 124 00000100:00100000:2.0:1787384524.815092:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384524.815182:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182301824 00000100:00100000:3.0:1787384524.815192:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182301824 00000100:00100000:3.0:1787384524.815253:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 125 00000100:00100000:3.0:1787384524.815263:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+61:11404:x1874208182301824:12345-192.168.203.45@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787384524.815345:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba3090 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.815362:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba3090 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.815372:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba3090 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.815386:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba3097 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.815393:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba3097 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.815399:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba3097 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.815421:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba309e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.815430:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba309e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.815437:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba309e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384524.815482:0:8195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787384524.815486:0:8195:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787384524.815497:0:8195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba309e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.815508:0:8195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba3090 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.815521:0:8195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba3090 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.815527:0:8195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba3090 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.815533:0:8195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cc000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384524.815537:0:8195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba3090 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.815544:0:8195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba3090 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.815556:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98f7c3a9cf00) 00010000:00010000:3.0:1787384524.815558:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384524.815562:0:8195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba3090 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.815568:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba3090 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.815581:0:8195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba3097 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.815587:0:8195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba3097 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.815592:0:8195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba3097 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.815597:0:8195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cd600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384524.815607:0:8195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba3097 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.815613:0:8195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba3097 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.815620:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff98f7c294f200) 00010000:00010000:3.0:1787384524.815622:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384524.815625:0:8195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba3097 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.815630:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba3097 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.815645:0:8195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba309e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.815650:0:8195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba309e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.815656:0:8195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba309e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.815661:0:8195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cdc00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384524.815663:0:8195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba309e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.815668:0:8195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba309e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.815675:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f7c3a9c600) 00010000:00010000:3.0:1787384524.815677:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384524.815701:0:8195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba309e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.815707:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba309e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384524.815823:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+61:11404:x1874208182301824:12345-192.168.203.45@tcp:34:lhsmtool_posix.0 Request processed in 560us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384524.815832:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 125 00000100:00100000:3.0:1787384524.822149:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384524.822241:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182302080 00000100:00100000:1.0:1787384524.822251:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182302080 00000100:00100000:1.0:1787384524.822312:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 126 00000100:00100000:1.0:1787384524.822321:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d8533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+61:11404:x1874208182302080:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787384524.822352:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384524.822372:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953a00/0x7ef423838fba30a5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce389e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384524.822467:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba30ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384524.822481:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba30ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384524.822493:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba30ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384524.822505:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787384524.822591:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba30ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384524.822614:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba30ac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384524.822621:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba30ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384524.822627:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3953000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384524.822631:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba30ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384524.822639:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba30ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384524.822658:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f7c3a9c600) 00010000:00010000:1.0:1787384524.822661:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787384524.822666:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba30ac lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384524.822672:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba30ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384524.822712:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953a00/0x7ef423838fba30a5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce389e expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384524.822720:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98f7c3a9cf00) 00010000:00010000:1.0:1787384524.822723:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787384524.822726:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953a00/0x7ef423838fba30a5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce389e expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384524.822735:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3953a00, rc 0) 00000100:00100000:1.0:1787384524.822843:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d8533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+62:11404:x1874208182302080:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 523us (702us total) trans 4294967399 rc 301/301 00000100:00100000:1.0:1787384524.822851:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 126 00000100:00100000:0.0:1787384524.826717:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384524.826848:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182302208 00000100:00100000:1.0:1787384524.826858:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182302208 00000100:00100000:1.0:1787384524.826918:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 127 00000100:00100000:1.0:1787384524.826933:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+62:11404:x1874208182302208:12345-192.168.203.45@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787384524.826976:0:6521:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787384524.827109:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+62:11404:x1874208182302208:12345-192.168.203.45@tcp:53:lhsmtool_posix.0 Request processed in 180us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384524.827117:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 127 00000100:00100000:3.0:1787384524.838034:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384524.838166:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182302464 00000100:00100000:2.0:1787384524.838179:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182302464 00000100:00100000:2.0:1787384524.838251:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 128 00000100:00100000:2.0:1787384524.838261:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d8533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+62:11404:x1874208182302464:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787384524.838281:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384524.838297:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787384524.838323:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba304a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3882 expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.838343:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f8fd1ea700) 00010000:00010000:2.0:1787384524.838349:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787384524.838362:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba30ba lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce38a5 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787384524.838711:0:6523:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1787384524.838927:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba30c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.838941:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba30c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.838951:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba30c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.839004:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba30ba lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38a5 expref: 64 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.839020:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba30c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38a5 expref: 63 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.839028:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98f8e8aa4d00) 00010000:00010000:2.0:1787384524.839031:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787384524.839034:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965ac00, rc 0) 00000100:00100000:2.0:1787384524.839108:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d8533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+63:11404:x1874208182302464:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 848us (1089us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1787384524.839125:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 128 00000100:00100000:2.0:1787384524.848892:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384524.849009:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182302720 00000100:00100000:0.0:1787384524.849024:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182302720 00000100:00100000:0.0:1787384524.849110:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 129 00000100:00100000:0.0:1787384524.849120:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+63:11404:x1874208182302720:12345-192.168.203.45@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787384524.849185:0:14031:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384524.849211:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba30c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38a5 expref: 63 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.849230:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98f8e8aa4d00) 00010000:00010000:0.0:1787384524.849249:0:14031:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787384524.849269:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba30cf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.849282:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba30cf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.849291:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba30cf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.849346:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba30d6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xa25c4138 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.849367:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba30d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa25c4138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.849374:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba30d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa25c4138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.849414:0:14031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba30cf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.849421:0:14031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba30cf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.849427:0:14031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba30cf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.849434:0:14031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6141a00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384524.849438:0:14031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba30cf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.849446:0:14031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba30cf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.849454:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f8fd1ea700) 00010000:00010000:0.0:1787384524.849457:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384524.849461:0:14031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba30cf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.849467:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba30cf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.849476:0:14031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba30d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa25c4138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.849487:0:14031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba30d6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa25c4138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.849493:0:14031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba30d6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa25c4138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.849498:0:14031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6141400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384524.849501:0:14031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba30d6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa25c4138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.849508:0:14031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba30d6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa25c4138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.849515:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xa25c4138 (ffff98f7c3a9c500) 00010000:00010000:0.0:1787384524.849518:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384524.849520:0:14031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba30d6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xa25c4138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.849526:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba30d6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xa25c4138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384524.849612:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+62:11404:x1874208182302720:12345-192.168.203.45@tcp:36:lhsmtool_posix.0 Request processed in 493us (735us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787384524.849620:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 129 00000100:00100000:0.0:1787384524.857927:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384524.858006:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182302848 00000100:00100000:0.0:1787384524.858014:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182302848 00000100:00100000:2.0:1787384524.859320:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 130 00000100:00100000:2.0:1787384524.859351:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+62:11404:x1874208182302848:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787384524.859380:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384524.859425:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba30dd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce38ac expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.859471:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba30e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.859499:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba30e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.859514:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba30e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.859672:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba30dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38ac expref: 64 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.859696:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba30e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38ac expref: 63 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.859706:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:2.0:1787384524.859710:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787384524.859714:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965b400, rc 0) 00000100:00100000:2.0:1787384524.859837:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+63:11404:x1874208182302848:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 502us (1930us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384524.859855:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 130 00000100:00100000:2.0:1787384524.863914:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384524.864029:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182303104 00000100:00100000:3.0:1787384524.864061:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182303104 00000100:00100000:3.0:1787384524.864148:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 131 00000100:00100000:3.0:1787384524.864160:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+63:11404:x1874208182303104:12345-192.168.203.45@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787384524.864612:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba30eb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.864634:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba30eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.864649:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba30eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787384524.864907:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:3.0:1787384524.864920:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 419945140112ns, next at 420945136955ns, rc = 0 00000004:00010000:3.0:1787384524.864991:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000022a6ca31 reply state 000000001daf69c3 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba30eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.865006:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba30eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.865026:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:3.0:1787384524.865029:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787384524.865034:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787384524.865193:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+65:11404:x1874208182303104:12345-192.168.203.45@tcp:36:lhsmtool_posix.0 Request processed in 1031us (1290us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1787384524.865202:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 131 00000100:00100000:3.0:1787384524.867544:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384524.867834:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182303232 00000100:00100000:2.0:1787384524.867847:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182303232 00000100:00100000:2.0:1787384524.867925:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 132 00000100:00100000:2.0:1787384524.867937:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d8530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+65:11404:x1874208182303232:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787384524.867978:0:8195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384524.868005:0:8195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba30f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce38b3 expref: -99 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.868087:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba30f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38b3 expref: 66 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.868105:0:8195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba30f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38b3 expref: 66 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.868128:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:2.0:1787384524.868132:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787384524.868136:0:8195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965a200, rc 0) 00000100:00100000:2.0:1787384524.868228:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d8530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+66:11404:x1874208182303232:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 293us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384524.868237:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 132 00000100:00100000:0.0:1787384524.871977:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384524.872105:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182303360 00000100:00100000:1.0:1787384524.872120:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182303360 00000100:00100000:1.0:1787384524.872217:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 45 00000100:00100000:1.0:1787384524.872234:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+8:2415:x1874208182303360:12345-192.168.203.45@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787384524.872540:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+9:2415:x1874208182303360:12345-192.168.203.45@tcp:2:lhsmtool_posix.0 Request processed in 312us (579us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787384524.872548:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 45 00000100:00080000:3.0:1787384524.873154:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787384524.875977:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384524.876145:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182303616 00000100:00100000:1.0:1787384524.876162:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182303616 00000100:00100000:1.0:1787384524.876252:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 30 00000100:00100000:1.0:1787384524.876265:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+66:11404:x1874208182303616:12345-192.168.203.45@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787384524.876841:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+67:11404:x1874208182303616:12345-192.168.203.45@tcp:35:lhsmtool_posix.0 Request processed in 473us (774us total) trans 4294967402 rc 0/0 00000100:00100000:1.0:1787384524.876851:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 30 00000100:00100000:0.0:1787384524.880173:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384524.880291:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182303872 00000100:00100000:1.0:1787384524.880305:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182303872 00000100:00100000:1.0:1787384524.880423:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 133 00000100:00100000:1.0:1787384524.880436:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+67:11404:x1874208182303872:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787384524.880594:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+67:11404:x1874208182303872:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 Request processed in 160us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384524.880603:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 133 00000100:00100000:0.0:1787384524.888918:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384524.889410:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182304000 00000100:00100000:3.0:1787384524.889425:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182304000 00000100:00100000:3.0:1787384524.889508:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 134 00000100:00100000:3.0:1787384524.889521:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+67:11404:x1874208182304000:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787384524.889550:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384524.889583:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba30f9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce38ba expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.889678:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba3100 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.889694:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba3100 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.889708:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba3100 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384524.889774:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787384524.889836:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba3100 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.889895:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba30f9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38ba expref: 69 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.889920:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba3100 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38ba expref: 68 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.889930:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:3.0:1787384524.889934:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787384524.889938:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cc000, rc 0) 00000100:00100000:3.0:1787384524.890092:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+68:11404:x1874208182304000:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 572us (1190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384524.890101:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 134 00000100:00100000:2.0:1787384524.898752:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384524.901819:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182304128 00000100:00100000:0.0:1787384524.901844:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182304128 00000100:00100000:0.0:1787384524.902272:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 46 00000100:00100000:0.0:1787384524.902286:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+9:2416:x1874208182304128:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787384524.902434:0:8890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384524.902465:0:8890:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba3107 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce38c1 expref: -99 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787384524.902504:0:8890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8952cc, blocks: 0x0 00010000:00010000:0.0:1787384524.902533:0:8890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1787384524.902538:0:8890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384524.902550:0:8890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba3107 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38c1 expref: 10 pid: 8890 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.902570:0:8890:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba3107 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38c1 expref: 10 pid: 8890 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.902586:0:8890:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6141e00, rc 0) 00000100:00100000:0.0:1787384524.902679:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+10:2416:x1874208182304128:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 395us (3942us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384524.902687:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 46 00000100:00100000:1.0:1787384524.912324:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384524.912529:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182304384 00000100:00100000:3.0:1787384524.912544:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182304384 00000100:00100000:3.0:1787384524.912624:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 135 00000100:00100000:3.0:1787384524.912636:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9175c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+68:11404:x1874208182304384:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787384524.912840:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9175c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+68:11404:x1874208182304384:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 Request processed in 205us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384524.912848:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 135 00000100:00100000:1.0:1787384524.926443:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384524.926900:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182304512 00000100:00100000:0.0:1787384524.926923:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182304512 00000100:00100000:0.0:1787384524.927011:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 47 00000100:00100000:0.0:1787384524.927023:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9174e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+10:11404:x1874208182304512:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787384524.927078:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384524.927103:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000124fd424/0x7ef423838fba310e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce38c8 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.927142:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba3107 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38c1 expref: 11 pid: 8890 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.927152:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787384524.927157:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384524.927163:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000124fd424/0x7ef423838fba310e lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38c8 expref: 11 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.927349:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba3107 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38c1 expref: 11 pid: 8890 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.927366:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba3107 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38c1 expref: 11 pid: 8890 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384524.927384:0:8438:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1874208203348352:192.168.203.45@tcp:104: 00000100:00100000:0.0:1787384524.927509:0:8438:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2aac900 going to sleep for 11 seconds 00000100:00100000:2.0:1787384524.931608:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384524.931765:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182304640 00000100:00100000:1.0:1787384524.931818:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182304640 00010000:00010000:1.0:1787384524.931881:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba3107 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38c1 expref: 12 pid: 8890 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384524.931937:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 71 00000100:00100000:1.0:1787384524.931950:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+12:2416:x1874208182304640:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384524.931982:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384524.932014:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba3107 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38c1 expref: 12 pid: 8890 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384524.932032:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba3107 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38c1 expref: 12 pid: 8890 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384524.932078:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384524.932083:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384524.932095:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000124fd424/0x7ef423838fba310e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38c8 expref: 12 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384524.932127:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000124fd424/0x7ef423838fba310e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38c8 expref: 12 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384524.932186:0:8463:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000124fd424/0x7ef423838fba310e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38c8 expref: 12 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384524.932205:0:8463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d915aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8463:1874208203348480:192.168.203.45@tcp:105: 00000100:00100000:1.0:1787384524.932306:0:8463:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d139c3c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787384524.934705:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba3107 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38c1 expref: 12 pid: 8890 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384524.934739:0:8438:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1874208203348352:192.168.203.45@tcp:104: 00010000:00010000:0.0:1787384524.934857:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000124fd424/0x7ef423838fba310e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38c8 expref: 11 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.934897:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6141c00, rc 0) 00000100:00100000:0.0:1787384524.934989:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9174e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+11:11404:x1874208182304512:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 7967us (8559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384524.935001:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 47 00000100:00100000:0.0:1787384524.936896:0:8463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d915aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8463:1874208203348480:192.168.203.45@tcp:105: 00010000:00010000:0.0:1787384524.936946:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384524.941384:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+10:2416:x1874208182304640:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 9416us (9770us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384524.941427:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 71 00000100:00100000:2.0:1787384524.949093:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384524.949261:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182304768 00000100:00100000:0.0:1787384524.949275:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182304768 00002000:00100000:0.0:1787384524.949349:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff98f8f7f07b80 x1874208182304768/t0(0) o4->55e96ad5-fd9d-44d4-856e-5db0c40b1329@192.168.203.45@tcp:555/0 lens 504/0 e 0 to 0 dl 1787384535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787384524.949362:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98f8f7f07b80 with x1874208182304768 ext(0->12) 00002000:00010000:0.0:1787384524.949369:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98f8f7f07b80 00000100:00100000:0.0:1787384524.949412:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 2 00000100:00100000:0.0:1787384524.949423:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+10:2415:x1874208182304768:12345-192.168.203.45@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787384524.951352:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+12:2415:x1874208182304768:12345-192.168.203.45@tcp:4:lhsmtool_posix.0 Request processed in 1915us (2258us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787384524.951369:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 2 00002000:00100000:0.0:1787384524.951383:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff98f8f7f07b80 x1874208182304768/t4294967309(0) o4->55e96ad5-fd9d-44d4-856e-5db0c40b1329@192.168.203.45@tcp:555/0 lens 504/448 e 0 to 0 dl 1787384535 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787384524.951394:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98f8f7f07b80 with x1874208182304768 ext(0->12) 00002000:00010000:0.0:1787384524.951401:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98f8f7f07b80 00000100:00100000:1.0:1787384524.954001:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384524.954132:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182304896 00000100:00100000:0.0:1787384524.954167:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182304896 00000100:00100000:0.0:1787384524.954253:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 136 00000100:00100000:0.0:1787384524.954266:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9159f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+68:11404:x1874208182304896:12345-192.168.203.45@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787384524.962661:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:0.0:1787384524.962681:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:0.0:1787384524.962720:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:0.0:1787384524.962748:0:6501:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98f8f1ab0000 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1787384524.962754:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff98f7c3b20d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98f8f9755e40 00000020:00080000:0.0:1787384524.962757:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff98f7c3b20800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98f7c2af3e00 00000004:00080000:0.0:1787384524.962810:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1787384524.962838:0:6501:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98f8e8ab9b40 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1787384524.962841:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff98f8ee048c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98f8e8ab9cc0 00000020:00080000:0.0:1787384524.962844:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff98f8ee048900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98f8f571bc00 00000020:00080000:0.0:1787384524.962871:0:6553:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1787384524.962938:0:6553:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1787384524.963244:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203348608:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787384524.963299:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384524.963338:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787384524.963345:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203348736:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787384524.963365:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384524.963397:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203348608 00000100:00100000:1.0:1787384524.963405:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203348608 00000100:00100000:1.0:1787384524.963452:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203348736 00000100:00100000:1.0:1787384524.963456:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203348736 00000100:00100000:1.0:1787384524.963477:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787384524.963491:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d915a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3651:x1874208203348608:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787384524.963517:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:2.0:1787384524.963524:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba2e13 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.963538:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba2e13 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384524.963540:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060c5a1fc/0x7ef423838fba3115 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.963549:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba2e13 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.963559:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cce00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384524.963564:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000016504a0a/0x7ef423838fba2ec9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3820 expref: 11 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.963565:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba2e13 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.963573:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba2e13 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384524.963588:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1787384524.963594:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787384524.963600:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060c5a1fc/0x7ef423838fba3115 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.963604:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff98f7c3a9cd00) 00010000:00010000:2.0:1787384524.963611:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384524.963617:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba2e13 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.963624:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba2e13 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384524.963636:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000016504a0a/0x7ef423838fba2ec9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3820 expref: 11 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.963648:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2ebb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384524.963652:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000016504a0a/0x7ef423838fba2ec9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3820 expref: 11 pid: 8438 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.963664:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2ebb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384524.963673:0:8435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d915a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1874208203348864:192.168.203.45@tcp:104: 00010000:00010000:2.0:1787384524.963686:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2ebb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.963693:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cd800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384524.963697:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2ebb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.963705:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2ebb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.963714:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff98f7c294f900) 00010000:00010000:2.0:1787384524.963716:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384524.963720:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2ebb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.963726:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba2ebb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.963742:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2f39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.963749:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2f39 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.963755:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2f39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.963760:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384524.963764:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2f39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.963803:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2f39 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.963812:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f7c3a9cc00) 00010000:00010000:2.0:1787384524.963815:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787384524.963936:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9159f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+20:11404:x1874208182304896:12345-192.168.203.45@tcp:44:lhsmtool_posix.0 Request processed in 9671us (9948us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384524.963945:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 136 00010000:00010000:2.0:1787384524.963972:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2f39 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384524.963977:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00010000:00010000:2.0:1787384524.963985:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba2f39 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384524.963990:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d915bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3651:x1874208203348736:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1787384524.964007:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2f5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.964016:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2f5c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.964023:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2f5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.964029:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965aa00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384524.964032:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2f5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.964038:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2f5c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.964048:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f7c3a9cc00) 00010000:00010000:2.0:1787384524.964066:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384524.964069:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2f5c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.964082:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba2f5c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787384524.964098:0:8890:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00010000:00010000:2.0:1787384524.964100:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba302e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787384524.964103:0:8890:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787384524 00002000:00010000:0.0:1787384524.964109:0:8890:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:2.0:1787384524.964113:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba302e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787384524.964114:0:8890:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1787384524 -> 1787384524 00002000:00010000:0.0:1787384524.964118:0:8890:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1787384524.964124:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba302e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.964133:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3952000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384524.964137:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba302e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.964144:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba302e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.964154:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f7c3a9c600) 00010000:00010000:2.0:1787384524.964158:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384524.964161:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba302e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.964168:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba302e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384524.964171:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d915bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3651:x1874208203348736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 183us (802us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787384524.964185:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:2.0:1787384524.964190:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba30eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.964199:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba30eb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.964211:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba30eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.964217:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cdc00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384524.964220:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba30eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.964228:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba30eb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787384524.964232:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98f8d9158700/2, rc 0, transno 4294967310 00010000:00010000:2.0:1787384524.964239:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98f8e8aa4900) 00000100:00100000:0.0:1787384524.964240:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203348736:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1787384524.964245:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787384524.964250:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba30eb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.964256:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba30eb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787384524.964421:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787384524.964548:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d8532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203348992:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787384524.964585:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384524.964669:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203348992 00000100:00100000:3.0:1787384524.964674:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203348992 00000100:00100000:3.0:1787384524.964709:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787384524.964717:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203348992:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787384524.964745:0:8890:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:3.0:1787384524.964801:0:8890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a8952ca, atime: 0x6a8952ca, ctime: 0x6a8952ca, blocks: 0x8 00010000:00010000:3.0:1787384524.964808:0:8890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa40ac1a/0x7ef423838fba311c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.964820:0:8890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1787384524.964824:0:8890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384524.964830:0:8890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa40ac1a/0x7ef423838fba311c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.964845:0:8890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa40ac1a/0x7ef423838fba311c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.964855:0:8890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa40ac1a/0x7ef423838fba311c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.964862:0:8890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa40ac1a/0x7ef423838fba311c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.964879:0:8890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787384524.965531:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3653:x1874208203348992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 813us (943us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787384524.965539:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787384524.966022:0:3653:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1787384524.966030:0:3653:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967304 00000004:00080000:0.0:1787384524.966061:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98f8d9b57800, transno 4294967302 00000004:00080000:0.0:1787384524.966070:0:3653:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967304 00000100:00100000:0.0:1787384524.966087:0:3653:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff98f8d8532300 x1874208203348992/t4294967305(4294967305) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787384540 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1787384524.966097:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98f8d8532300/2, rc 0, transno 4294967305 00000100:00100000:0.0:1787384524.966102:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d8532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203348992:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787384524.967608:0:8435:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d139c600 going to sleep for 11 seconds 00010000:00010000:2.0:1787384524.970346:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384524.970357:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa40ac1a/0x7ef423838fba311c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.970372:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cd600 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:2.0:1787384524.970377:0:8453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa40ac1a/0x7ef423838fba311c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.970388:0:8453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa40ac1a/0x7ef423838fba311c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.970428:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa40ac1a/0x7ef423838fba311c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.970436:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa40ac1a/0x7ef423838fba311c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.970459:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384524.970462:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384524.970463:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384524.976715:0:8435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d915a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1874208203348864:192.168.203.45@tcp:104: 00010000:00010000:2.0:1787384524.976747:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000060c5a1fc/0x7ef423838fba3115 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384524.977468:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384524.977536:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182305024 00000100:00100000:2.0:1787384524.977543:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182305024 00000100:00100000:2.0:1787384524.977669:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 51 00000100:00100000:2.0:1787384524.977681:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+12:2414:x1874208182305024:12345-192.168.203.45@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787384524.979187:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384524.979262:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182305152 00000100:00100000:3.0:1787384524.979289:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182305152 00010000:00010000:3.0:1787384524.979322:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000016504a0a/0x7ef423838fba2ec9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3820 expref: 13 pid: 8438 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384524.979401:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 72 00000100:00100000:3.0:1787384524.979427:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b47c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+13:2416:x1874208182305152:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384524.979440:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384524.979447:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000016504a0a/0x7ef423838fba2ec9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3820 expref: 13 pid: 8438 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.979461:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000016504a0a/0x7ef423838fba2ec9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3820 expref: 13 pid: 8438 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.979487:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016504a0a/0x7ef423838fba2ec9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3820 expref: 13 pid: 8438 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.979505:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787384524.979509:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787384524.979514:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000060c5a1fc/0x7ef423838fba3115 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.979524:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060c5a1fc/0x7ef423838fba3115 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384524.979552:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384524.979616:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b47c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+12:2416:x1874208182305152:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 189us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384524.979623:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 72 00010000:00010000:2.0:1787384524.983374:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000060c5a1fc/0x7ef423838fba3115 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.983394:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060c5a1fc/0x7ef423838fba3115 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.983407:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060c5a1fc/0x7ef423838fba3115 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.983432:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060c5a1fc/0x7ef423838fba3115 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384524.983467:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787384524.983748:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d915a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3651:x1874208203348608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20258us (20444us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787384524.983758:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:0.0:1787384524.984137:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384524.984144:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060c5a1fc/0x7ef423838fba3115 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.984153:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3952e00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384524.984157:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060c5a1fc/0x7ef423838fba3115 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.984167:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060c5a1fc/0x7ef423838fba3115 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.984207:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060c5a1fc/0x7ef423838fba3115 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.984215:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060c5a1fc/0x7ef423838fba3115 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384524.984239:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384524.984241:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384524.984243:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787384524.984293:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98f8d9158380/2, rc 0, transno 4294967311 00000100:00100000:0.0:1787384524.984301:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203348608:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1787384524.987326:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1787384524.987341:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:2.0:1787384524.987524:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2414:x1874208182305024:12345-192.168.203.45@tcp:16:lhsmtool_posix.0 Request processed in 9831us (10042us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384524.987536:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 51 00000100:00100000:2.0:1787384524.999561:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384525.000792:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182305408 00000100:00100000:3.0:1787384525.000821:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182305408 00000100:00100000:2.0:1787384525.003177:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 137 00000100:00100000:2.0:1787384525.003192:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+16:11404:x1874208182305408:12345-192.168.203.45@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787384525.003247:0:8195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384525.003275:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba3100 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38ba expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.003295:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:2.0:1787384525.003300:0:8195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787384525.003328:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba3123 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.003343:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba3123 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.003353:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba3123 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787384525.003492:0:8195:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000065399239 reply state 000000008b90fd65 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba3123 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.003506:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba3123 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.003513:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:2.0:1787384525.003515:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787384525.003517:0:8195:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787384525.003643:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+17:11404:x1874208182305408:12345-192.168.203.45@tcp:36:lhsmtool_posix.0 Request processed in 452us (4089us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1787384525.003650:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 137 00000100:00080000:3.0:1787384525.008688:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384525.012662:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384525.016723:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182305536 00000100:00100000:3.0:1787384525.016739:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182305536 00000100:00100000:0.0:1787384525.033257:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 52 00000100:00100000:0.0:1787384525.033273:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d915b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2415:x1874208182305536:12345-192.168.203.45@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787384525.033407:0:8890:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787384525.033411:0:8890:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1787384524 -> 1787384523 00002000:00010000:0.0:1787384525.033413:0:8890:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787384522 00002000:00010000:0.0:1787384525.033416:0:8890:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1787384524 -> 1787384523 00002000:00010000:0.0:1787384525.033418:0:8890:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1787384525.033493:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d915b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:2415:x1874208182305536:12345-192.168.203.45@tcp:2:lhsmtool_posix.0 Request processed in 224us (21528us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787384525.033501:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 52 00000100:00100000:1.0:1787384525.036626:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384525.036766:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182305792 00000100:00100000:0.0:1787384525.036807:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182305792 00000100:00100000:0.0:1787384525.036879:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 138 00000100:00100000:0.0:1787384525.036890:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d915a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+17:11404:x1874208182305792:12345-192.168.203.45@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787384525.036969:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140600/0x7ef423838fba312a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384525.036997:0:14031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba30e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38ac expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384525.037006:0:14031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140600/0x7ef423838fba312a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384525.037039:0:14031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba30e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38ac expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384525.037070:0:14031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba30e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38ac expref: 17 pid: 6523 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384525.037086:0:14031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42f0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14031:1874208203349120:192.168.203.45@tcp:104: 00000100:00100000:0.0:1787384525.037162:0:14031:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2aac900 going to sleep for 11 seconds 00000100:00100000:0.0:1787384525.045741:0:14031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42f0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14031:1874208203349120:192.168.203.45@tcp:104: 00010000:00010000:0.0:1787384525.045771:0:14031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140600/0x7ef423838fba312a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384525.047378:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384525.047660:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182305920 00000100:00100000:0.0:1787384525.047669:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182305920 00010000:00010000:0.0:1787384525.047713:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba30e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38ac expref: 18 pid: 6523 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384525.047748:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 73 00000100:00100000:0.0:1787384525.047758:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d915aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+18:2416:x1874208182305920:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787384525.047808:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384525.047819:0:10399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba30e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38ac expref: 18 pid: 6523 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384525.048322:0:10399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba30e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38ac expref: 18 pid: 6523 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384525.048352:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba30e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38ac expref: 18 pid: 6523 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384525.048375:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:0.0:1787384525.048382:0:10399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140600/0x7ef423838fba312a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384525.048395:0:10399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140600/0x7ef423838fba312a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384525.048403:0:10399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140600/0x7ef423838fba312a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384525.048502:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384525.048570:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d915aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+17:2416:x1874208182305920:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 813us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384525.048579:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 73 00010000:00010000:2.0:1787384525.050758:0:14031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140600/0x7ef423838fba312a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.050773:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140600/0x7ef423838fba312a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.050933:0:14031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140600/0x7ef423838fba312a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.050942:0:14031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140600/0x7ef423838fba312a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.050949:0:14031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140600/0x7ef423838fba312a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.050955:0:14031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384525.050959:0:14031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140600/0x7ef423838fba312a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.051085:0:14031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140600/0x7ef423838fba312a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.051107:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:2.0:1787384525.051111:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787384525.051118:0:14031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140600/0x7ef423838fba312a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.051126:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140600/0x7ef423838fba312a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384525.051411:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d915a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+16:11404:x1874208182305792:12345-192.168.203.45@tcp:55:lhsmtool_posix.0 Request processed in 14518us (14791us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787384525.051422:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 138 00000100:00100000:1.0:1787384525.059237:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384525.059356:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182306048 00000100:00100000:2.0:1787384525.059366:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182306048 00000100:00100000:2.0:1787384525.059419:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 53 00000100:00100000:2.0:1787384525.059429:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:2413:x1874208182306048:12345-192.168.203.45@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787384525.059474:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009ca6122b/0x7ef423838fba3131 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.059501:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000124fd424/0x7ef423838fba310e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38c8 expref: 7 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.059510:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384525.059515:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787384525.059521:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ca6122b/0x7ef423838fba3131 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.059575:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000124fd424/0x7ef423838fba310e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38c8 expref: 7 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.059936:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000124fd424/0x7ef423838fba310e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38c8 expref: 7 pid: 8438 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384525.059952:0:8435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7f06300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1874208203349248:192.168.203.45@tcp:104: 00000100:00100000:1.0:1787384525.060418:0:8435:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7240b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787384525.068417:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384525.068520:0:8435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7f06300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1874208203349248:192.168.203.45@tcp:104: 00010000:00010000:3.0:1787384525.068551:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009ca6122b/0x7ef423838fba3131 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384525.069439:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182306176 00000100:00100000:0.0:1787384525.069451:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182306176 00010000:00010000:0.0:1787384525.069504:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000124fd424/0x7ef423838fba310e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38c8 expref: 8 pid: 8438 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384525.069571:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 74 00000100:00100000:0.0:1787384525.069590:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+8:2415:x1874208182306176:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787384525.070461:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384525.070496:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000124fd424/0x7ef423838fba310e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38c8 expref: 8 pid: 8438 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384525.070518:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000124fd424/0x7ef423838fba310e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38c8 expref: 8 pid: 8438 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384525.070546:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000124fd424/0x7ef423838fba310e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38c8 expref: 8 pid: 8438 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384525.070567:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787384525.070572:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787384525.070578:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009ca6122b/0x7ef423838fba3131 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384525.070588:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ca6122b/0x7ef423838fba3131 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384525.070637:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384525.071652:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:2415:x1874208182306176:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 2066us (3240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384525.071663:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 74 00010000:00010000:0.0:1787384525.071717:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009ca6122b/0x7ef423838fba3131 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384525.071728:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ca6122b/0x7ef423838fba3131 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384525.071755:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009ca6122b/0x7ef423838fba3131 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384525.071763:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ca6122b/0x7ef423838fba3131 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384525.071771:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ca6122b/0x7ef423838fba3131 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384525.071806:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965bc00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384525.071810:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ca6122b/0x7ef423838fba3131 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384525.071820:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ca6122b/0x7ef423838fba3131 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384525.071847:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ca6122b/0x7ef423838fba3131 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384525.071856:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ca6122b/0x7ef423838fba3131 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384525.073682:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2413:x1874208182306048:12345-192.168.203.45@tcp:1:lhsmtool_posix.0 Request processed in 14243us (14443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384525.073696:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 53 00000100:00100000:3.0:1787384525.078698:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384525.078912:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182306432 00000100:00100000:0.0:1787384525.078924:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182306432 00000100:00100000:0.0:1787384525.079002:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 139 00000100:00100000:0.0:1787384525.079016:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d8530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+16:11404:x1874208182306432:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787384525.079119:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3138 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384525.079140:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba3027 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3874 expref: 16 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384525.079152:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3138 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384525.079211:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba3027 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3874 expref: 16 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384525.079230:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba3027 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3874 expref: 16 pid: 14031 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384525.079248:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1874208203349376:192.168.203.45@tcp:104: 00000100:00100000:0.0:1787384525.079356:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2aac900 going to sleep for 11 seconds 00000100:00100000:0.0:1787384525.082770:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1874208203349376:192.168.203.45@tcp:104: 00010000:00010000:0.0:1787384525.082840:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3138 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384525.083925:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384525.084225:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182306560 00000100:00100000:1.0:1787384525.084236:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182306560 00010000:00010000:1.0:1787384525.084288:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba3027 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3874 expref: 17 pid: 14031 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384525.084336:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 75 00000100:00100000:1.0:1787384525.084368:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d8533100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+17:2416:x1874208182306560:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384525.084388:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384525.084398:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba3027 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3874 expref: 17 pid: 14031 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384525.084417:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba3027 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3874 expref: 17 pid: 14031 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384525.084442:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba3027 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3874 expref: 17 pid: 14031 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384525.084461:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f7c3a9c600) 00010000:00010000:1.0:1787384525.084470:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba3089 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3897 expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384525.084484:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3138 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384525.084494:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3138 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384525.084504:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3138 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384525.084538:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384525.084762:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d8533100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+16:2416:x1874208182306560:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 398us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384525.084771:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 75 00010000:00010000:2.0:1787384525.084925:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3138 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.084933:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3138 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.085105:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba313f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.085116:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba30f2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38b3 expref: 16 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.085125:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba313f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.085153:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba30f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38b3 expref: 16 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.085166:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba30f2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38b3 expref: 16 pid: 8195 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384525.085203:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7f06a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1874208203349504:192.168.203.45@tcp:104: 00000100:00100000:2.0:1787384525.085255:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c72406c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384525.089360:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7f06a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1874208203349504:192.168.203.45@tcp:104: 00010000:00010000:0.0:1787384525.089402:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba313f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384525.091081:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384525.091226:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182306688 00000100:00100000:0.0:1787384525.091235:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182306688 00010000:00010000:0.0:1787384525.091272:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba30f2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38b3 expref: 17 pid: 8195 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384525.091310:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 76 00000100:00100000:0.0:1787384525.091319:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d8532a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+17:2415:x1874208182306688:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787384525.091333:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384525.091339:0:10399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba30f2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38b3 expref: 17 pid: 8195 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384525.091351:0:10399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba30f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38b3 expref: 17 pid: 8195 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384525.091374:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba30f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38b3 expref: 17 pid: 8195 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384525.091391:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:0.0:1787384525.091396:0:10399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba313f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384525.091423:0:10399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba313f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384525.091429:0:10399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba313f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384525.091462:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384525.091517:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d8532a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+16:2415:x1874208182306688:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 198us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384525.091524:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 76 00010000:00010000:2.0:1787384525.091597:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba313f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.091606:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba313f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787384525.091711:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1787384525.091885:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1787384525.091925:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:2.0:1787384525.092001:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7f05f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1874208203349632:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787384525.092060:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384525.092085:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8e8ab9180 going to sleep for 11 seconds 00000100:00100000:0.0:1787384525.092280:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203349632 00000100:00100000:0.0:1787384525.092285:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203349632 00000100:00100000:0.0:1787384525.092323:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787384525.092330:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6521:x1874208203349632:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787384525.092402:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6521:x1874208203349632:12345-0@lo:1000:mdt00_000.0 Request processed in 72us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384525.092408:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787384525.093270:0:6521:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1787384525.093277:0:6521:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:2.0:1787384525.093294:0:6521:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98f8d9158700, transno 4294967310 00000100:00100000:2.0:1787384525.093319:0:6521:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff98f8d9158380 x1874208203348608/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787384540 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384525.093331:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7f05f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1874208203349632:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787384525.093446:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1787384525.093495:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7f05f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1874208203349760:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787384525.093531:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384525.093558:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2b71a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787384525.093663:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203349760 00000100:00100000:0.0:1787384525.093669:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203349760 00000100:00100000:0.0:1787384525.093702:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787384525.093710:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6521:x1874208203349760:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787384525.093822:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6521:x1874208203349760:12345-0@lo:1000:mdt00_000.0 Request processed in 111us (288us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1787384525.093896:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787384525.093973:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7f05f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1874208203349760:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1787384525.094004:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba313f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.094023:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba313f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.094030:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba313f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.094035:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965a400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384525.094040:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba313f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.094046:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba313f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.094074:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:2.0:1787384525.094077:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787384525.094081:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba313f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.094087:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba313f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.094111:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba3082 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.094117:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba3082 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.094123:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba3082 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.094128:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3952400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384525.094137:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba3082 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.094144:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba3082 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.094152:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f7c3a9c600) 00010000:00010000:2.0:1787384525.094154:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787384525.094160:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba3089 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3897 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.094171:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba3089 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3897 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.094179:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba3089 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3897 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.094205:0:6521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba3089 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3897 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384525.094217:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7f05500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1874208203349888:192.168.203.45@tcp:105: 00000100:00100000:2.0:1787384525.094282:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2b71a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787384525.102765:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7f05500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1874208203349888:192.168.203.45@tcp:105: 00010000:00010000:2.0:1787384525.102818:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba3082 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.102838:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba3082 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.102891:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba3146 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.102905:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba3146 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.102916:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba3146 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.102925:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba3146 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.102931:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba3146 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.102938:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba3146 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.102944:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965a400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384525.102948:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba3146 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.102954:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba3146 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.102965:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f7c3a9c600) 00010000:00010000:2.0:1787384525.102968:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384525.102972:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba3146 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.102977:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba3146 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.102993:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3138 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.102999:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3138 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.103006:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3138 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.103010:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140e00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384525.103013:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3138 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.103018:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3138 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.103026:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f7c3a9c600) 00010000:00010000:2.0:1787384525.103028:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787384525.103030:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3138 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.103035:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3138 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384525.103189:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d8530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+19:11404:x1874208182306432:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 Request processed in 24176us (24502us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1787384525.103198:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 139 00000020:00080000:2.0:1787384525.103203:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787384525.103652:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787384525.103659:0:13801:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787384525.105211:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787384525.105241:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787384525.105427:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384525.106707:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182306816 00000100:00100000:0.0:1787384525.106725:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182306816 00000100:00100000:0.0:1787384525.106890:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 31 00000100:00100000:0.0:1787384525.106901:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d8531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+19:11403:x1874208182306816:12345-192.168.203.45@tcp:49:lfs.0 00000100:00100000:0.0:1787384525.107046:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d8531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+19:11403:x1874208182306816:12345-192.168.203.45@tcp:49:lfs.0 Request processed in 146us (1628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384525.107064:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 31 00000100:00100000:1.0:1787384525.109942:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384525.110385:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182307072 00000100:00100000:2.0:1787384525.110395:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182307072 00000100:00100000:2.0:1787384525.110442:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 32 00000100:00100000:2.0:1787384525.110450:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9507850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+19:11404:x1874208182307072:12345-192.168.203.45@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787384525.110933:0:6525:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787384525.110967:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:2.0:1787384525.111001:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba314d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.111016:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba314d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.111027:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba314d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.111035:0:6525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba314d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.111041:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba314d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.111056:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba314d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.111118:0:6525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787384525.111209:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9507850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+21:11404:x1874208182307072:12345-192.168.203.45@tcp:35:lhsmtool_posix.0 Request processed in 758us (1275us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1787384525.111216:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 32 00000020:00080000:2.0:1787384525.111221:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787384525.112869:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384525.112994:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182307328 00000100:00100000:3.0:1787384525.113004:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182307328 00000100:00100000:3.0:1787384525.113070:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 140 00000100:00100000:3.0:1787384525.113080:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+21:11403:x1874208182307328:12345-192.168.203.45@tcp:58:lfs.0 00000040:00080000:3.0:1787384525.113229:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1787384525.113302:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+21:11403:x1874208182307328:12345-192.168.203.45@tcp:58:lfs.0 Request processed in 223us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384525.113310:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 140 00010000:00010000:1.0:1787384525.115259:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384525.115273:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba314d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384525.115284:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965a400 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384525.115289:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba314d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384525.115299:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba314d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384525.115318:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:1.0:1787384525.115320:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787384525.115325:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba314d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384525.115330:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba314d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384525.115346:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384525.115348:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384525.115349:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384525.144923:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384525.145024:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182307456 00000100:00100000:2.0:1787384525.145039:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182307456 00000100:00100000:2.0:1787384525.145119:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 141 00000100:00100000:2.0:1787384525.145129:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d8531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+21:11406:x1874208182307456:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:2.0:1787384525.145170:0:14031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384525.145192:0:14031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3154 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce38cf expref: -99 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.145261:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba315b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.145275:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba315b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.145286:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba315b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.145300:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba3162 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.145308:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba3162 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.145314:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba3162 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.145382:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a000/0x7ef423838fba3169 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.145389:0:14031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba3074 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3890 expref: 22 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.145395:0:14031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a000/0x7ef423838fba3169 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.145422:0:14031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba3074 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3890 expref: 22 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.145437:0:14031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba3074 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3890 expref: 22 pid: 14031 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384525.145447:0:14031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7f05500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14031:1874208203350016:192.168.203.45@tcp:104: 00000100:00100000:2.0:1787384525.145532:0:14031:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2b71cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384525.152108:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384525.152128:0:14031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7f05500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14031:1874208203350016:192.168.203.45@tcp:104: 00010000:00010000:0.0:1787384525.152156:0:14031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a000/0x7ef423838fba3169 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384525.152444:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182307712 00000100:00100000:1.0:1787384525.152454:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182307712 00000100:00100000:1.0:1787384525.152534:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 33 00000100:00100000:1.0:1787384525.152562:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+23:6184:x1874208182307712:12345-192.168.203.45@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787384525.153077:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+24:6184:x1874208182307712:12345-192.168.203.45@tcp:35:ldlm_bl.0 Request processed in 532us (978us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1787384525.153085:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 33 00000100:00100000:1.0:1787384525.155342:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384525.155937:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182307840 00000100:00100000:0.0:1787384525.155947:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182307840 00010000:00010000:0.0:1787384525.155982:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba3074 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3890 expref: 24 pid: 14031 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384525.156033:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 77 00000100:00100000:0.0:1787384525.156043:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9158700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+24:2415:x1874208182307840:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787384525.156066:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384525.156072:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba3074 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3890 expref: 24 pid: 14031 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384525.156086:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba3074 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3890 expref: 24 pid: 14031 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384525.156121:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba3074 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3890 expref: 24 pid: 14031 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384525.156136:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f7c3a9c600) 00010000:00010000:0.0:1787384525.156140:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a000/0x7ef423838fba3169 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384525.156150:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a000/0x7ef423838fba3169 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384525.156157:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a000/0x7ef423838fba3169 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384525.156189:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384525.156246:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9158700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+23:2415:x1874208182307840:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 203us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384525.156253:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 77 00010000:00010000:2.0:1787384525.156268:0:14031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a000/0x7ef423838fba3169 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.156278:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a000/0x7ef423838fba3169 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384525.156335:0:14031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787384525.156339:0:14031:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787384525.156358:0:14031:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a000/0x7ef423838fba3169 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.156372:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a000/0x7ef423838fba3169 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.156382:0:14031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba315b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.156389:0:14031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba315b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.156396:0:14031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba315b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.156401:0:14031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965a800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384525.156412:0:14031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba315b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.156420:0:14031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba315b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.156429:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f8fd1ea700) 00010000:00010000:2.0:1787384525.156431:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384525.156434:0:14031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba315b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.156440:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba315b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.156450:0:14031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba3162 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.156455:0:14031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba3162 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.156461:0:14031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba3162 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.156466:0:14031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965b600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384525.156469:0:14031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba3162 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.156473:0:14031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba3162 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.156480:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff98f8e8aa4a00) 00010000:00010000:2.0:1787384525.156482:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384525.156491:0:14031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba3162 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.156497:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba3162 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.156532:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3154 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38cf expref: 23 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.158310:0:14031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a000/0x7ef423838fba3169 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38cf expref: 22 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384525.158325:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f7c3a9c600) 00010000:00010000:2.0:1787384525.158328:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787384525.158331:0:14031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965a000, rc 0) 00000100:00100000:2.0:1787384525.159989:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d8531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+22:11406:x1874208182307456:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 14849us (15069us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384525.160001:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 141 00010000:00010000:2.0:1787384525.751272:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787384526.130144:0:14268:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787384526.130154:0:14268:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787384526.130355:0:14268:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787384526.130363:0:14268:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1787384526.144970:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787384526.144979:0:13801:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787384526.145021:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787384526.145030:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787384526.145676:0:13801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d8530a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1874208203350144:192.168.203.45@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787384526.145807:0:13801:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d829ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1787384526.150757:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384526.150827:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182307968 00000100:00100000:1.0:1787384526.150836:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182307968 00000100:00100000:1.0:1787384526.150891:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 142 00000100:00100000:1.0:1787384526.150900:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d8532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+23:11418:x1874208182307968:12345-192.168.203.45@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787384526.150997:0:6521:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787384526.151104:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d8532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+23:11418:x1874208182307968:12345-192.168.203.45@tcp:53:lhsmtool_posix.0 Request processed in 205us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384526.151112:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 142 00000100:00100000:0.0:1787384526.151488:0:13801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d8530a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1874208203350144:192.168.203.45@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787384526.158662:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384526.158739:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182308224 00000100:00100000:3.0:1787384526.158750:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182308224 00000100:00100000:3.0:1787384526.158939:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 143 00000100:00100000:3.0:1787384526.158949:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+22:11418:x1874208182308224:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787384526.158969:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384526.158999:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3170 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce38d6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384526.159114:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba3177 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384526.159130:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba3177 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384526.159489:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba3177 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384526.159502:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787384526.159613:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3170 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38d6 expref: 25 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384526.159630:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba3177 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38d6 expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384526.159639:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f7c3a9c600) 00010000:00010000:3.0:1787384526.159642:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787384526.159646:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cc000, rc 0) 00000100:00100000:3.0:1787384526.159719:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+24:11418:x1874208182308224:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 770us (1064us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1787384526.159746:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 143 00000100:00100000:1.0:1787384526.173372:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384526.173412:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182308352 00000100:00100000:1.0:1787384526.173421:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182308352 00000100:00100000:1.0:1787384526.173483:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 11 00000100:00100000:1.0:1787384526.173495:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d915ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+24:2413:x1874208182308352:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384526.173511:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384526.173538:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba3177 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38d6 expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384526.173557:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f7c3a9c600) 00010000:00010000:1.0:1787384526.173562:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384526.173614:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d915ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+23:2413:x1874208182308352:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 120us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384526.173622:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 11 00000100:00100000:2.0:1787384526.175856:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384526.175922:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182308608 00000100:00100000:3.0:1787384526.175929:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182308608 00000100:00100000:3.0:1787384526.176051:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 144 00000100:00100000:3.0:1787384526.176061:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+23:11418:x1874208182308608:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787384526.176138:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba3185 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384526.176155:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba3185 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384526.176166:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba3185 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384526.176436:0:14031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba3185 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384526.176446:0:14031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba3185 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384526.176453:0:14031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba3185 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384526.176459:0:14031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cd600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384526.176463:0:14031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba3185 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384526.176471:0:14031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba3185 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384526.176493:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f7c3a9c600) 00010000:00010000:3.0:1787384526.176497:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787384526.176501:0:14031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba3185 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384526.176508:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba3185 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384526.176837:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+24:11418:x1874208182308608:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 Request processed in 776us (984us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1787384526.176846:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 144 00000040:00080000:2.0:1787384526.177137:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787384526.177142:0:13801:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787384526.178231:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787384526.178242:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787384526.184770:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384526.186989:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182308864 00000100:00100000:1.0:1787384526.187008:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182308864 00000100:00100000:1.0:1787384526.187172:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 34 00000100:00100000:1.0:1787384526.187183:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+24:11418:x1874208182308864:12345-192.168.203.45@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787384526.187395:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+25:11418:x1874208182308864:12345-192.168.203.45@tcp:35:lhsmtool_posix.0 Request processed in 213us (2634us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1787384526.187403:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 34 00000100:00100000:1.0:1787384526.266545:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787384526.266584:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203350272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787384526.266674:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384526.266739:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203350272 00000100:00100000:0.0:1787384526.266751:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203350272 00000100:00100000:0.0:1787384526.266855:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787384526.266869:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9159880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3653:x1874208203350272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787384526.266897:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00080000:3.0:1787384526.267017:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787384526.267427:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203350400:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787384526.267515:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9159880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3653:x1874208203350272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 650us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384526.267523:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787384526.269510:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203350272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787384526.270914:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384526.271182:0:13608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203350400 00000100:00100000:1.0:1787384526.271194:0:13608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203350400 00000100:00100000:1.0:1787384526.271285:0:13608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00080000:3.0:1787384526.271291:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787384526.271301:0:13608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d8533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203350400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787384526.271332:0:13608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:1.0:1787384526.271492:0:13608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d8533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203350400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 196us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384526.271500:0:13608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787384526.271599:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203350400:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787384526.775519:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384526.776548:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787384526.776579:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d8531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203350528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787384526.776679:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384526.778458:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d915a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203350656:0@lo:400:kworker.0 00000100:00100000:0.0:1787384526.778587:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384526.778682:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203350656 00000100:00100000:0.0:1787384526.778693:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203350656 00000100:00100000:0.0:1787384526.778761:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1787384526.778773:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d945bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3653:x1874208203350656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384526.778881:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d945bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3653:x1874208203350656:12345-0@lo:400:kworker.0 Request processed in 110us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384526.778890:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1787384526.780033:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203350528 00000100:00100000:3.0:1787384526.780053:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203350528 00000100:00100000:3.0:1787384526.780125:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787384526.780136:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d915bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874208203350528:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787384526.780582:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d915b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203350912:0@lo:400:kworker.0 00000100:00100000:1.0:1787384526.780663:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384526.781025:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203351168:0@lo:400:kworker.0 00000100:00080000:2.0:1787384526.781119:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787384526.782675:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874208203350784:0@lo:400:kworker.0 00000100:00100000:0.0:1787384526.782760:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384526.782834:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874208203351296:0@lo:400:kworker.0 00000100:00100000:0.0:1787384526.782859:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384526.782880:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203351808:0@lo:400:kworker.0 00000100:00100000:0.0:1787384526.782907:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384526.782989:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203350784 00000100:00100000:0.0:1787384526.782999:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203350784 00000100:00100000:1.0:1787384526.783258:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874208203351424:0@lo:400:kworker.0 00000100:00100000:1.0:1787384526.783309:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1787384526.783454:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787384526.783618:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203351296 00000100:00100000:0.0:1787384526.783623:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203351296 00000100:00100000:0.0:1787384526.783659:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203351424 00000100:00100000:0.0:1787384526.783662:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203351424 00000100:00100000:0.0:1787384526.783684:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1787384526.783694:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874208203350784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384526.785567:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203350912 00000100:00100000:2.0:1787384526.785833:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203350912 00000100:00100000:2.0:1787384526.785913:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787384526.785925:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203350912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384526.789980:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d915bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874208203350528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9814us (13270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384526.790001:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787384526.790133:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1787384526.790154:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874208203351296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384526.790287:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874208203351296:12345-0@lo:400:kworker.0 Request processed in 143us (7426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384526.790295:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1787384526.790331:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1787384526.790340:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874208203351424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384526.790376:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874208203351424:12345-0@lo:400:kworker.0 Request processed in 38us (7066us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384526.790382:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1787384526.790409:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203351808 00000100:00100000:3.0:1787384526.790420:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203351808 00000100:00100000:3.0:1787384526.790479:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787384526.790486:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203351808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384526.790522:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203351808:12345-0@lo:400:kworker.0 Request processed in 37us (7614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384526.790528:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787384526.790568:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c355b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874208203351040:0@lo:400:kworker.0 00000100:00100000:3.0:1787384526.790615:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384526.790645:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874208203351552:0@lo:400:kworker.0 00000100:00100000:3.0:1787384526.790669:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384526.790697:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203351040 00000100:00100000:3.0:1787384526.790701:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203351040 00000100:00100000:3.0:1787384526.790718:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203351552 00000100:00100000:3.0:1787384526.790721:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203351552 00000100:00100000:3.0:1787384526.790739:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1787384526.790744:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d8531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874208203351040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384526.790813:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d8531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874208203351040:12345-0@lo:400:kworker.0 Request processed in 67us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384526.790828:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1787384526.790843:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1787384526.790849:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d8531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874208203351552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384526.790898:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d8531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874208203351552:12345-0@lo:400:kworker.0 Request processed in 48us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384526.790903:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1787384526.790947:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c355b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874208203351040:0@lo:400:kworker.0 00000100:00100000:3.0:1787384526.790958:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874208203351552:0@lo:400:kworker.0 00000100:00100000:3.0:1787384526.791030:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874208203351296:0@lo:400:kworker.0 00000100:00100000:3.0:1787384526.791055:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203351808:0@lo:400:kworker.0 00000100:00080000:3.0:1787384526.791090:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787384526.791096:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787384526.791099:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787384526.791136:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384526.791173:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874208203351680:0@lo:400:kworker.0 00000100:00100000:3.0:1787384526.795500:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384526.795601:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d915a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203350656:0@lo:400:kworker.0 00000100:00100000:3.0:1787384526.795681:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203351680 00000100:00100000:3.0:1787384526.795691:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203351680 00000100:00100000:3.0:1787384526.795774:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1787384526.795812:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c355b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874208203351680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384526.795902:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c355b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874208203351680:12345-0@lo:400:kworker.0 Request processed in 92us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384526.795933:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00080000:3.0:1787384526.800994:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787384526.801108:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7e65c00 x1874208203351680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384526.801129:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874208203351680:0@lo:400:kworker.0 00000100:00100000:3.0:1787384526.801572:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203351168 00000100:00100000:3.0:1787384526.801583:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203351168 00000100:00100000:3.0:1787384526.801653:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787384526.801663:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d8530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203351168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384526.801816:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d8530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203351168:12345-0@lo:400:kworker.0 Request processed in 153us (10678us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384526.801825:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787384526.801872:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203351168:0@lo:400:kworker.0 00010000:00080000:1.0:1787384526.805088:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7e64a80 x1874208203351424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384526.805112:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874208203351424:0@lo:400:kworker.0 00000100:00100000:1.0:1787384526.805144:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d8531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203350528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384526.808548:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874208203350784:12345-0@lo:400:kworker.0 Request processed in 24838us (25769us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384526.808568:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1787384526.808640:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874208203350784:0@lo:400:kworker.0 00000100:00100000:1.0:1787384526.812835:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d915b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203350912:0@lo:400:kworker.0 00000100:00100000:2.0:1787384526.813634:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203350912:12345-0@lo:400:kworker.0 Request processed in 27704us (32963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384526.813650:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000040:00080000:0.0:1787384527.223090:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787384527.223104:0:13801:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787384527.223152:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787384527.223164:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787384527.288285:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203351936:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787384527.288401:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384527.288727:0:13608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203351936 00000100:00100000:2.0:1787384527.288737:0:13608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203351936 00000100:00100000:2.0:1787384527.288834:0:13608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787384527.288846:0:13608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203351936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787384527.288873:0:13608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384527.288938:0:13608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203351936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384527.288946:0:13608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787384527.289092:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203351936:0@lo:13:osp-pre-1-1.0 00000040:00080000:1.0:1787384527.422193:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787384527.713398:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384527.713913:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384527.713945:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384527.714274:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182309120 00000100:00100000:2.0:1787384527.714292:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182309120 00000100:00100000:2.0:1787384527.714377:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182309632 00000100:00100000:2.0:1787384527.714381:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182309632 00000100:00100000:2.0:1787384527.714409:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 312 00000100:00100000:2.0:1787384527.714420:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d915b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+25:2414:x1874208182309120:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384527.714528:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384527.714565:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384527.714587:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384527.714613:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384527.714641:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182309248 00000100:00100000:3.0:1787384527.714645:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182309248 00000100:00100000:3.0:1787384527.714666:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182309760 00000100:00100000:3.0:1787384527.714668:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182309760 00000100:00100000:3.0:1787384527.714694:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 313 00000100:00100000:3.0:1787384527.714700:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d915a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182309632:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384527.714947:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d915b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+25:2414:x1874208182309120:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 529us (1565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384527.715096:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182309376 00000100:00100000:0.0:1787384527.715101:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182309376 00000100:00100000:0.0:1787384527.715139:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182309504 00000100:00100000:0.0:1787384527.715142:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182309504 00000100:00100000:0.0:1787384527.715180:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 109 00000100:00100000:0.0:1787384527.715188:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2414:x1874208182309376:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384527.715220:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2414:x1874208182309376:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 33us (1309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384527.715227:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 109 00000100:00100000:0.0:1787384527.715247:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 110 00000100:00100000:0.0:1787384527.715254:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4307100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2414:x1874208182309504:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384527.715278:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4307100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2414:x1874208182309504:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 25us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384527.715285:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 110 00000100:00100000:0.0:1787384527.715308:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182308992 00000100:00100000:0.0:1787384527.715311:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182308992 00000100:00100000:0.0:1787384527.715340:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 383 00000100:00100000:0.0:1787384527.715346:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d945ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+13:2414:x1874208182308992:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384527.715369:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d945ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+13:2414:x1874208182308992:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 24us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384527.715376:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 383 00000100:00100000:2.0:1787384527.715901:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 312 00000100:00100000:3.0:1787384527.715983:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d915a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182309632:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 1281us (2036us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384527.716265:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 314 00000100:00100000:0.0:1787384527.716280:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2414:x1874208182309248:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384527.716340:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2414:x1874208182309248:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 66us (1774us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384527.716349:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 314 00000100:00100000:0.0:1787384527.716372:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 315 00000100:00100000:0.0:1787384527.716380:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182309760:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384527.716408:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182309760:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 29us (1794us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384527.716415:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 315 00000100:00080000:0.0:1787384527.719206:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787384527.719219:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787384527.719224:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787384527.719228:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787384527.722253:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 313 00010000:00010000:3.0:1787384527.799110:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787384528.167534:0:14320:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787384528.167547:0:14320:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787384528.167584:0:14320:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787384528.167594:0:14320:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787384528.393366:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384528.395269:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182310016 00000100:00100000:1.0:1787384528.395288:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182310016 00000100:00100000:1.0:1787384528.395367:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 145 00000100:00100000:1.0:1787384528.395378:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+25:11439:x1874208182310016:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:1.0:1787384528.395411:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384528.396278:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953e00/0x7ef423838fba318c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce38dd expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384528.396987:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953600/0x7ef423838fba3193 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384528.397526:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953600/0x7ef423838fba3193 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384528.397542:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953600/0x7ef423838fba3193 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384528.397562:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787384528.397736:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953e00/0x7ef423838fba318c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38dd expref: 28 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384528.397756:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953600/0x7ef423838fba3193 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38dd expref: 27 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384528.397767:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f7c3a9c600) 00010000:00010000:1.0:1787384528.397771:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787384528.397806:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3953600, rc 0) 00000100:00100000:1.0:1787384528.400149:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+27:11439:x1874208182310016:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 4756us (6781us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1787384528.400230:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 145 00000100:00100000:3.0:1787384528.403811:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384528.403872:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182310144 00000100:00100000:3.0:1787384528.403885:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182310144 00000100:00100000:3.0:1787384528.405408:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 146 00000100:00100000:3.0:1787384528.406104:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+27:11439:x1874208182310144:12345-192.168.203.45@tcp:54:lfs.0 00010000:00010000:3.0:1787384528.407242:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba31a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384528.407269:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba31a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384528.407283:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba31a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384528.407335:0:8195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba31a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384528.407344:0:8195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba31a1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384528.407351:0:8195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba31a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384528.407375:0:8195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cd600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384528.407380:0:8195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba31a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384528.407389:0:8195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba31a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384528.407405:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f7c3a9c600) 00010000:00010000:3.0:1787384528.407408:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787384528.407415:0:8195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba31a1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384528.409131:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba31a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384528.409400:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+27:11439:x1874208182310144:12345-192.168.203.45@tcp:54:lfs.0 Request processed in 3972us (5618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384528.409413:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 146 00000100:00100000:2.0:1787384528.506720:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384528.508620:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182310272 00000100:00100000:0.0:1787384528.508639:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182310272 00000100:00100000:0.0:1787384528.508843:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 54 00000100:00100000:0.0:1787384528.508856:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2416:x1874208182310272:12345-192.168.203.45@tcp:101:cat.0 00010000:00010000:0.0:1787384528.508881:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384528.508911:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037b223cf/0x7ef423838fba31a8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce38e4 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787384528.508960:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a8952cb, atime: 0x6a8952ca, ctime: 0x6a8952cb, blocks: 0x8 00010000:00010000:1.0:1787384528.509049:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=423s v=(0 0) 00010000:00010000:1.0:1787384528.509056:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384528.509069:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037b223cf/0x7ef423838fba31a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38e4 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384528.509093:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000037b223cf/0x7ef423838fba31a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38e4 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384528.509139:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6140600, rc 0) 00000100:00100000:1.0:1787384528.509238:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:2416:x1874208182310272:12345-192.168.203.45@tcp:101:cat.0 Request processed in 384us (2532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384528.509247:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 54 00000100:00100000:3.0:1787384528.514279:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384528.515310:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182310400 00000100:00100000:1.0:1787384528.515325:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182310400 00002000:00100000:1.0:1787384528.515517:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff98f8f7e68000 x1874208182310400/t0(0) o3->55e96ad5-fd9d-44d4-856e-5db0c40b1329@192.168.203.45@tcp:559/0 lens 488/0 e 0 to 0 dl 1787384539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787384528.515530:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98f8f7e68000 with x1874208182310400 ext(0->4095) 00002000:00010000:1.0:1787384528.515537:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98f8f7e68000 00000100:00100000:1.0:1787384528.515632:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 3 00000100:00100000:1.0:1787384528.515643:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:2416:x1874208182310400:12345-192.168.203.45@tcp:3:cat.0 00000100:00100000:1.0:1787384528.515923:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:2416:x1874208182310400:12345-192.168.203.45@tcp:3:cat.0 Request processed in 280us (1658us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787384528.515932:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 3 00002000:00100000:1.0:1787384528.515946:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff98f8f7e68000 x1874208182310400/t0(0) o3->55e96ad5-fd9d-44d4-856e-5db0c40b1329@192.168.203.45@tcp:559/0 lens 488/4536 e 0 to 0 dl 1787384539 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787384528.515955:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98f8f7e68000 with x1874208182310400 ext(0->4095) 00002000:00010000:1.0:1787384528.515959:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98f8f7e68000 00000100:00100000:1.0:1787384528.823441:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1787384528.823954:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384528.832287:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203352064:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787384528.832415:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384528.834085:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203352064 00000100:00100000:3.0:1787384528.834103:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203352064 00000100:00100000:3.0:1787384528.834192:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787384528.834204:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203352064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787384528.834254:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787384528.834373:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203352064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 163us (1951us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384528.834381:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787384528.834941:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203352064:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787384529.337388:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203352192:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787384529.337489:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384529.337662:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203352192 00000100:00100000:2.0:1787384529.337673:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203352192 00000100:00100000:2.0:1787384529.337738:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787384529.337751:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203352192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787384529.337850:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1787384529.337921:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203352192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 171us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384529.337929:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787384529.338165:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203352192:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787384529.847539:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384530.872320:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787384530.886415:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:2.0:1787384530.886431:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:3.0:1787384530.888348:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:0.0:1787384530.888653:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:0.0:1787384530.888727:0:6501:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98f7c2b713c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1787384530.888734:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff98f7c209e600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98f7c2b71480 00000020:00080000:0.0:1787384530.888738:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff98f7c209e100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98f8d9461600 00000020:00080000:0.0:1787384530.888773:0:6501:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1787384530.888938:0:6553:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1787384530.889059:0:6553:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1787384530.889442:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba3123 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384530.889470:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba3123 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384530.889480:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba3123 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384530.889488:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965aa00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384530.889494:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba3123 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384530.889501:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba3123 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384530.889525:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff98f8e8aa4900) 00010000:00010000:2.0:1787384530.889529:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384530.889535:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba3123 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384530.889542:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965aa00/0x7ef423838fba3123 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384531.383102:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203352320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787384531.383175:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384531.387700:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203352320 00000100:00100000:3.0:1787384531.387714:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203352320 00000100:00100000:2.0:1787384531.387863:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787384531.387893:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203352448:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787384531.388081:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384531.388214:0:13608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203352448 00000100:00100000:1.0:1787384531.388219:0:13608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203352448 00000100:00100000:1.0:1787384531.388273:0:13608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787384531.388283:0:13608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203352448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787384531.388311:0:13608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787384531.388354:0:13608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203352448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384531.388361:0:13608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:1.0:1787384531.388385:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787384531.388411:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787384531.388421:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203352320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787384531.388432:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787384531.388476:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203352320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (5301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384531.388483:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787384531.388903:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203352448:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787384531.389003:0:3654:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1787384531.389018:0:3654:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98f8d9158380, transno 4294967311 00000004:00080000:1.0:1787384531.389036:0:3654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:1.0:1787384531.389061:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203352320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787384531.895410:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787384531.895432:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203352576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787384531.895497:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384531.895566:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203352576 00000100:00100000:1.0:1787384531.895574:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203352576 00000100:00100000:1.0:1787384531.895622:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787384531.895632:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203352576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787384531.895674:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787384531.895715:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203352576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384531.895740:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:1.0:1787384531.895763:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787384531.895919:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384531.895970:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1787384531.895975:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98f8d8532300, transno 4294967305 00000100:00100000:1.0:1787384531.896010:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203352576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787384531.898335:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c426b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203352960:0@lo:400:kworker.0 00000100:00100000:3.0:1787384531.898399:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384531.898445:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c426b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874208203353472:0@lo:400:kworker.0 00000100:00100000:3.0:1787384531.898474:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384531.898504:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787384531.898510:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4269500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203353088:0@lo:400:kworker.0 00000100:00100000:3.0:1787384531.898529:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384531.898543:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c426aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874208203353600:0@lo:400:kworker.0 00000100:00100000:3.0:1787384531.898561:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384531.898590:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203353472 00000100:00100000:3.0:1787384531.898596:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203353472 00000100:00100000:3.0:1787384531.898641:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203353088 00000100:00100000:3.0:1787384531.898644:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203353088 00000100:00100000:3.0:1787384531.898676:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203353600 00000100:00100000:3.0:1787384531.898679:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203353600 00000100:00100000:3.0:1787384531.898696:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1787384531.898704:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874208203353472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384531.898767:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874208203353472:12345-0@lo:400:kworker.0 Request processed in 64us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384531.898775:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1787384531.898827:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1787384531.898833:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203353088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384531.898862:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203353088:12345-0@lo:400:kworker.0 Request processed in 29us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384531.898868:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1787384531.898994:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1787384531.899011:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874208203353600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384531.899042:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874208203353600:12345-0@lo:400:kworker.0 Request processed in 41us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384531.899048:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1787384531.899089:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4269500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203353088:0@lo:400:kworker.0 00000100:00100000:3.0:1787384531.899099:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c426aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874208203353600:0@lo:400:kworker.0 00010000:00080000:3.0:1787384531.899110:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c426b480 x1874208203353472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384531.899121:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c426b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874208203353472:0@lo:400:kworker.0 00000100:00100000:0.0:1787384531.899650:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203352704:0@lo:400:kworker.0 00000100:00100000:0.0:1787384531.899701:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384531.899736:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c426b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203353216:0@lo:400:kworker.0 00000100:00100000:0.0:1787384531.899759:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384531.899804:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4269f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874208203353728:0@lo:400:kworker.0 00000100:00100000:0.0:1787384531.899828:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384531.899849:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787384531.900439:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203352832:0@lo:400:kworker.0 00000100:00100000:0.0:1787384531.900471:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384531.900495:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4269880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203353344:0@lo:400:kworker.0 00000100:00100000:0.0:1787384531.900515:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384531.900530:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c426ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203353856:0@lo:400:kworker.0 00000100:00100000:0.0:1787384531.900551:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384531.900582:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203353856 00000100:00100000:0.0:1787384531.900587:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203353856 00000100:00100000:0.0:1787384531.900631:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787384531.900639:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203353856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384531.900738:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203353856:12345-0@lo:400:kworker.0 Request processed in 99us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384531.900756:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787384531.900958:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203353728 00000100:00100000:0.0:1787384531.900963:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203353728 00000100:00100000:0.0:1787384531.900984:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203352832 00000100:00100000:0.0:1787384531.900987:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203352832 00000100:00100000:0.0:1787384531.900998:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203353344 00000100:00100000:0.0:1787384531.902259:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203353344 00000100:00100000:0.0:1787384531.902305:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1787384531.902314:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874208203353728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384531.902376:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874208203353728:12345-0@lo:400:kworker.0 Request processed in 64us (2546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384531.902383:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1787384531.902399:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1787384531.902405:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203352832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384531.902433:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203352832:12345-0@lo:400:kworker.0 Request processed in 29us (1961us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384531.902438:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1787384531.902449:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1787384531.902455:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203353344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384531.902481:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203353344:12345-0@lo:400:kworker.0 Request processed in 26us (1964us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384531.902486:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1787384531.902541:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203352832:0@lo:400:kworker.0 00000100:00100000:0.0:1787384531.902552:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4269880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203353344:0@lo:400:kworker.0 00000100:00100000:0.0:1787384531.902563:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c426ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203353856:0@lo:400:kworker.0 00010000:00080000:0.0:1787384531.902588:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4269f80 x1874208203353728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384531.902599:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4269f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874208203353728:0@lo:400:kworker.0 00000100:00100000:2.0:1787384531.902733:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203352960 00000100:00100000:2.0:1787384531.902738:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203352960 00000100:00100000:2.0:1787384531.902768:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203353216 00000100:00100000:2.0:1787384531.902772:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203353216 00000100:00100000:2.0:1787384531.902815:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787384531.902821:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203352960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384531.902865:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203352960:12345-0@lo:400:kworker.0 Request processed in 43us (4466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384531.902871:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787384531.903119:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787384531.903137:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203353216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384531.903177:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203353216:12345-0@lo:400:kworker.0 Request processed in 52us (3416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384531.903183:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787384531.903220:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c426b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203353216:0@lo:400:kworker.0 00000100:00100000:2.0:1787384531.903245:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c426b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203352960:0@lo:400:kworker.0 00000100:00100000:3.0:1787384531.903751:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203352704 00000100:00100000:3.0:1787384531.903758:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203352704 00000100:00100000:3.0:1787384531.903831:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1787384531.903839:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3653:x1874208203352704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384531.903892:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3653:x1874208203352704:12345-0@lo:400:kworker.0 Request processed in 53us (4189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384531.903910:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00080000:1.0:1787384531.904194:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787384531.904200:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787384531.904202:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787384531.904805:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203352704:0@lo:400:kworker.0 00000100:00100000:0.0:1787384532.407994:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787384532.408028:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203353984:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787384532.408102:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384532.408161:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203353984 00000100:00100000:0.0:1787384532.408167:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203353984 00000100:00100000:0.0:1787384532.408210:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787384532.408219:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee532450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203353984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787384532.408242:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787384532.408295:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee532450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203353984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384532.408303:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787384532.408529:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203353984:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787384532.835260:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384532.835297:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384532.835316:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384532.835343:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384532.835372:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182310656 00000100:00100000:0.0:1787384532.835382:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182310656 00000100:00100000:0.0:1787384532.835434:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182311168 00000100:00100000:0.0:1787384532.835437:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182311168 00000100:00100000:0.0:1787384532.835460:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 322 00000100:00100000:0.0:1787384532.835469:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+13:2415:x1874208182310656:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384532.835542:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+13:2415:x1874208182310656:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 74us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384532.835557:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 322 00000100:00100000:0.0:1787384532.835575:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 323 00000100:00100000:0.0:1787384532.835581:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2415:x1874208182311168:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384532.835607:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2415:x1874208182311168:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 27us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384532.835613:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 323 00000100:00100000:0.0:1787384532.835633:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182310528 00000100:00100000:0.0:1787384532.835636:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182310528 00000100:00100000:0.0:1787384532.835659:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 385 00000100:00100000:0.0:1787384532.835664:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+13:2415:x1874208182310528:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384532.835684:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+13:2415:x1874208182310528:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 20us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384532.835689:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 385 00000100:00080000:1.0:1787384532.836653:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384532.836980:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182310912 00000100:00100000:2.0:1787384532.836987:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182310912 00000100:00100000:2.0:1787384532.837059:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 112 00000100:00100000:2.0:1787384532.837070:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2415:x1874208182310912:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384532.837139:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2415:x1874208182310912:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 72us (1841us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384532.837155:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 112 00000100:00080000:1.0:1787384532.837845:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787384532.838376:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384532.838411:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384532.838436:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384532.838455:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182311040 00000100:00100000:2.0:1787384532.838461:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182311040 00000100:00100000:2.0:1787384532.838500:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 113 00000100:00100000:2.0:1787384532.838508:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c426b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2415:x1874208182311040:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384532.838552:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c426b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2415:x1874208182311040:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 45us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384532.838558:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 113 00000100:00080000:2.0:1787384532.838576:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787384532.838606:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182310784 00000100:00100000:2.0:1787384532.838610:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182310784 00000100:00100000:2.0:1787384532.838633:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182311296 00000100:00100000:2.0:1787384532.838635:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182311296 00000100:00100000:2.0:1787384532.838653:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 324 00000100:00100000:2.0:1787384532.838658:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c426b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2415:x1874208182310784:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384532.838684:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c426b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2415:x1874208182310784:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 26us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384532.838690:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 324 00000100:00100000:2.0:1787384532.838701:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 325 00000100:00100000:2.0:1787384532.838707:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4269f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2415:x1874208182311296:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384532.838731:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4269f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2415:x1874208182311296:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 25us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384532.843554:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 325 00000100:00080000:2.0:1787384532.844354:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787384532.920038:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384533.654225:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384533.654300:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182311424 00000100:00100000:0.0:1787384533.654309:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182311424 00000100:00100000:0.0:1787384533.654380:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 147 00000100:00100000:0.0:1787384533.654391:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c426ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+13:11092:x1874208182311424:12345-192.168.203.45@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787384533.654504:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c426ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+13:11092:x1874208182311424:12345-192.168.203.45@tcp:60:lhsmtool_posix.0 Request processed in 115us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384533.654512:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 147 00000100:00100000:2.0:1787384533.659433:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384533.659833:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182311552 00000100:00100000:0.0:1787384533.659843:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182311552 00000100:00100000:2.0:1787384533.660214:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 148 00000100:00100000:2.0:1787384533.660226:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4269880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:11092:x1874208182311552:12345-192.168.203.45@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787384533.660342:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4269880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:11092:x1874208182311552:12345-192.168.203.45@tcp:60:lhsmtool_posix.0 Request processed in 118us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384533.660349:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 148 00000100:00100000:2.0:1787384533.668207:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384533.675896:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182311808 00000100:00100000:1.0:1787384533.675910:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182311808 00000100:00100000:1.0:1787384533.675970:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 35 00000100:00100000:1.0:1787384533.675980:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c426b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+13:11092:x1874208182311808:12345-192.168.203.45@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787384533.676207:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c426b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+14:11092:x1874208182311808:12345-192.168.203.45@tcp:35:lhsmtool_posix.0 Request processed in 227us (8010us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1787384533.676215:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 35 00010000:00010000:3.0:1787384533.944976:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384533.946005:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787384533.946028:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c426aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203354112:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787384533.946109:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384533.946478:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203354112 00000100:00100000:3.0:1787384533.946487:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203354112 00000100:00100000:3.0:1787384533.946532:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787384533.946540:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203354112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787384533.946571:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787384533.946616:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203354112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384533.946622:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787384533.946669:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c426aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203354112:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787384534.051587:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384534.051759:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182311936 00000100:00100000:2.0:1787384534.051769:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182311936 00000100:00100000:2.0:1787384534.051873:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 149 00000100:00100000:2.0:1787384534.051885:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:11898:x1874208182311936:12345-192.168.203.45@tcp:101:lsof.0 00010000:00010000:2.0:1787384534.051906:0:14031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384534.051926:0:14031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba31af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce38eb expref: -99 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384534.051998:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba31b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384534.052011:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba31b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384534.052024:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba31b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384534.052098:0:14031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787384534.052101:0:14031:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787384534.052145:0:14031:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba31b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384534.052171:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba31af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38eb expref: 7 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384534.052191:0:14031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba31b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38eb expref: 6 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384534.052200:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c294da00) 00010000:00010000:2.0:1787384534.052204:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787384534.052207:0:14031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965a200, rc 0) 00000100:00100000:2.0:1787384534.052271:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+6:11898:x1874208182311936:12345-192.168.203.45@tcp:101:lsof.0 Request processed in 389us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384534.052279:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 149 00000100:00080000:0.0:1787384534.052407:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384534.455556:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203354240:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787384534.455626:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384534.456305:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203354240 00000100:00100000:3.0:1787384534.456315:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203354240 00000100:00100000:3.0:1787384534.456375:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787384534.456384:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4269500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203354240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787384534.456419:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1787384534.456530:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4269500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203354240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 146us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384534.456537:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787384534.463592:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203354240:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787384534.967020:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384535.995031:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384536.503018:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787384536.503042:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c426aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203354368:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787384536.503108:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384536.503265:0:13608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203354368 00000100:00100000:2.0:1787384536.503272:0:13608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203354368 00000100:00100000:2.0:1787384536.503337:0:13608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787384536.503346:0:13608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203354368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787384536.503375:0:13608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787384536.503418:0:13608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203354368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384536.503438:0:13608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:0.0:1787384536.503595:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787384536.503630:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c426aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203354368:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787384536.504089:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee115f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203354496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787384536.504125:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384536.504240:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203354496 00000100:00100000:0.0:1787384536.504245:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203354496 00000100:00080000:1.0:1787384536.504377:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787384536.504863:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787384536.504874:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203354496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787384536.504890:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787384536.504942:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203354496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384536.504949:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787384536.505029:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee115f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203354496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787384537.018173:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787384537.018196:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203354624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787384537.018264:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384537.018384:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203354624 00000100:00100000:2.0:1787384537.018392:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203354624 00000100:00100000:2.0:1787384537.018452:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00080000:1.0:1787384537.018558:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787384537.018590:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203354624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787384537.018621:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384537.018675:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203354624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 214us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384537.018682:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787384537.018775:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203354624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787384537.020073:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee115f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203354752:0@lo:400:kworker.0 00000100:00100000:1.0:1787384537.020131:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384537.020164:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd759c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874208203355136:0@lo:400:kworker.0 00000100:00100000:1.0:1787384537.020175:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd75a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203355264:0@lo:400:kworker.0 00000100:00100000:0.0:1787384537.020206:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384537.020213:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384537.020237:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203355648:0@lo:400:kworker.0 00000100:00100000:1.0:1787384537.020239:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4031c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203355776:0@lo:400:kworker.0 00000100:00100000:0.0:1787384537.020278:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384537.020297:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203355136 00000100:00100000:1.0:1787384537.020304:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203355136 00000100:00100000:0.0:1787384537.020307:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c355a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203356160:0@lo:400:kworker.0 00000100:00100000:0.0:1787384537.020336:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384537.020353:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1787384537.020363:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4107800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874208203355136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384537.020363:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787384537.020374:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203355008:0@lo:400:kworker.0 00000100:00100000:0.0:1787384537.020409:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384537.020422:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4107800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874208203355136:12345-0@lo:400:kworker.0 Request processed in 60us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384537.020431:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1787384537.020431:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3adb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874208203355520:0@lo:400:kworker.0 00000100:00100000:0.0:1787384537.020460:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384537.020517:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874208203354880:0@lo:400:kworker.0 00000100:00100000:1.0:1787384537.020555:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203355648 00000100:00100000:1.0:1787384537.020560:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203355648 00000100:00100000:2.0:1787384537.020570:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203354752 00000100:00100000:2.0:1787384537.020577:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203354752 00000100:00100000:1.0:1787384537.020591:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203356160 00000100:00100000:1.0:1787384537.020596:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203356160 00000100:00100000:2.0:1787384537.020618:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1787384537.020628:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3653:x1874208203354752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384537.020634:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787384537.020645:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203355648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384537.020669:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3653:x1874208203354752:12345-0@lo:400:kworker.0 Request processed in 42us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384537.020677:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1787384537.020689:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203355648:12345-0@lo:400:kworker.0 Request processed in 46us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384537.020697:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787384537.020717:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787384537.020796:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203355264 00000100:00100000:3.0:1787384537.020801:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203355264 00000100:00100000:3.0:1787384537.020827:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203355008 00000100:00100000:3.0:1787384537.020839:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203355008 00000100:00100000:3.0:1787384537.020856:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787384537.020863:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203355264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384537.020899:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203355264:12345-0@lo:400:kworker.0 Request processed in 37us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384537.020906:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787384537.020919:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787384537.020925:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203355008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384537.020953:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203355008:12345-0@lo:400:kworker.0 Request processed in 28us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384537.020958:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00080000:3.0:1787384537.021046:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787384537.021077:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384537.021111:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee115f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203354752:0@lo:400:kworker.0 00000100:00100000:3.0:1787384537.021140:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd75a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203355264:0@lo:400:kworker.0 00000100:00100000:3.0:1787384537.021158:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203355776 00000100:00100000:3.0:1787384537.021161:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203355776 00000100:00100000:2.0:1787384537.021210:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203356160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384537.021244:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203356160:12345-0@lo:400:kworker.0 Request processed in 519us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384537.029735:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787384537.029760:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203355776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384537.030014:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874208203356032:0@lo:400:kworker.0 00000100:00100000:1.0:1787384537.030533:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203355520 00000100:00100000:1.0:1787384537.030542:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203355520 00000100:00100000:1.0:1787384537.030603:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1787384537.030614:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874208203355520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384537.030640:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384537.030717:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787384537.030747:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384537.030920:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd759c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874208203355136:0@lo:400:kworker.0 00000100:00100000:0.0:1787384537.030932:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203355648:0@lo:400:kworker.0 00000100:00100000:0.0:1787384537.030943:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c355a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203356160:0@lo:400:kworker.0 00000100:00100000:0.0:1787384537.030982:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203355008:0@lo:400:kworker.0 00010000:00010000:0.0:1787384537.031030:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384537.031163:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203356032 00000100:00100000:0.0:1787384537.031168:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203356032 00000100:00100000:1.0:1787384537.031298:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874208203355520:12345-0@lo:400:kworker.0 Request processed in 686us (10836us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384537.031305:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1787384537.031319:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203354880 00000100:00100000:1.0:1787384537.031323:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203354880 00000100:00100000:1.0:1787384537.031344:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1787384537.031351:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c426aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874208203354880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384537.031381:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c426aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874208203354880:12345-0@lo:400:kworker.0 Request processed in 31us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384537.031388:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00010000:00080000:1.0:1787384537.031423:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3adb480 x1874208203355520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384537.031435:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3adb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874208203355520:0@lo:400:kworker.0 00000100:00080000:1.0:1787384537.031458:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787384537.032943:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1787384537.032960:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874208203356032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384537.033059:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874208203356032:12345-0@lo:400:kworker.0 Request processed in 107us (2420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384537.033075:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00010000:00080000:0.0:1787384537.033117:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c422ca80 x1874208203356032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384537.033129:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874208203356032:0@lo:400:kworker.0 00000100:00100000:2.0:1787384537.034333:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874208203354880:0@lo:400:kworker.0 00000100:00100000:2.0:1787384537.034348:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd758e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874208203355392:0@lo:400:kworker.0 00000100:00100000:2.0:1787384537.034412:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384537.034442:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4031f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874208203355904:0@lo:400:kworker.0 00000100:00100000:2.0:1787384537.034464:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:2.0:1787384537.034556:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:2.0:1787384537.034568:0:6501:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000100:00100000:1.0:1787384537.034603:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203355392 00000100:00100000:1.0:1787384537.034610:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203355392 00000100:00100000:1.0:1787384537.034675:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203355904 00000100:00100000:1.0:1787384537.034679:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203355904 00000100:00100000:1.0:1787384537.034703:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1787384537.034710:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874208203355392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384537.034768:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874208203355392:12345-0@lo:400:kworker.0 Request processed in 57us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384537.034775:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1787384537.034808:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1787384537.034827:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874208203355904:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787384537.034914:0:6553:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1787384537.034924:0:6553:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1787384537.034963:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd758e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874208203355392:0@lo:400:kworker.0 00000100:00100000:0.0:1787384537.035012:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4031c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203355776:0@lo:400:kworker.0 00000100:00080000:2.0:1787384537.035021:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787384537.035474:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203355776:12345-0@lo:400:kworker.0 Request processed in 5723us (14393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384537.035483:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787384537.035500:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874208203355904:12345-0@lo:400:kworker.0 Request processed in 683us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384537.035518:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1787384537.035799:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4031f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874208203355904:0@lo:400:kworker.0 00000040:00080000:0.0:1787384537.468309:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787384537.468318:0:13801:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787384537.468430:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1787384537.468436:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787384537.529516:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c2a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203356288:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787384537.529590:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384537.529748:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203356288 00000100:00100000:0.0:1787384537.529756:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203356288 00000100:00100000:0.0:1787384537.529827:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787384537.529837:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203356288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787384537.529859:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787384537.531107:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203356288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1265us (1511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384537.531118:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787384537.531183:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c2a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203356288:0@lo:13:osp-pre-1-1.0 00000040:00080000:0.0:1787384537.655651:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1787384537.818449:0:14518:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 03:42:15 (1787384535) 00000100:00100000:2.0:1787384537.975470:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384537.975498:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384537.975520:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384537.975543:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182312704 00000100:00100000:0.0:1787384537.975544:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182312192 00000100:00100000:2.0:1787384537.975553:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182312704 00000100:00100000:0.0:1787384537.975553:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182312192 00000100:00100000:0.0:1787384537.975618:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 332 00000100:00100000:0.0:1787384537.975629:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+13:2413:x1874208182312192:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384537.975705:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+13:2413:x1874208182312192:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 77us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384537.975713:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 332 00000100:00100000:2.0:1787384537.975769:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 333 00000100:00100000:2.0:1787384537.975797:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+6:2413:x1874208182312704:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384537.975830:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+6:2413:x1874208182312704:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 52us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384537.975838:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 333 00000100:00100000:2.0:1787384537.975868:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182312448 00000100:00100000:2.0:1787384537.975873:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182312448 00000100:00100000:2.0:1787384537.975908:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 117 00000100:00100000:2.0:1787384537.975915:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2413:x1874208182312448:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384537.976026:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2413:x1874208182312448:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 111us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384537.976034:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 117 00000100:00080000:2.0:1787384537.976051:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787384537.976055:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384537.980603:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384537.980642:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384537.980677:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384537.980700:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384537.980727:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182312064 00000100:00100000:2.0:1787384537.980736:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182312064 00000100:00100000:2.0:1787384537.980802:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 387 00000100:00100000:2.0:1787384537.980814:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+13:2414:x1874208182312064:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384537.980892:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+13:2414:x1874208182312064:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 81us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384537.980901:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 387 00000100:00100000:2.0:1787384537.980933:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182312320 00000100:00100000:2.0:1787384537.980937:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182312320 00000100:00100000:2.0:1787384537.980979:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182312832 00000100:00100000:2.0:1787384537.980982:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182312832 00000100:00100000:2.0:1787384537.981003:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 334 00000100:00100000:2.0:1787384537.981009:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2414:x1874208182312320:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384537.981039:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2414:x1874208182312320:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 30us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384537.981046:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 334 00000100:00100000:2.0:1787384537.981058:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 335 00000100:00100000:2.0:1787384537.981065:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182312832:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384537.981091:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182312832:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 27us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384537.981098:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 335 00000100:00100000:2.0:1787384537.981116:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182312576 00000100:00100000:2.0:1787384537.981120:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182312576 00000100:00100000:2.0:1787384537.981147:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 118 00000100:00100000:2.0:1787384537.981160:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc1b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2414:x1874208182312576:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384537.981188:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc1b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2414:x1874208182312576:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 29us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384537.981194:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 118 00000100:00080000:2.0:1787384537.981212:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787384537.981216:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787384538.039923:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384539.063298:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384539.063324:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203356416:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787384539.063410:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384539.063582:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203356416 00000100:00100000:2.0:1787384539.063589:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203356416 00000100:00100000:2.0:1787384539.063643:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787384539.063652:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203356416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787384539.063688:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787384539.063736:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203356416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384539.063744:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787384539.063818:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203356416:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787384539.066186:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384539.575534:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787384539.575559:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203356544:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787384539.575642:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384539.575749:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203356544 00000100:00100000:3.0:1787384539.575757:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203356544 00000100:00100000:3.0:1787384539.575820:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787384539.575829:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c2a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203356544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787384539.575868:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1787384539.575911:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c2a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203356544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384539.575917:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787384539.576473:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203356544:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787384539.793257:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384539.796611:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182313088 00000100:00100000:0.0:1787384539.797260:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182313088 00000100:00100000:0.0:1787384539.797434:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 150 00000100:00100000:0.0:1787384539.797464:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+13:12165:x1874208182313088:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787384539.797484:0:8195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384539.797506:0:8195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba31bd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce38f2 expref: -99 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384539.797581:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba31c4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384539.797595:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba31c4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384539.797605:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba31c4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384539.797631:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba31cb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384539.797638:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba31cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384539.797644:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba31cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384539.797736:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba31d2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384539.797744:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba31d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384539.797752:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba31d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384539.797771:0:8195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1787384539.797888:0:8195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba31c4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384539.797896:0:8195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba31c4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384539.797902:0:8195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba31c4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384539.797907:0:8195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384539.797911:0:8195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba31c4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384539.797918:0:8195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba31c4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384539.797954:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98f7c294f000) 00010000:00010000:0.0:1787384539.797957:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384539.797962:0:8195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba31c4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384539.797968:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba31c4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384539.797981:0:8195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba31cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384539.797987:0:8195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba31cb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384539.798002:0:8195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba31cb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384539.798008:0:8195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6141400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384539.798011:0:8195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba31cb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384539.798017:0:8195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba31cb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384539.798026:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98f7c3a9de00) 00010000:00010000:0.0:1787384539.798028:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384539.798031:0:8195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba31cb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384539.798036:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba31cb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384539.798303:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba31bd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38f2 expref: 16 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384539.798318:0:8195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba31d2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38f2 expref: 15 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384539.798325:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98f7c3a9cf00) 00010000:00010000:0.0:1787384539.798326:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384539.798329:0:8195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6141a00, rc 0) 00000100:00100000:0.0:1787384539.798408:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+15:12165:x1874208182313088:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 948us (5160us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1787384539.798427:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 150 00000100:00100000:3.0:1787384539.804181:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384539.804342:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384539.804535:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182313344 00000100:00100000:0.0:1787384539.804545:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182313344 00000100:00100000:0.0:1787384539.804604:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 151 00000100:00100000:0.0:1787384539.804623:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+15:12165:x1874208182313344:12345-192.168.203.45@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787384539.804728:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+15:12165:x1874208182313344:12345-192.168.203.45@tcp:59:lhsmtool_posix.0 Request processed in 114us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384539.804735:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 151 00000100:00080000:2.0:1787384539.806991:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384539.808857:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182313216 00000100:00100000:1.0:1787384539.809185:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182313216 00000100:00100000:1.0:1787384539.809302:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 12 00000100:00100000:1.0:1787384539.809322:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b44450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+15:2415:x1874208182313216:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384539.809337:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384539.809371:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba31d2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38f2 expref: 15 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384539.809391:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98f7c3a9cf00) 00010000:00010000:1.0:1787384539.809396:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384539.809456:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b44450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+14:2415:x1874208182313216:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 136us (5283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384539.809464:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 12 00000100:00100000:3.0:1787384539.812331:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384539.812515:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182313472 00000100:00100000:2.0:1787384539.812530:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182313472 00000100:00100000:2.0:1787384539.812630:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 152 00000100:00100000:2.0:1787384539.812646:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:12165:x1874208182313472:12345-192.168.203.45@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787384539.812829:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:12165:x1874208182313472:12345-192.168.203.45@tcp:59:lhsmtool_posix.0 Request processed in 187us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384539.812838:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 152 00000100:00080000:3.0:1787384539.815467:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787384540.087065:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787384540.535044:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787384540.535057:0:13801:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787384540.535496:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787384540.535511:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787384540.728387:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787384541.112670:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384541.623561:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4031f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203356672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787384541.623665:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384541.624290:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787384541.624307:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203356800:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787384541.624347:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384541.624402:0:13608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203356672 00000100:00100000:2.0:1787384541.624412:0:13608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203356672 00000100:00100000:2.0:1787384541.624478:0:13608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203356800 00000100:00100000:2.0:1787384541.624483:0:13608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203356800 00000100:00100000:3.0:1787384541.624508:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787384541.624522:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4031c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203356672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787384541.624563:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787384541.624624:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4031c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203356672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384541.624630:0:13608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787384541.624646:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787384541.624648:0:13608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203356800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787384541.624664:0:13608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787384541.624701:0:13608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203356800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384541.624708:0:13608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:3.0:1787384541.624740:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787384541.624766:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203356800:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787384541.624801:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4031f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203356672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787384542.136389:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874208203357312:0@lo:400:kworker.0 00000100:00100000:0.0:1787384542.136771:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384542.136867:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203357824:0@lo:400:kworker.0 00000100:00100000:0.0:1787384542.136902:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384542.136925:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203358336:0@lo:400:kworker.0 00000100:00100000:0.0:1787384542.136964:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384542.137000:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1787384542.137008:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4031f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203356928:0@lo:400:kworker.0 00000100:00100000:0.0:1787384542.137039:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384542.137081:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c355a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203357440:0@lo:400:kworker.0 00000100:00100000:0.0:1787384542.137107:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384542.137125:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203357952:0@lo:400:kworker.0 00000100:00100000:0.0:1787384542.137145:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384542.137163:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c20d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203358464:0@lo:400:kworker.0 00000100:00100000:0.0:1787384542.137184:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384542.137217:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203357056:0@lo:400:kworker.0 00000100:00100000:0.0:1787384542.137243:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384542.137259:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203357568:0@lo:400:kworker.0 00000100:00100000:0.0:1787384542.137279:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384542.137298:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874208203358080:0@lo:400:kworker.0 00000100:00100000:0.0:1787384542.137318:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384542.137351:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787384542.137357:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203357184:0@lo:400:kworker.0 00000100:00100000:0.0:1787384542.137377:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384542.137393:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874208203357696:0@lo:400:kworker.0 00000100:00100000:0.0:1787384542.137413:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384542.137428:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203358208:0@lo:400:kworker.0 00000100:00100000:0.0:1787384542.137448:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787384542.137474:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384542.137499:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203357824 00000100:00100000:0.0:1787384542.137508:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203357824 00000100:00100000:0.0:1787384542.137559:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203358336 00000100:00100000:0.0:1787384542.137562:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203358336 00000100:00100000:0.0:1787384542.137589:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203357952 00000100:00100000:0.0:1787384542.137592:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203357952 00000100:00100000:0.0:1787384542.137614:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203358464 00000100:00100000:0.0:1787384542.137617:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203358464 00000100:00100000:0.0:1787384542.137634:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787384542.137642:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee31ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203357824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384542.137709:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee31ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203357824:12345-0@lo:400:kworker.0 Request processed in 66us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384542.137717:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787384542.137736:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787384542.137742:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203358336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384542.137768:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203358336:12345-0@lo:400:kworker.0 Request processed in 27us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384542.137774:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787384542.137814:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787384542.137820:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203357952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384542.137850:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203357952:12345-0@lo:400:kworker.0 Request processed in 30us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384542.137857:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787384542.137870:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787384542.137876:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203358464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384542.137901:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203358464:12345-0@lo:400:kworker.0 Request processed in 26us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384542.137906:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787384542.137945:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203356928 00000100:00100000:0.0:1787384542.137949:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203356928 00000100:00100000:0.0:1787384542.137978:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1787384542.137985:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3653:x1874208203356928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384542.138028:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3653:x1874208203356928:12345-0@lo:400:kworker.0 Request processed in 43us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384542.138035:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1787384542.138071:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203357440 00000100:00100000:0.0:1787384542.138076:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203357440 00000100:00100000:0.0:1787384542.138102:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203357184 00000100:00100000:0.0:1787384542.138104:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203357184 00000100:00100000:0.0:1787384542.138116:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787384542.138121:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203357440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384542.138156:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203357440:12345-0@lo:400:kworker.0 Request processed in 34us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384542.138162:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787384542.138173:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787384542.138178:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203357184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384542.138212:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203357184:12345-0@lo:400:kworker.0 Request processed in 33us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384542.138218:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787384542.138236:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203357312 00000100:00100000:0.0:1787384542.138240:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203357312 00000100:00100000:0.0:1787384542.138260:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203357056 00000100:00100000:0.0:1787384542.138263:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203357056 00000100:00100000:0.0:1787384542.138275:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203357568 00000100:00100000:0.0:1787384542.138277:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203357568 00000100:00100000:0.0:1787384542.138303:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203358080 00000100:00100000:0.0:1787384542.138306:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203358080 00000100:00100000:0.0:1787384542.138321:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203357696 00000100:00100000:0.0:1787384542.138324:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203357696 00000100:00100000:0.0:1787384542.138336:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203358208 00000100:00100000:0.0:1787384542.138339:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203358208 00000100:00100000:0.0:1787384542.138364:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1787384542.138370:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874208203357312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384542.138405:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874208203357312:12345-0@lo:400:kworker.0 Request processed in 35us (1920us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384542.138411:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1787384542.138423:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1787384542.138427:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203357056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384542.138454:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203357056:12345-0@lo:400:kworker.0 Request processed in 26us (1210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384542.138460:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1787384542.138470:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1787384542.138476:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203357568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384542.138503:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203357568:12345-0@lo:400:kworker.0 Request processed in 27us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384542.138508:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1787384542.138518:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1787384542.138524:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874208203358080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384542.138548:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874208203358080:12345-0@lo:400:kworker.0 Request processed in 25us (1229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384542.138553:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1787384542.138562:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1787384542.138568:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874208203357696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384542.138596:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874208203357696:12345-0@lo:400:kworker.0 Request processed in 28us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384542.138602:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1787384542.138619:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1787384542.138625:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874208203358208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384542.138653:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874208203358208:12345-0@lo:400:kworker.0 Request processed in 28us (1204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384542.138659:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00080000:0.0:1787384542.138691:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787384542.138696:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787384542.138699:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787384542.138743:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203357184:0@lo:400:kworker.0 00010000:00080000:0.0:1787384542.138759:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7e07800 x1874208203357696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384542.138770:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874208203357696:0@lo:400:kworker.0 00010000:00080000:0.0:1787384542.138808:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7e06d80 x1874208203358208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384542.138817:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203358208:0@lo:400:kworker.0 00000100:00100000:0.0:1787384542.138828:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203357056:0@lo:400:kworker.0 00000100:00100000:0.0:1787384542.138839:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203357568:0@lo:400:kworker.0 00000100:00100000:0.0:1787384542.138849:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874208203358080:0@lo:400:kworker.0 00000100:00100000:0.0:1787384542.138897:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4031f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203356928:0@lo:400:kworker.0 00000100:00100000:0.0:1787384542.138908:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c355a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203357440:0@lo:400:kworker.0 00000100:00100000:0.0:1787384542.138919:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203357952:0@lo:400:kworker.0 00000100:00100000:0.0:1787384542.138928:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c20d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203358464:0@lo:400:kworker.0 00000100:00100000:0.0:1787384542.138963:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874208203357312:0@lo:400:kworker.0 00000100:00100000:0.0:1787384542.138974:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203357824:0@lo:400:kworker.0 00000100:00100000:0.0:1787384542.138987:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203358336:0@lo:400:kworker.0 00000100:00100000:3.0:1787384542.141126:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787384542.141152:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203358592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787384542.141237:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384542.141301:0:13608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203358592 00000100:00100000:3.0:1787384542.141309:0:13608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203358592 00000100:00100000:3.0:1787384542.141362:0:13608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787384542.141371:0:13608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203358592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787384542.141405:0:13608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787384542.141452:0:13608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203358592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384542.141459:0:13608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787384542.141516:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203358592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384542.241490:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384542.241907:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182313600 00000100:00100000:1.0:1787384542.241920:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182313600 00000100:00100000:1.0:1787384542.242016:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 153 00000100:00100000:1.0:1787384542.242028:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+14:12208:x1874208182313600:12345-192.168.203.45@tcp:101:lfs.0 00000100:00080000:0.0:1787384542.242160:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787384542.242186:0:14031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384542.242216:0:14031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba31e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce38f9 expref: -99 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.242304:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba31e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.242322:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba31e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.242356:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba31e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.242373:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953a00/0x7ef423838fba31ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.242381:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953a00/0x7ef423838fba31ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.242388:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953a00/0x7ef423838fba31ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.242448:0:14031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba31e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.242456:0:14031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba31e7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.242463:0:14031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba31e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.242470:0:14031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3952c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384542.242475:0:14031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba31e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.242484:0:14031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba31e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.242499:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c294da00) 00010000:00010000:1.0:1787384542.242502:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384542.242508:0:14031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba31e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.242520:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba31e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.242534:0:14031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953a00/0x7ef423838fba31ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.242540:0:14031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953a00/0x7ef423838fba31ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.242545:0:14031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953a00/0x7ef423838fba31ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.242550:0:14031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3953a00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384542.242553:0:14031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953a00/0x7ef423838fba31ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.242559:0:14031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953a00/0x7ef423838fba31ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.242566:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98f8edc2ee00) 00010000:00010000:1.0:1787384542.242569:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384542.242572:0:14031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953a00/0x7ef423838fba31ee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.242577:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953a00/0x7ef423838fba31ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.242619:0:14031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba31e0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38f9 expref: 15 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.242641:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c294da00) 00010000:00010000:1.0:1787384542.242643:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384542.242647:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba31e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38f9 expref: 15 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.242657:0:14031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3953400, rc 0) 00000100:00100000:1.0:1787384542.242745:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+14:12208:x1874208182313600:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 719us (1266us total) trans 0 rc 301/301 00000100:00100000:1.0:1787384542.242753:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 153 00000100:00100000:1.0:1787384542.256013:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384542.257294:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182313856 00000100:00100000:2.0:1787384542.257312:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182313856 00000100:00100000:2.0:1787384542.257394:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 154 00000100:00100000:2.0:1787384542.257405:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+14:12208:x1874208182313856:12345-192.168.203.45@tcp:36:lfs.0 00010000:00010000:2.0:1787384542.257482:0:8195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384542.257517:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba2b34 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce371d expref: 14 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.257539:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c294da00) 00010000:00010000:2.0:1787384542.257545:0:8195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787384542.257627:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba31f5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.257658:0:8195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba31b6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38eb expref: 5 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.257668:0:8195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba31f5 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.257710:0:8195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba31b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38eb expref: 5 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.257727:0:8195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba31b6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38eb expref: 5 pid: 14031 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384542.257746:0:8195:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40df800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8195:1874208203358720:192.168.203.45@tcp:104: 00000100:00100000:2.0:1787384542.257896:0:8195:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c29566c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384542.264952:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384542.265063:0:8195:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40df800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8195:1874208203358720:192.168.203.45@tcp:104: 00010000:00010000:2.0:1787384542.265099:0:8195:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba31f5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384542.266652:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182313984 00000100:00100000:3.0:1787384542.266667:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182313984 00010000:00010000:3.0:1787384542.266735:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba31b6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38eb expref: 6 pid: 14031 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384542.266797:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 78 00000100:00100000:3.0:1787384542.266809:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+6:2415:x1874208182313984:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384542.266826:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384542.266834:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba31b6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38eb expref: 6 pid: 14031 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.266849:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba31b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38eb expref: 6 pid: 14031 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.266875:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba31b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38eb expref: 6 pid: 14031 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.266893:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c294da00) 00010000:00010000:3.0:1787384542.266905:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba31f5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.266917:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba31f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.266925:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba31f5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.266961:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384542.267036:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2415:x1874208182313984:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 227us (2104us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384542.267044:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 78 00010000:00010000:2.0:1787384542.267281:0:8195:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba31f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.267290:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba31f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.267318:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba31fc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.267328:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba31fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.267345:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba31fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.268053:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba3203 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.268066:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba3203 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.268075:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba3203 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787384542.268091:0:8195:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000528bae06 reply state 00000000d524a54b transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba3203 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.268104:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba3203 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.268111:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f8e8aa4100) 00010000:00010000:2.0:1787384542.268114:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787384542.268117:0:8195:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787384542.268124:0:8195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1787384542.268133:0:8195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba31f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.268141:0:8195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba31f5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.268148:0:8195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba31f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.268155:0:8195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965ae00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384542.268167:0:8195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba31f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.268176:0:8195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba31f5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.268187:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c294da00) 00010000:00010000:2.0:1787384542.268190:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384542.268194:0:8195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba31f5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.268202:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba31f5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787384542.268219:0:8195:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000528bae06 reply state 00000000d524a54b transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba31fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.268228:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba31fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.268235:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98f8e8aa4800) 00010000:00010000:2.0:1787384542.268238:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787384542.268240:0:8195:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1787384542.268336:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+15:12208:x1874208182313856:12345-192.168.203.45@tcp:36:lfs.0 Request processed in 10929us (12335us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1787384542.268346:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 154 00000100:00080000:0.0:1787384542.268471:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787384542.385914:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384542.386055:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182314112 00000100:00100000:1.0:1787384542.386068:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182314112 00000100:00100000:1.0:1787384542.386145:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 155 00000100:00100000:1.0:1787384542.386158:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c355a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+15:12216:x1874208182314112:12345-192.168.203.45@tcp:101:lctl.0 00010000:00010000:1.0:1787384542.386192:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384542.386222:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba320a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3900 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.386310:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953a00/0x7ef423838fba3211 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.386325:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953a00/0x7ef423838fba3211 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.386338:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953a00/0x7ef423838fba3211 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384542.386432:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787384542.386436:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787384542.386466:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953a00/0x7ef423838fba3211 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.386495:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba320a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3900 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.386515:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953a00/0x7ef423838fba3211 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3900 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.386524:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f8edc2ee00) 00010000:00010000:1.0:1787384542.386528:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787384542.386531:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3953a00, rc 0) 00000100:00100000:1.0:1787384542.386616:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c355a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+16:12216:x1874208182314112:12345-192.168.203.45@tcp:101:lctl.0 Request processed in 460us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384542.386624:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 155 00000100:00100000:3.0:1787384542.493338:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384542.493505:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182314240 00000100:00100000:3.0:1787384542.493518:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182314240 00000100:00100000:3.0:1787384542.493595:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 156 00000100:00100000:3.0:1787384542.493607:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+16:12222:x1874208182314240:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:3.0:1787384542.493633:0:14031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384542.494010:0:14031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba3218 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3907 expref: -99 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.494103:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba321f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.494121:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba321f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.494146:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba321f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.494172:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3226 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.494181:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3226 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.494188:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3226 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.494302:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba322d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.494311:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba322d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.494318:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba322d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384542.494363:0:14031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1787384542.494368:0:14031:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787384542.494511:0:14031:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba322d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.494526:0:14031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba321f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.494531:0:14031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba321f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.494538:0:14031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba321f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.494555:0:14031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cdc00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384542.494559:0:14031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba321f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.494568:0:14031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba321f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.494585:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f8edc2ee00) 00010000:00010000:3.0:1787384542.494589:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384542.494595:0:14031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba321f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.494601:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba321f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.494616:0:14031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3226 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.494623:0:14031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3226 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.494629:0:14031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3226 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.494634:0:14031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cda00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384542.494636:0:14031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3226 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.494642:0:14031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3226 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.495065:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98f8e8aa4800) 00010000:00010000:3.0:1787384542.495069:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384542.495073:0:14031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3226 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.495079:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3226 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.495121:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba3218 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3907 expref: 18 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.495208:0:14031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba322d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3907 expref: 17 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.495216:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f8e8aa4100) 00010000:00010000:3.0:1787384542.495218:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787384542.495221:0:14031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cd800, rc 0) 00000100:00100000:3.0:1787384542.495319:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+17:12222:x1874208182314240:12345-192.168.203.45@tcp:101:bash.0 Request processed in 1713us (1994us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384542.495329:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 156 00000100:00100000:3.0:1787384542.501631:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384542.503548:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182314496 00000100:00100000:2.0:1787384542.503568:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182314496 00000100:00100000:2.0:1787384542.503668:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 157 00000100:00100000:2.0:1787384542.503682:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+17:12222:x1874208182314496:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:2.0:1787384542.503713:0:8195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384542.503753:0:8195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3234 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce390e expref: -99 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.503925:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba323b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.503954:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba323b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.503968:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba323b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.504182:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba3242 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.504204:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba3242 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.504218:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba3242 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787384542.504592:0:8195:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:2.0:1787384542.504752:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba3249 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.504764:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba3249 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.504774:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba3249 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.505060:0:8195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba323b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.505086:0:8195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba323b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.505093:0:8195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba323b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.505098:0:8195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965bc00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384542.505102:0:8195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba323b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.505109:0:8195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba323b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.505123:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f8e8aa4100) 00010000:00010000:2.0:1787384542.505126:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384542.505130:0:8195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba323b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.505136:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba323b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787384542.505149:0:8195:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f7967469 reply state 00000000a122748e transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba3242 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.505159:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba3242 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.505166:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f8e8aa4000) 00010000:00010000:2.0:1787384542.505168:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787384542.505171:0:8195:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787384542.505209:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3234 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce390e expref: 20 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.505231:0:8195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba3249 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce390e expref: 19 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.505239:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f8e8aa4e00) 00010000:00010000:2.0:1787384542.505241:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787384542.505244:0:8195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965b400, rc 0) 00000100:00100000:2.0:1787384542.505319:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+20:12222:x1874208182314496:12345-192.168.203.45@tcp:101:bash.0 Request processed in 1640us (3701us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1787384542.505329:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 157 00000100:00100000:3.0:1787384542.520570:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000001:00080000:3.0:1787384542.521273:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967419 is committed 00000100:00100000:0.0:1787384542.524211:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182314624 00000100:00100000:0.0:1787384542.524235:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182314624 00000100:00100000:0.0:1787384542.524351:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 55 00000100:00100000:0.0:1787384542.524364:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2416:x1874208182314624:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:0.0:1787384542.524389:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384542.524518:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df82f75b/0x7ef423838fba3257 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3915 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787384542.524553:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384542.524580:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=437s v=(0 0) 00010000:00010000:0.0:1787384542.524585:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384542.524597:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df82f75b/0x7ef423838fba3257 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3915 expref: 6 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384542.524619:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000df82f75b/0x7ef423838fba3257 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3915 expref: 6 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384542.524650:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6140a00, rc 0) 00000100:00100000:0.0:1787384542.524742:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2416:x1874208182314624:12345-192.168.203.45@tcp:101:bash.0 Request processed in 379us (4181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384542.524751:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 55 00000100:00080000:0.0:1787384542.524819:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787384542.525872:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba31fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.525887:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba31fc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.525895:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba31fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.525902:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965a400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384542.525907:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba31fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.525916:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba31fc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.525943:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98f8e8aa4800) 00010000:00010000:2.0:1787384542.525947:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384542.525954:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba31fc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.525969:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba31fc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.525991:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba3203 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.525997:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba3203 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.526004:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba3203 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.526010:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965a600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384542.526014:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba3203 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.526020:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba3203 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.526030:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f8e8aa4100) 00010000:00010000:2.0:1787384542.526033:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384542.526036:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba3203 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.526043:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba3203 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.526060:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba3242 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.526067:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba3242 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.526080:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba3242 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.526085:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965ac00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384542.526089:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba3242 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.526095:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba3242 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.526104:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f8e8aa4000) 00010000:00010000:2.0:1787384542.526107:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384542.526111:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba3242 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.526116:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba3242 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384542.534752:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384542.534957:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182314752 00000100:00100000:0.0:1787384542.534971:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182314752 00000100:00100000:0.0:1787384542.535054:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 56 00000100:00100000:0.0:1787384542.535067:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:12222:x1874208182314752:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:0.0:1787384542.535091:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384542.535115:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075dd50c5/0x7ef423838fba325e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce391c expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384542.535157:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000df82f75b/0x7ef423838fba3257 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3915 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384542.535168:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384542.535172:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384542.535178:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075dd50c5/0x7ef423838fba325e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce391c expref: 7 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384542.535221:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000df82f75b/0x7ef423838fba3257 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3915 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384542.535238:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000df82f75b/0x7ef423838fba3257 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3915 expref: 7 pid: 8436 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384542.535274:0:8438:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4031f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1874208203358848:192.168.203.45@tcp:104: 00000100:00100000:0.0:1787384542.535593:0:8438:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d829ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1787384542.548372:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384542.553565:0:8438:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4031f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1874208203358848:192.168.203.45@tcp:104: 00010000:00010000:0.0:1787384542.553617:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075dd50c5/0x7ef423838fba325e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce391c expref: 7 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384542.553646:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6140e00, rc 0) 00000100:00100000:0.0:1787384542.553744:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:12222:x1874208182314752:12345-192.168.203.45@tcp:101:bash.0 Request processed in 18679us (19005us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384542.553755:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 56 00000100:00100000:1.0:1787384542.564724:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182314880 00000100:00100000:1.0:1787384542.564747:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182314880 00010000:00010000:1.0:1787384542.564842:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000df82f75b/0x7ef423838fba3257 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3915 expref: 7 pid: 8436 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384542.564947:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 79 00000100:00100000:1.0:1787384542.564959:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:2415:x1874208182314880:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384542.564980:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384542.565009:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000df82f75b/0x7ef423838fba3257 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3915 expref: 7 pid: 8436 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.565046:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000df82f75b/0x7ef423838fba3257 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3915 expref: 7 pid: 8436 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.565093:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df82f75b/0x7ef423838fba3257 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3915 expref: 7 pid: 8436 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.565116:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384542.565121:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384542.565131:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000075dd50c5/0x7ef423838fba325e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce391c expref: 6 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.565142:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075dd50c5/0x7ef423838fba325e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce391c expref: 6 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.565484:0:6508:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000075dd50c5/0x7ef423838fba325e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce391c expref: 6 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384542.565502:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e64000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6508:1874208203358976:192.168.203.45@tcp:105: 00000100:00100000:1.0:1787384542.565622:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c1370b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787384542.574197:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e64000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6508:1874208203358976:192.168.203.45@tcp:105: 00010000:00010000:2.0:1787384542.574237:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384542.574324:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2415:x1874208182314880:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 9366us (25961us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384542.574337:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 79 00000100:00100000:3.0:1787384542.587169:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384542.587422:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182315136 00000100:00100000:1.0:1787384542.587441:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182315136 00000100:00100000:1.0:1787384542.587526:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 36 00000100:00100000:1.0:1787384542.587539:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+15:12222:x1874208182315136:12345-192.168.203.45@tcp:35:bash.0 00000100:00100000:2.0:1787384542.590489:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+16:12222:x1874208182315136:12345-192.168.203.45@tcp:35:bash.0 Request processed in 2938us (3316us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1787384542.590505:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 36 00000100:00100000:1.0:1787384542.647197:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787384542.647253:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4031f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203359104:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787384542.647359:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384542.647455:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203359104 00000100:00100000:0.0:1787384542.647467:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203359104 00000100:00100000:1.0:1787384542.647632:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787384542.647643:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203359104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787384542.647674:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787384542.647739:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203359104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384542.647747:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787384542.647940:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4031f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203359104:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787384542.725398:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384542.725519:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182315392 00000100:00100000:2.0:1787384542.725550:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182315392 00000100:00100000:2.0:1787384542.725634:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 158 00000100:00100000:2.0:1787384542.725646:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4031f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+16:12232:x1874208182315392:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:2.0:1787384542.725681:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384542.725709:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba3265 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3923 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384542.725900:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1787384542.726045:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba3265 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3923 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.726065:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f8edc2ee00) 00010000:00010000:2.0:1787384542.726069:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787384542.726074:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba3265 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3923 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.726090:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965ac00, rc 0) 00000100:00100000:2.0:1787384542.726175:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4031f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+17:12232:x1874208182315392:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 531us (792us total) trans 4294967421 rc 301/301 00000100:00100000:2.0:1787384542.726183:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 158 00000100:00100000:1.0:1787384542.731477:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384542.731582:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182315648 00000100:00100000:2.0:1787384542.731596:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182315648 00000100:00100000:2.0:1787384542.731677:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 37 00000100:00100000:2.0:1787384542.731690:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+17:12232:x1874208182315648:12345-192.168.203.45@tcp:35:lfs.0 00000100:00100000:2.0:1787384542.732216:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+18:12232:x1874208182315648:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 528us (754us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1787384542.732225:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 37 00000100:00100000:3.0:1787384542.847200:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384542.847268:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182315776 00000100:00100000:1.0:1787384542.847282:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182315776 00000100:00100000:1.0:1787384542.847361:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 159 00000100:00100000:1.0:1787384542.847373:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd758e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+18:12238:x1874208182315776:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:1.0:1787384542.847406:0:14031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384542.847433:0:14031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba3273 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce392a expref: -99 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.847524:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953e00/0x7ef423838fba327a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.847541:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953e00/0x7ef423838fba327a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.847554:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953e00/0x7ef423838fba327a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384542.847612:0:14031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1787384542.847616:0:14031:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787384542.847640:0:14031:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953e00/0x7ef423838fba327a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.847695:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba3273 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce392a expref: 20 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.847716:0:14031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953e00/0x7ef423838fba327a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce392a expref: 19 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.847726:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f8e8aa4100) 00010000:00010000:1.0:1787384542.847729:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787384542.847733:0:14031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3953e00, rc 0) 00000100:00100000:1.0:1787384542.848171:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd758e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+19:12238:x1874208182315776:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 799us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384542.848180:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 159 00000100:00100000:0.0:1787384542.856671:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384542.857498:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182316032 00000100:00100000:2.0:1787384542.857512:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182316032 00000100:00100000:2.0:1787384542.857603:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 160 00000100:00100000:2.0:1787384542.857614:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+19:12238:x1874208182316032:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:2.0:1787384542.857643:0:8195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384542.857670:0:8195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba3281 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3931 expref: -99 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.865740:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba3288 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.865772:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba3288 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.865806:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba3288 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384542.865820:0:8195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787384542.866003:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba3281 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3931 expref: 22 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.866027:0:8195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba3288 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3931 expref: 21 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.866037:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f8e8aa4e00) 00010000:00010000:2.0:1787384542.866040:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787384542.866044:0:8195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965a600, rc 0) 00000100:00100000:2.0:1787384542.866158:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+21:12238:x1874208182316032:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 8545us (9500us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1787384542.866191:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 160 00000100:00100000:0.0:1787384542.876572:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384542.876720:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182316288 00000100:00100000:2.0:1787384542.876733:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182316288 00000100:00100000:2.0:1787384542.876841:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 161 00000100:00100000:2.0:1787384542.876855:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+21:12238:x1874208182316288:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:3.0:1787384542.877250:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384542.877300:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba3296 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3938 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.877444:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba329d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.877462:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba329d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.877475:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba329d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384542.877490:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787384542.877653:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba3296 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3938 expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.877676:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba329d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3938 expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.877686:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f8e8aa4e00) 00010000:00010000:3.0:1787384542.877690:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787384542.877694:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cda00, rc 0) 00000100:00100000:3.0:1787384542.877832:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+23:12238:x1874208182316288:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 981us (1276us total) trans 4294967424 rc 0/0 00000100:00100000:3.0:1787384542.877842:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 161 00000100:00100000:3.0:1787384542.880942:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384542.881744:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182316416 00000100:00100000:1.0:1787384542.881760:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182316416 00000100:00100000:1.0:1787384542.881901:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 13 00000100:00100000:1.0:1787384542.881913:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd759c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+23:2416:x1874208182316416:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384542.881944:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384542.881977:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba3288 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3931 expref: 23 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.882003:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f8e8aa4e00) 00010000:00010000:1.0:1787384542.882010:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384542.882100:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd759c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+22:2416:x1874208182316416:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 189us (1180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384542.882109:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 13 00000100:00100000:0.0:1787384542.895684:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384542.898099:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182316544 00000100:00100000:2.0:1787384542.898121:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182316544 00000100:00100000:2.0:1787384542.898227:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 57 00000100:00100000:2.0:1787384542.898239:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2415:x1874208182316544:12345-192.168.203.45@tcp:1:lfs.0 00010000:00010000:2.0:1787384542.898302:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e3dd551/0x7ef423838fba32ab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.898329:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000075dd50c5/0x7ef423838fba325e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce391c expref: 6 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.898339:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384542.898344:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787384542.898349:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e3dd551/0x7ef423838fba32ab lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.898411:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000075dd50c5/0x7ef423838fba325e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce391c expref: 6 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.898428:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000075dd50c5/0x7ef423838fba325e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce391c expref: 6 pid: 8438 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384542.898469:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1874208203359232:192.168.203.45@tcp:104: 00000100:00100000:2.0:1787384542.898623:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2956540 going to sleep for 11 seconds 00000100:00100000:0.0:1787384542.902911:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384542.903102:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182316672 00000100:00100000:1.0:1787384542.903141:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182316672 00002000:00100000:1.0:1787384542.903214:0:8443:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff98f8f7e07b80 x1874208182316672/t0(0) o4->55e96ad5-fd9d-44d4-856e-5db0c40b1329@192.168.203.45@tcp:573/0 lens 504/0 e 0 to 0 dl 1787384553 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787384542.903226:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98f8f7e07b80 with x1874208182316672 ext(0->12) 00010000:00010000:1.0:1787384542.903237:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000075dd50c5/0x7ef423838fba325e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce391c expref: 7 pid: 8438 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.903257:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000075dd50c5/0x7ef423838fba325e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce391c expref: 7 pid: 8438 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787384542.903266:0:8443:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98f8f7e07b80 00000100:00100000:1.0:1787384542.903311:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 2 00000100:00100000:1.0:1787384542.903322:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:2416:x1874208182316672:12345-192.168.203.45@tcp:4:lfs.0 00000100:00100000:2.0:1787384542.907557:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1874208203359232:192.168.203.45@tcp:104: 00010000:00010000:2.0:1787384542.907599:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004e3dd551/0x7ef423838fba32ab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384542.908389:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+9:2416:x1874208182316672:12345-192.168.203.45@tcp:4:lfs.0 Request processed in 5058us (5479us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787384542.908404:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 2 00002000:00100000:1.0:1787384542.908418:0:8443:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff98f8f7e07b80 x1874208182316672/t4294967306(0) o4->55e96ad5-fd9d-44d4-856e-5db0c40b1329@192.168.203.45@tcp:573/0 lens 504/448 e 0 to 0 dl 1787384553 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787384542.908430:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98f8f7e07b80 with x1874208182316672 ext(0->12) 00010000:00010000:1.0:1787384542.908442:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000075dd50c5/0x7ef423838fba325e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce391c expref: 9 pid: 8438 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.908461:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000075dd50c5/0x7ef423838fba325e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce391c expref: 9 pid: 8438 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787384542.908487:0:8443:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98f8f7e07b80 00000100:00100000:3.0:1787384542.935998:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384542.936135:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182316800 00000100:00100000:1.0:1787384542.936144:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182316800 00010000:00010000:1.0:1787384542.936183:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000075dd50c5/0x7ef423838fba325e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce391c expref: 9 pid: 8438 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384542.936228:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 80 00000100:00100000:1.0:1787384542.936236:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd75a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+9:2414:x1874208182316800:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384542.936252:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787384542.936270:0:10399:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787384542.936273:0:10399:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787384541 00002000:00010000:1.0:1787384542.936275:0:10399:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787384542 00002000:00010000:1.0:1787384542.936278:0:10399:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1787384541 00002000:00010000:1.0:1787384542.936280:0:10399:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1787384542.936286:0:10399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 0000000075dd50c5/0x7ef423838fba325e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce391c expref: 9 pid: 8438 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.936300:0:10399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000075dd50c5/0x7ef423838fba325e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce391c expref: 9 pid: 8438 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.936324:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075dd50c5/0x7ef423838fba325e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce391c expref: 9 pid: 8438 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.936339:0:10399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=1s v=(1 0) 00010000:00010000:1.0:1787384542.936343:0:10399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787384542.936361:0:10399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004e3dd551/0x7ef423838fba32ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.936370:0:10399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e3dd551/0x7ef423838fba32ab lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.936405:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787384542.937411:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004e3dd551/0x7ef423838fba32ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.937426:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e3dd551/0x7ef423838fba32ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.937449:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e3dd551/0x7ef423838fba32ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.937458:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e3dd551/0x7ef423838fba32ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.937466:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e3dd551/0x7ef423838fba32ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.937473:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965ac00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:2.0:1787384542.937478:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e3dd551/0x7ef423838fba32ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.937503:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e3dd551/0x7ef423838fba32ab lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.937518:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e3dd551/0x7ef423838fba32ab lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.937525:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e3dd551/0x7ef423838fba32ab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384542.941098:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd75a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+8:2414:x1874208182316800:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 4852us (5100us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384542.941110:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 80 00000100:00100000:2.0:1787384542.948080:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:2415:x1874208182316544:12345-192.168.203.45@tcp:1:lfs.0 Request processed in 49830us (52399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384542.948095:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 57 00000100:00100000:0.0:1787384542.949746:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384542.950270:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182317056 00000100:00100000:1.0:1787384542.950281:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182317056 00000100:00100000:1.0:1787384542.950368:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 38 00000100:00100000:1.0:1787384542.950379:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9504c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+22:12238:x1874208182317056:12345-192.168.203.45@tcp:35:lfs.0 00000004:00010000:1.0:1787384542.950437:0:6524:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba329d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3938 expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787384542.950620:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1787384542.950656:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1787384542.951408:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1787384542.951449:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba32b2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.951465:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba3249 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce390e expref: 26 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.951473:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba32b2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.951528:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba3249 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce390e expref: 26 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.951543:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba3249 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce390e expref: 26 pid: 8195 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384542.951560:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e66a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1874208203359360:192.168.203.45@tcp:104: 00000100:00100000:1.0:1787384542.952133:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c2fd30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384542.957190:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384542.957303:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182317184 00000100:00100000:2.0:1787384542.957313:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182317184 00010000:00010000:2.0:1787384542.957349:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba3249 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce390e expref: 27 pid: 8195 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384542.957394:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 81 00000100:00100000:2.0:1787384542.957404:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+27:2416:x1874208182317184:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384542.957418:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384542.957424:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba3249 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce390e expref: 27 pid: 8195 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.957436:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba3249 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce390e expref: 27 pid: 8195 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.957474:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f8e8aa4e00) 00010000:00010000:2.0:1787384542.957479:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba32b2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.957488:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba32b2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.957494:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba32b2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384542.957513:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384542.957566:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+27:2416:x1874208182317184:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 162us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384542.957574:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 81 00010000:00010000:1.0:1787384542.957669:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba3249 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce390e expref: 26 pid: 8195 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384542.957684:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e66a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1874208203359360:192.168.203.45@tcp:104: 00010000:00010000:1.0:1787384542.957703:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba32b2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.957713:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba32b2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384542.957717:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba32b2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787384542.957859:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:1.0:1787384542.957995:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1787384542.958075:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e66a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1874208203359488:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787384542.958117:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384542.958140:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c2fd3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787384542.958428:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203359488 00000100:00100000:0.0:1787384542.958433:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203359488 00000100:00100000:0.0:1787384542.958476:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787384542.958483:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6524:x1874208203359488:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787384542.958579:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6524:x1874208203359488:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 95us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384542.958587:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787384542.958888:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e66a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1874208203359488:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787384542.959024:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:2.0:1787384542.959084:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40de300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1874208203359616:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787384542.959129:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384542.959153:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2956e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787384542.959564:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203359616 00000100:00100000:0.0:1787384542.959570:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203359616 00000100:00100000:0.0:1787384542.959611:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787384542.959620:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6524:x1874208203359616:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787384542.959742:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6524:x1874208203359616:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 123us (612us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787384542.959749:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787384542.959811:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40de300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1874208203359616:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787384542.959865:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:0.0:1787384542.959902:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba32b2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384542.959912:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba32b2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384542.960303:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba32b2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384542.960310:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3953000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384542.960314:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba32b2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384542.960322:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba32b2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384542.960337:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f8e8aa4e00) 00010000:00010000:0.0:1787384542.960351:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787384542.960356:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba32b2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384542.960362:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba32b2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787384542.960465:0:6524:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787384542.960528:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1787384542.960540:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 438040760362ns, next at 439040757865ns, rc = 0 00000001:00080000:0.0:1787384542.960546:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:0.0:1787384542.960573:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f8e8aa4e00) 00010000:00010000:0.0:1787384542.960576:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787384542.960583:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba329d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3938 expref: 30 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384542.960670:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9504c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+29:12238:x1874208182317056:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 10293us (10933us total) trans 4294967433 rc 0/0 00000100:00100000:0.0:1787384542.960678:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 38 00000020:00080000:0.0:1787384542.960683:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787384542.969338:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384542.969445:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182317312 00000100:00100000:3.0:1787384542.969455:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182317312 00000100:00100000:3.0:1787384542.969521:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 162 00000100:00100000:3.0:1787384542.969544:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+29:12238:x1874208182317312:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:3.0:1787384542.969566:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384542.969589:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba32b9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce393f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.969645:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba32b9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce393f expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.969671:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba32b9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce393f expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384542.969689:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c294f500) 00010000:00010000:3.0:1787384542.969692:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787384542.969696:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cd600, rc 0) 00000100:00100000:3.0:1787384542.969758:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+30:12238:x1874208182317312:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 215us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384542.969766:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 162 00000100:00100000:3.0:1787384542.974479:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384542.974579:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182317568 00000100:00100000:2.0:1787384542.974590:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182317568 00000100:00100000:2.0:1787384542.974648:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 39 00000100:00100000:2.0:1787384542.974671:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+30:12238:x1874208182317568:12345-192.168.203.45@tcp:35:lfs.0 00000100:00100000:2.0:1787384542.974952:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+31:12238:x1874208182317568:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 294us (482us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1787384542.974961:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 39 00000100:00100000:1.0:1787384543.074700:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384543.074765:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384543.074832:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384543.074858:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384543.074878:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384543.074899:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384543.074937:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182317824 00000100:00100000:1.0:1787384543.074945:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182317824 00000100:00100000:1.0:1787384543.074993:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182318080 00000100:00100000:1.0:1787384543.074996:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182318080 00000100:00100000:1.0:1787384543.075020:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182318336 00000100:00100000:1.0:1787384543.075022:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182318336 00000100:00100000:1.0:1787384543.075031:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182318464 00000100:00100000:1.0:1787384543.075033:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182318464 00000100:00100000:1.0:1787384543.075046:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 342 00000100:00100000:1.0:1787384543.075059:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2414:x1874208182318080:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384543.075121:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2414:x1874208182318080:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 67us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384543.075129:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 342 00000100:00100000:1.0:1787384543.075148:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 343 00000100:00100000:1.0:1787384543.075154:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2416:x1874208182318336:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384543.075178:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2416:x1874208182318336:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 24us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384543.075184:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 343 00000100:00100000:1.0:1787384543.075200:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 344 00000100:00100000:1.0:1787384543.075206:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2416:x1874208182318464:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384543.075229:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2416:x1874208182318464:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 23us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384543.075245:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 344 00000100:00100000:1.0:1787384543.075257:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 163 00000100:00100000:1.0:1787384543.075263:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+31:12248:x1874208182317824:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:1.0:1787384543.075277:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384543.075303:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba32c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3946 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384543.075405:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1787384543.075503:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba32c0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3946 expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.075518:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f8edc2ee00) 00010000:00010000:1.0:1787384543.075521:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787384543.075526:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba32c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3946 expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.075538:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3952000, rc 0) 00000100:00100000:1.0:1787384543.075562:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+32:12248:x1874208182317824:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 299us (872us total) trans 4294967435 rc 301/301 00000100:00100000:1.0:1787384543.075568:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 163 00000100:00080000:0.0:1787384543.076288:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787384543.076429:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182317952 00000100:00100000:3.0:1787384543.076436:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182317952 00000100:00100000:3.0:1787384543.076487:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 389 00000100:00100000:3.0:1787384543.076495:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+13:2414:x1874208182317952:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384543.076537:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+13:2414:x1874208182317952:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 43us (1771us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384543.076544:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 389 00000100:00100000:2.0:1787384543.077087:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182318208 00000100:00100000:2.0:1787384543.077094:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182318208 00000100:00100000:2.0:1787384543.077442:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 123 00000100:00100000:2.0:1787384543.077451:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2416:x1874208182318208:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384543.077494:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2416:x1874208182318208:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 44us (2614us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384543.077502:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 123 00000100:00080000:1.0:1787384543.077682:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787384543.082762:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384543.082989:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182318592 00000100:00100000:3.0:1787384543.083010:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182318592 00000100:00100000:3.0:1787384543.083079:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 164 00000100:00100000:3.0:1787384543.083090:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+32:12248:x1874208182318592:12345-192.168.203.45@tcp:34:lfs.0 00010000:00010000:3.0:1787384543.083163:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba32ce lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384543.083180:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba32ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384543.083193:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba32ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384543.083208:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba32d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384543.083214:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba32d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384543.083220:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba32d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384543.083296:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba32dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384543.083304:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba32dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384543.083311:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba32dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787384543.083352:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba32dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384543.083594:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba32ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384543.083601:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba32ce lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384543.083608:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba32ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384543.083614:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cce00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384543.083617:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba32ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384543.083624:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba32ce lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384543.083635:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f8e8aa4100) 00010000:00010000:3.0:1787384543.083638:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384543.083642:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba32ce lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384543.083648:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba32ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384543.083660:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba32d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384543.083667:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba32d5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384543.083673:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba32d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384543.083685:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cdc00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384543.083688:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba32d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384543.083694:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba32d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384543.083702:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f7c294f900) 00010000:00010000:3.0:1787384543.083704:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384543.083707:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba32d5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384543.083712:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba32d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384543.083726:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba32dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384543.083733:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba32dc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384543.083738:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba32dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384543.083744:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cda00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384543.083746:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba32dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384543.083752:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba32dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384543.083770:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c294f500) 00010000:00010000:3.0:1787384543.083772:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384543.084114:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba32dc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384543.084124:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba32dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384543.084298:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+32:12248:x1874208182318592:12345-192.168.203.45@tcp:34:lfs.0 Request processed in 1207us (1543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384543.084308:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 164 00000100:00100000:0.0:1787384543.092869:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384543.093867:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182318848 00000100:00100000:2.0:1787384543.093878:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182318848 00000100:00100000:2.0:1787384543.093938:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 40 00000100:00100000:2.0:1787384543.093948:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+32:12248:x1874208182318848:12345-192.168.203.45@tcp:35:lfs.0 00000100:00100000:2.0:1787384543.094171:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+33:12248:x1874208182318848:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 223us (1315us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1787384543.094179:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 40 00000100:00100000:0.0:1787384543.155363:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384543.155515:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182319104 00000100:00100000:1.0:1787384543.155525:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182319104 00000100:00100000:1.0:1787384543.155635:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 165 00000100:00100000:1.0:1787384543.155646:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+33:12251:x1874208182319104:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:1.0:1787384543.155694:0:14031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384543.155718:0:14031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba32e3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce394d expref: -99 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.155829:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952e00/0x7ef423838fba32ea lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.155864:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952e00/0x7ef423838fba32ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.155875:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952e00/0x7ef423838fba32ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.155888:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba32f1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.155895:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba32f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.155901:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba32f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.156017:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba32f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.156026:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba32f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.156033:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba32f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384543.156042:0:14031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787384543.156141:0:14031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952e00/0x7ef423838fba32ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.156149:0:14031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952e00/0x7ef423838fba32ea lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.156155:0:14031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952e00/0x7ef423838fba32ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.156161:0:14031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3952e00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384543.156166:0:14031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952e00/0x7ef423838fba32ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.156172:0:14031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952e00/0x7ef423838fba32ea lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.156184:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f8e8aa4100) 00010000:00010000:1.0:1787384543.156187:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384543.156191:0:14031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952e00/0x7ef423838fba32ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.156197:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952e00/0x7ef423838fba32ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.156210:0:14031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba32f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.156216:0:14031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba32f1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.156222:0:14031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba32f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.156244:0:14031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3953c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384543.156247:0:14031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba32f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.156253:0:14031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba32f1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.156262:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f8edc2e700) 00010000:00010000:1.0:1787384543.156264:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384543.156267:0:14031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba32f1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.156272:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba32f1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.156314:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba32e3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce394d expref: 36 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.156326:0:14031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba32f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce394d expref: 35 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.156333:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c294f500) 00010000:00010000:1.0:1787384543.156335:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787384543.156338:0:14031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3953000, rc 0) 00000100:00100000:1.0:1787384543.156399:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+35:12251:x1874208182319104:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 755us (1045us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1787384543.156408:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 165 00010000:00010000:0.0:1787384543.158948:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384543.160799:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384543.160993:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182319232 00000100:00100000:0.0:1787384543.161003:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182319232 00000100:00100000:0.0:1787384543.161061:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 166 00000100:00100000:0.0:1787384543.161072:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d915aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+35:12251:x1874208182319232:12345-192.168.203.45@tcp:54:lfs.0 00010000:00010000:0.0:1787384543.161231:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3306 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384543.161248:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3306 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384543.161260:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3306 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384543.161299:0:8195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3306 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384543.161307:0:8195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3306 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384543.161313:0:8195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3306 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384543.161319:0:8195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384543.161323:0:8195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3306 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384543.161330:0:8195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3306 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384543.161342:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c294f500) 00010000:00010000:0.0:1787384543.161344:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787384543.161348:0:8195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3306 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384543.161352:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3306 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384543.161582:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d915aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+35:12251:x1874208182319232:12345-192.168.203.45@tcp:54:lfs.0 Request processed in 511us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384543.161590:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 166 00000100:00100000:0.0:1787384543.167877:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384543.168138:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182319488 00000100:00100000:2.0:1787384543.168149:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182319488 00000100:00100000:2.0:1787384543.168282:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 41 00000100:00100000:2.0:1787384543.168292:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c426b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+35:12251:x1874208182319488:12345-192.168.203.45@tcp:35:lfs.0 00000100:00100000:2.0:1787384543.168537:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c426b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+36:12251:x1874208182319488:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 245us (670us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1787384543.168545:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 41 00000100:00100000:1.0:1787384543.606428:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384543.606537:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182319744 00000100:00100000:3.0:1787384543.606547:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182319744 00000100:00100000:3.0:1787384543.606613:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 167 00000100:00100000:3.0:1787384543.606622:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+36:12282:x1874208182319744:12345-192.168.203.45@tcp:101:cat.0 00010000:00010000:3.0:1787384543.606647:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384543.606679:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba330d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3954 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384543.606819:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3314 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384543.606832:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3314 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384543.606851:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3314 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384543.606876:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787384543.606994:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba330d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3954 expref: 39 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384543.607011:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3314 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3954 expref: 38 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384543.607021:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c294f500) 00010000:00010000:3.0:1787384543.607024:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787384543.607027:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cda00, rc 0) 00000100:00100000:3.0:1787384543.607086:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+38:12282:x1874208182319744:12345-192.168.203.45@tcp:101:cat.0 Request processed in 465us (667us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1787384543.607094:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 167 00000100:00100000:3.0:1787384543.619186:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384543.619301:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182319872 00000100:00100000:1.0:1787384543.619310:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182319872 00000100:00100000:1.0:1787384543.619376:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 14 00000100:00100000:1.0:1787384543.619386:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9158700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+38:2416:x1874208182319872:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384543.619403:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384543.619427:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3314 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3954 expref: 38 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.619446:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c294f500) 00010000:00010000:1.0:1787384543.619450:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384543.619518:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9158700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+37:2416:x1874208182319872:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 133us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384543.619526:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 14 00000100:00100000:1.0:1787384543.623769:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384543.624387:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182320128 00000100:00100000:0.0:1787384543.624398:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182320128 00000100:00100000:0.0:1787384543.624464:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 42 00000100:00100000:0.0:1787384543.624474:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+37:12282:x1874208182320128:12345-192.168.203.45@tcp:35:cat.0 00000100:00100000:0.0:1787384543.624755:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+38:12282:x1874208182320128:12345-192.168.203.45@tcp:35:cat.0 Request processed in 281us (993us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1787384543.624764:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 42 00000100:00100000:0.0:1787384543.724394:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384543.724847:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182320384 00000100:00100000:1.0:1787384543.724857:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182320384 00000100:00100000:1.0:1787384543.724930:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 168 00000100:00100000:1.0:1787384543.724940:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+38:12287:x1874208182320384:12345-192.168.203.45@tcp:101:dd.0 00010000:00010000:1.0:1787384543.724965:0:14031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384543.724968:0:14031:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787384543.724995:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953e00/0x7ef423838fba327a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce392a expref: 38 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.725013:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f8e8aa4100) 00010000:00010000:1.0:1787384543.725018:0:14031:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787384543.725032:0:14031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952e00/0x7ef423838fba3322 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce395b expref: -99 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.725171:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba3329 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.725186:0:14031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba32f8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce394d expref: 38 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.725194:0:14031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba3329 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.725226:0:14031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba32f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce394d expref: 38 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.725239:0:14031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba32f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce394d expref: 38 pid: 14031 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384543.725252:0:14031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e66a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14031:1874208203359744:192.168.203.45@tcp:104: 00000100:00100000:1.0:1787384543.725363:0:14031:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c2fd3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787384543.735457:0:14031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e66a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14031:1874208203359744:192.168.203.45@tcp:104: 00010000:00010000:2.0:1787384543.735488:0:14031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba3329 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384543.736825:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384543.736986:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182320512 00000100:00100000:1.0:1787384543.736995:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182320512 00010000:00010000:1.0:1787384543.737032:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba32f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce394d expref: 39 pid: 14031 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384543.737073:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 82 00000100:00100000:1.0:1787384543.737083:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b46050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+39:2415:x1874208182320512:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384543.737097:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384543.737104:0:10399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba32f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce394d expref: 39 pid: 14031 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.737130:0:10399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba32f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce394d expref: 39 pid: 14031 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.737151:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba32f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce394d expref: 39 pid: 14031 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.737168:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c294f500) 00010000:00010000:1.0:1787384543.737173:0:10399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba3329 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.737194:0:10399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba3329 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.737202:0:10399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba3329 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384543.737223:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384543.737273:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b46050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+38:2415:x1874208182320512:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 191us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384543.737280:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 82 00010000:00010000:2.0:1787384543.737517:0:14031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba3329 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384543.737532:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba3329 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384543.737550:0:14031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787384543.737676:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952e00/0x7ef423838fba3322 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce395b expref: 39 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384543.737691:0:14031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba3329 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce395b expref: 38 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384543.737698:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c294f500) 00010000:00010000:2.0:1787384543.737701:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787384543.737703:0:14031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3953400, rc 0) 00000100:00100000:2.0:1787384543.737748:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+38:12287:x1874208182320384:12345-192.168.203.45@tcp:101:dd.0 Request processed in 12809us (13364us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1787384543.737755:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 168 00000100:00100000:0.0:1787384543.745590:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384543.746073:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182320640 00000100:00100000:2.0:1787384543.746083:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182320640 00000100:00100000:2.0:1787384543.746146:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 169 00000100:00100000:2.0:1787384543.746156:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+38:12287:x1874208182320640:12345-192.168.203.45@tcp:101:dd.0 00010000:00010000:2.0:1787384543.746178:0:8195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384543.746197:0:8195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba3337 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3962 expref: -99 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384543.746231:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba333e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384543.746262:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba333e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384543.746272:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba333e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384543.746378:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba3337 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3962 expref: 40 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384543.746395:0:8195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba333e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3962 expref: 39 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384543.746403:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c294f500) 00010000:00010000:2.0:1787384543.746407:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787384543.746410:0:8195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965ae00, rc 0) 00000100:00100000:2.0:1787384543.746477:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+39:12287:x1874208182320640:12345-192.168.203.45@tcp:101:dd.0 Request processed in 322us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384543.746484:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 169 00000100:00100000:1.0:1787384543.758155:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384543.758257:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182320896 00000100:00100000:0.0:1787384543.758268:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182320896 00000100:00100000:0.0:1787384543.758329:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 170 00000100:00100000:0.0:1787384543.758340:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+39:12287:x1874208182320896:12345-192.168.203.45@tcp:36:dd.0 00010000:00010000:0.0:1787384543.762269:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba3345 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384543.762291:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba3345 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384543.762302:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba3345 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787384543.762382:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:0.0:1787384543.762405:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000436c6751 reply state 00000000c0ebea71 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba3345 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384543.762418:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba3345 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384543.762428:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c294f500) 00010000:00010000:0.0:1787384543.762431:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787384543.762435:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787384543.762851:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+42:12287:x1874208182320896:12345-192.168.203.45@tcp:36:dd.0 Request processed in 4508us (4699us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1787384543.762861:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 170 00000020:00080000:0.0:1787384543.762867:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787384544.135929:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384544.136261:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182321024 00000100:00100000:2.0:1787384544.136272:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182321024 00000100:00100000:2.0:1787384544.136344:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 171 00000100:00100000:2.0:1787384544.136355:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+42:12301:x1874208182321024:12345-192.168.203.45@tcp:101:stat.0 00010000:00010000:2.0:1787384544.136379:0:14031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384544.136400:0:14031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba334c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3969 expref: -99 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787384544.136451:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787384544.136467:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba3353 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.136505:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba3353 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.136518:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba3353 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.136532:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba335a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.136539:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba335a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.136546:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba335a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.136615:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3361 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.136624:0:14031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba3329 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce395b expref: 43 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.136633:0:14031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3361 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.136670:0:14031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba3329 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce395b expref: 43 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.136683:0:14031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba3329 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce395b expref: 43 pid: 14031 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384544.136706:0:14031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40dfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14031:1874208203359872:192.168.203.45@tcp:104: 00000100:00100000:2.0:1787384544.136815:0:14031:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2956240 going to sleep for 11 seconds 00000100:00100000:0.0:1787384544.139422:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384544.139747:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182321280 00000100:00100000:1.0:1787384544.139756:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182321280 00000100:00100000:1.0:1787384544.139830:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 43 00000100:00100000:1.0:1787384544.139844:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+44:6183:x1874208182321280:12345-192.168.203.45@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787384544.140328:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+45:6183:x1874208182321280:12345-192.168.203.45@tcp:35:ldlm_bl.0 Request processed in 483us (911us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1787384544.140365:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 43 00000100:00100000:2.0:1787384544.142460:0:14031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40dfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14031:1874208203359872:192.168.203.45@tcp:104: 00010000:00010000:2.0:1787384544.142492:0:14031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3361 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384544.148265:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384544.148366:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182321408 00000100:00100000:3.0:1787384544.148377:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182321408 00010000:00010000:3.0:1787384544.148416:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba3329 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce395b expref: 45 pid: 14031 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384544.148457:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 83 00000100:00100000:3.0:1787384544.148467:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+45:2416:x1874208182321408:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384544.148481:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384544.148489:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba3329 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce395b expref: 45 pid: 14031 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.148503:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba3329 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce395b expref: 45 pid: 14031 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.148542:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba3329 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce395b expref: 45 pid: 14031 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.148560:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c294f500) 00010000:00010000:3.0:1787384544.148565:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3361 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.148575:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3361 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.148583:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3361 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.148615:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384544.148675:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+44:2416:x1874208182321408:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 208us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384544.148683:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 83 00010000:00010000:2.0:1787384544.148815:0:14031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3361 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.148824:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3361 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384544.148894:0:14031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787384544.148898:0:14031:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787384544.148936:0:14031:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3361 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.148951:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3361 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.148960:0:14031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba3353 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.148967:0:14031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba3353 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.148973:0:14031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba3353 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.148979:0:14031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965bc00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384544.148991:0:14031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba3353 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.148999:0:14031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba3353 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.149009:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f8e8aa4100) 00010000:00010000:2.0:1787384544.149012:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384544.149016:0:14031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba3353 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.149022:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba3353 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.149033:0:14031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba335a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.149039:0:14031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba335a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.149044:0:14031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba335a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.149049:0:14031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965ba00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384544.149052:0:14031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba335a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.149057:0:14031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba335a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.149065:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f8e8aa4000) 00010000:00010000:2.0:1787384544.149067:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384544.149076:0:14031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba335a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.149082:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba335a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.149119:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba334c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3969 expref: 44 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.149132:0:14031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3361 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3969 expref: 43 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.149138:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c294f500) 00010000:00010000:2.0:1787384544.149141:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787384544.149143:0:14031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965be00, rc 0) 00000100:00100000:2.0:1787384544.149173:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+43:12301:x1874208182321024:12345-192.168.203.45@tcp:101:stat.0 Request processed in 12821us (13263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384544.149181:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 171 00000100:00100000:1.0:1787384544.183813:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787384544.183844:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203360000:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787384544.183915:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384544.184123:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203360000 00000100:00100000:2.0:1787384544.184131:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203360000 00000100:00100000:2.0:1787384544.184183:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787384544.184193:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd759c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203360000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787384544.184225:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787384544.184280:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd759c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203360000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384544.184288:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00010000:00010000:2.0:1787384544.184963:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384544.185455:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203360000:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787384544.235057:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384544.235263:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182321664 00000100:00100000:1.0:1787384544.235274:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182321664 00000100:00100000:1.0:1787384544.235340:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 172 00000100:00100000:1.0:1787384544.235350:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d915ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+43:12308:x1874208182321664:12345-192.168.203.45@tcp:36:truncate.0 00010000:00010000:1.0:1787384544.235407:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384544.235434:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3361 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3969 expref: 43 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.235454:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c294f500) 00010000:00010000:1.0:1787384544.235458:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787384544.235643:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952600/0x7ef423838fba3368 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.235658:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952600/0x7ef423838fba3368 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.235667:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952600/0x7ef423838fba3368 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787384544.235710:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:1.0:1787384544.235732:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000044759a43 reply state 00000000094a8bad transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952600/0x7ef423838fba3368 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.235764:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952600/0x7ef423838fba3368 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.235771:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c294f500) 00010000:00010000:1.0:1787384544.235774:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787384544.235835:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787384544.235945:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d915ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+45:12308:x1874208182321664:12345-192.168.203.45@tcp:36:truncate.0 Request processed in 596us (907us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1787384544.235954:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 172 00000020:00080000:1.0:1787384544.235959:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787384544.412296:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384544.412389:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182321792 00000100:00100000:3.0:1787384544.412399:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182321792 00000100:00100000:3.0:1787384544.412463:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 173 00000100:00100000:3.0:1787384544.412472:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+45:12322:x1874208182321792:12345-192.168.203.45@tcp:101:stat.0 00010000:00010000:3.0:1787384544.412724:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384544.412748:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba336f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3970 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.412950:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba3376 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.412965:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba3376 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.412975:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba3376 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.412988:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba337d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.412995:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba337d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.413001:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba337d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.413971:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3384 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.413990:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3384 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.414000:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3384 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384544.414221:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1787384544.414227:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787384544.414251:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3384 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.414282:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3384 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.414291:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba3376 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.414298:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba3376 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.414304:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba3376 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.414310:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cdc00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384544.414314:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba3376 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.414321:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba3376 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.414334:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f8e8aa4100) 00010000:00010000:3.0:1787384544.414337:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384544.414342:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba3376 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.414348:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba3376 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.414365:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba337d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.414371:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba337d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.414384:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba337d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.414389:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cce00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384544.414393:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba337d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.414400:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba337d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.414410:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f7c294f900) 00010000:00010000:3.0:1787384544.414412:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384544.414415:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba337d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.414420:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba337d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.414465:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba336f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3970 expref: 47 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.414481:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3384 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3970 expref: 46 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.414488:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c294f500) 00010000:00010000:3.0:1787384544.414490:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787384544.417178:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cda00, rc 0) 00000100:00100000:3.0:1787384544.417277:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+46:12322:x1874208182321792:12345-192.168.203.45@tcp:101:stat.0 Request processed in 4801us (4984us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384544.417304:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 173 00000100:00100000:3.0:1787384544.534821:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384544.534961:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182322048 00000100:00100000:2.0:1787384544.534980:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182322048 00000100:00100000:2.0:1787384544.535064:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 174 00000100:00100000:2.0:1787384544.535074:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9159880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+46:12332:x1874208182322048:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:2.0:1787384544.535095:0:14031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384544.535116:0:14031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba338b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3977 expref: -99 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384544.535212:0:14031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1787384544.535314:0:14031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba338b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3977 expref: 48 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.535329:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f8edc2ee00) 00010000:00010000:2.0:1787384544.535332:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787384544.535337:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba338b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3977 expref: 48 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.535352:0:14031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965a400, rc 0) 00000100:00100000:2.0:1787384544.535415:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9159880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+47:12332:x1874208182322048:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 342us (645us total) trans 4294967447 rc 301/301 00000100:00100000:2.0:1787384544.535422:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 174 00000100:00100000:1.0:1787384544.539761:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384544.539997:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182322304 00000100:00100000:3.0:1787384544.540008:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182322304 00000100:00100000:3.0:1787384544.540073:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 44 00000100:00100000:3.0:1787384544.540084:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9506850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+47:12332:x1874208182322304:12345-192.168.203.45@tcp:35:lfs.0 00000100:00100000:3.0:1787384544.540328:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9506850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+48:12332:x1874208182322304:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 244us (575us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1787384544.540336:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 44 00000100:00100000:0.0:1787384544.650989:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384544.651094:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182322560 00000100:00100000:1.0:1787384544.651104:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182322560 00000100:00100000:1.0:1787384544.651165:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 175 00000100:00100000:1.0:1787384544.651176:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+48:12338:x1874208182322560:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:1.0:1787384544.651201:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384544.651223:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952800/0x7ef423838fba3399 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce397e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.651328:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba33a0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.651343:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3384 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3970 expref: 49 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.651352:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba33a0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.651403:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3384 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3970 expref: 49 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.651416:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3384 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3970 expref: 49 pid: 6523 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384544.651429:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd75a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1874208203360128:192.168.203.45@tcp:104: 00000100:00100000:1.0:1787384544.651662:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c2fd3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787384544.673139:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384544.673377:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182322688 00000100:00100000:3.0:1787384544.673385:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182322688 00010000:00010000:3.0:1787384544.673427:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3384 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3970 expref: 50 pid: 6523 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384544.673474:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 84 00000100:00100000:3.0:1787384544.673493:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+50:2415:x1874208182322688:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384544.673508:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384544.673515:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3384 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3970 expref: 50 pid: 6523 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.673530:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3384 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3970 expref: 50 pid: 6523 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.673553:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c294f500) 00010000:00010000:3.0:1787384544.673565:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba33a0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.673590:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba33a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.673597:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba33a0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.673616:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384544.673676:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+50:2415:x1874208182322688:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 193us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384544.673684:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 84 00010000:00010000:1.0:1787384544.675204:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3384 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3970 expref: 49 pid: 6523 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384544.675228:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd75a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1874208203360128:192.168.203.45@tcp:104: 00010000:00010000:1.0:1787384544.675253:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba33a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.675263:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba33a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.675269:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba33a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384544.675288:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1787384544.675423:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952800/0x7ef423838fba3399 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce397e expref: 50 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.675439:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba33a0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce397e expref: 49 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.675465:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c294f500) 00010000:00010000:1.0:1787384544.675468:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787384544.675471:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3953400, rc 0) 00000100:00100000:1.0:1787384544.675537:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+49:12338:x1874208182322560:12345-192.168.203.45@tcp:101:bash.0 Request processed in 24362us (24556us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1787384544.675545:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 175 00000100:00100000:0.0:1787384544.686082:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384544.691575:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182322944 00000100:00100000:3.0:1787384544.691589:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182322944 00000100:00100000:3.0:1787384544.691843:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 176 00000100:00100000:3.0:1787384544.691854:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+49:12338:x1874208182322944:12345-192.168.203.45@tcp:36:bash.0 00010000:00010000:3.0:1787384544.692068:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba33ae lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.692084:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba33ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.692095:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba33ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787384544.692130:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:3.0:1787384544.692170:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008260d01c reply state 00000000411a1be5 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba33ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.692183:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba33ae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.692199:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c294f500) 00010000:00010000:3.0:1787384544.692202:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787384544.692205:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787384544.692310:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+52:12338:x1874208182322944:12345-192.168.203.45@tcp:36:bash.0 Request processed in 457us (6237us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1787384544.692317:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 176 00000020:00080000:3.0:1787384544.692322:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787384544.695247:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d915bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203360256:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787384544.695333:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384544.695421:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203360256 00000100:00100000:2.0:1787384544.695430:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203360256 00000100:00100000:2.0:1787384544.695686:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787384544.695696:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd75a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203360256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787384544.695736:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1787384544.702876:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd75a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203360256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 7170us (7531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384544.702891:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787384544.703433:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d915bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203360256:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787384544.706424:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384544.706714:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182323072 00000100:00100000:1.0:1787384544.706724:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182323072 00000100:00100000:1.0:1787384544.706858:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 177 00000100:00100000:1.0:1787384544.706868:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+52:12338:x1874208182323072:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:1.0:1787384544.706887:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384544.706905:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952800/0x7ef423838fba33b5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3985 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.707006:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953800/0x7ef423838fba33bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.707022:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba33a0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce397e expref: 53 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.707030:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953800/0x7ef423838fba33bc lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.707090:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba33a0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce397e expref: 53 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.707103:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba33a0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce397e expref: 53 pid: 6522 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384544.707117:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e06d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1874208203360384:192.168.203.45@tcp:104: 00000100:00100000:1.0:1787384544.707218:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c2fd3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787384544.721580:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384544.721952:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182323200 00000100:00100000:0.0:1787384544.721962:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182323200 00010000:00010000:0.0:1787384544.722002:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba33a0 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce397e expref: 54 pid: 6522 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384544.722051:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 85 00000100:00100000:0.0:1787384544.722061:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d915bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+54:2416:x1874208182323200:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787384544.722076:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384544.722095:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba33a0 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce397e expref: 54 pid: 6522 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384544.722109:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba33a0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce397e expref: 54 pid: 6522 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384544.722132:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c294f500) 00010000:00010000:0.0:1787384544.722137:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953800/0x7ef423838fba33bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384544.722148:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953800/0x7ef423838fba33bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384544.722156:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953800/0x7ef423838fba33bc lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384544.722176:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384544.722380:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d915bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+54:2416:x1874208182323200:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 319us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384544.722389:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 85 00010000:00010000:1.0:1787384544.723169:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba33a0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce397e expref: 53 pid: 6522 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384544.723190:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e06d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1874208203360384:192.168.203.45@tcp:104: 00010000:00010000:1.0:1787384544.723214:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953800/0x7ef423838fba33bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.723222:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953800/0x7ef423838fba33bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.723228:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953800/0x7ef423838fba33bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384544.723297:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787384544.723302:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787384544.723325:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953800/0x7ef423838fba33bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.723357:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952800/0x7ef423838fba33b5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3985 expref: 53 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.723391:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953800/0x7ef423838fba33bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3985 expref: 52 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.723400:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c294f500) 00010000:00010000:1.0:1787384544.723403:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787384544.723406:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3953800, rc 0) 00000100:00100000:1.0:1787384544.723446:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+52:12338:x1874208182323072:12345-192.168.203.45@tcp:101:bash.0 Request processed in 16580us (17032us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384544.723454:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 177 00000100:00100000:0.0:1787384544.730326:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384544.730471:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182323456 00000100:00100000:3.0:1787384544.730481:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182323456 00000100:00100000:3.0:1787384544.730577:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 45 00000100:00100000:3.0:1787384544.730587:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+52:12338:x1874208182323456:12345-192.168.203.45@tcp:35:bash.0 00000100:00100000:3.0:1787384544.731606:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+53:12338:x1874208182323456:12345-192.168.203.45@tcp:35:bash.0 Request processed in 1014us (1282us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1787384544.731617:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 45 00000100:00100000:2.0:1787384544.882487:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384544.882629:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182323712 00000100:00100000:1.0:1787384544.882638:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182323712 00000100:00100000:1.0:1787384544.882696:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 178 00000100:00100000:1.0:1787384544.882706:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+53:12348:x1874208182323712:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:1.0:1787384544.882728:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384544.882747:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952800/0x7ef423838fba33c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce398c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384544.882879:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1787384544.883000:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952800/0x7ef423838fba33c3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce398c expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.883015:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f8edc2ee00) 00010000:00010000:1.0:1787384544.883018:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787384544.883023:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952800/0x7ef423838fba33c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce398c expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.883055:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3952800, rc 0) 00000100:00100000:1.0:1787384544.883120:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+54:12348:x1874208182323712:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 414us (640us total) trans 4294967453 rc 301/301 00000100:00100000:1.0:1787384544.883128:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 178 00000100:00100000:0.0:1787384544.885833:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384544.885982:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182323840 00000100:00100000:3.0:1787384544.886001:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182323840 00000100:00100000:3.0:1787384544.886203:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 179 00000100:00100000:3.0:1787384544.886216:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+54:12348:x1874208182323840:12345-192.168.203.45@tcp:34:lfs.0 00010000:00010000:3.0:1787384544.886324:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba33d1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.886345:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba33d1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.886358:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba33d1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.886391:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba33d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.886398:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba33d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.886404:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba33d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.886496:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba33df lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.886506:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba33df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.886513:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba33df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787384544.886581:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba33df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.886597:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba33d1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.886604:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba33d1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.886612:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba33d1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.886619:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cce00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384544.886624:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba33d1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.886676:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba33d1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.886693:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f8e8aa4100) 00010000:00010000:3.0:1787384544.886696:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384544.886701:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba33d1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.886707:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba33d1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.886723:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba33d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.886728:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba33d8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.886733:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba33d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.886738:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cdc00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384544.886741:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba33d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.886747:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba33d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.886752:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f7c294f900) 00010000:00010000:3.0:1787384544.886755:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384544.886757:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba33d8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.886773:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba33d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.886827:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba33df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.886834:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba33df lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.886839:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba33df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.886844:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cda00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384544.886847:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba33df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.886854:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba33df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.886862:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c294f500) 00010000:00010000:3.0:1787384544.886864:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384544.886867:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba33df lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384544.886873:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba33df lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384544.886982:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+54:12348:x1874208182323840:12345-192.168.203.45@tcp:34:lfs.0 Request processed in 768us (1156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384544.886991:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 179 00000100:00100000:0.0:1787384544.889406:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384544.889496:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182324096 00000100:00100000:1.0:1787384544.889508:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182324096 00000100:00100000:1.0:1787384544.889565:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 46 00000100:00100000:1.0:1787384544.889573:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+54:12348:x1874208182324096:12345-192.168.203.45@tcp:35:lfs.0 00000100:00100000:1.0:1787384544.890204:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+55:12348:x1874208182324096:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 627us (806us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1787384544.890214:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 46 00000100:00100000:2.0:1787384544.964484:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384544.965411:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182324352 00000100:00100000:1.0:1787384544.965429:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182324352 00000100:00100000:1.0:1787384544.965529:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 180 00000100:00100000:1.0:1787384544.965541:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+55:12351:x1874208182324352:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:1.0:1787384544.965573:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384544.965603:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952800/0x7ef423838fba33e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3993 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.965755:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba33ed lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.965830:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba33ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.965847:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba33ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.965873:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba33f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.965881:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba33f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.965888:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba33f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.966057:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba33fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.966067:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba33fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.966075:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba33fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384544.966087:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787384544.966186:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba33ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.966195:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba33ed lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.966202:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba33ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.966208:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3953400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384544.966213:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba33ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.966232:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba33ed lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.966246:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f8e8aa4100) 00010000:00010000:1.0:1787384544.966249:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384544.966255:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba33ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.966261:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953400/0x7ef423838fba33ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.966279:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba33f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.966285:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba33f4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.966291:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba33f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.966296:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3953000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384544.966299:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba33f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.966306:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba33f4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.966313:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f8edc2e700) 00010000:00010000:1.0:1787384544.966600:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384544.966604:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba33f4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.967107:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953000/0x7ef423838fba33f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.967184:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952800/0x7ef423838fba33e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3993 expref: 58 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.967200:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba33fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3993 expref: 57 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.967209:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c294f500) 00010000:00010000:1.0:1787384544.967211:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787384544.967215:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3952400, rc 0) 00000100:00100000:1.0:1787384544.967510:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+57:12351:x1874208182324352:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 1970us (3041us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1787384544.967520:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 180 00000100:00100000:0.0:1787384544.972290:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384544.972349:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384544.972484:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182324608 00000100:00100000:1.0:1787384544.972498:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182324608 00000100:00100000:1.0:1787384544.972583:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 15 00000100:00100000:1.0:1787384544.972595:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee255500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+57:2416:x1874208182324608:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384544.972614:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384544.972647:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba33fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3993 expref: 57 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384544.972686:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c294f500) 00010000:00010000:1.0:1787384544.972699:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384544.972775:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee255500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+56:2416:x1874208182324608:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 182us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384544.972838:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 15 00000100:00100000:2.0:1787384544.973620:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182324480 00000100:00100000:2.0:1787384544.973631:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182324480 00000100:00100000:2.0:1787384544.973719:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 181 00000100:00100000:2.0:1787384544.973730:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+56:12351:x1874208182324480:12345-192.168.203.45@tcp:54:lfs.0 00010000:00010000:2.0:1787384544.973854:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba3409 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.973874:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba3409 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.973888:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba3409 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.973944:0:14031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba3409 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.973952:0:14031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba3409 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.973959:0:14031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba3409 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.973967:0:14031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965ba00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384544.973971:0:14031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba3409 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.973981:0:14031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba3409 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.973993:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c294f500) 00010000:00010000:2.0:1787384544.974009:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787384544.974015:0:14031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba3409 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384544.974022:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba3409 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384544.974121:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+56:12351:x1874208182324480:12345-192.168.203.45@tcp:54:lfs.0 Request processed in 391us (1843us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384544.974129:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 181 00000100:00100000:0.0:1787384544.977650:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384544.977745:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182324864 00000100:00100000:3.0:1787384544.977759:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182324864 00000100:00100000:3.0:1787384544.977871:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 47 00000100:00100000:3.0:1787384544.977883:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+56:12351:x1874208182324864:12345-192.168.203.45@tcp:35:lfs.0 00000100:00100000:3.0:1787384544.978409:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+57:12351:x1874208182324864:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 525us (772us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1787384544.978419:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 47 00010000:00010000:0.0:1787384545.210567:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384545.248189:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384545.248641:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182325120 00000100:00100000:3.0:1787384545.248671:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182325120 00000100:00100000:3.0:1787384545.248828:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 182 00000100:00100000:3.0:1787384545.248843:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+57:12369:x1874208182325120:12345-192.168.203.45@tcp:101:cat.0 00010000:00010000:3.0:1787384545.248884:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384545.248923:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3410 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce399a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.249090:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba3417 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.249110:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba3417 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.249124:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba3417 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384545.249138:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787384545.249604:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3410 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce399a expref: 60 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.249630:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba3417 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce399a expref: 59 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.249663:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c294f500) 00010000:00010000:3.0:1787384545.249667:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787384545.249672:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cdc00, rc 0) 00000100:00100000:3.0:1787384545.249893:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+59:12369:x1874208182325120:12345-192.168.203.45@tcp:101:cat.0 Request processed in 1052us (1717us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1787384545.249901:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 182 00000100:00100000:0.0:1787384545.291118:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384545.293648:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182325248 00000100:00100000:1.0:1787384545.293967:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182325248 00000100:00100000:1.0:1787384545.294205:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 183 00000100:00100000:1.0:1787384545.294292:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+59:12370:x1874208182325248:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:1.0:1787384545.294329:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384545.294359:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba3425 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce39a1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.294450:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952800/0x7ef423838fba342c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.294467:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952800/0x7ef423838fba342c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.294481:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952800/0x7ef423838fba342c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384545.294544:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1787384545.294549:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787384545.294574:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952800/0x7ef423838fba342c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.294604:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba3425 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39a1 expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.297513:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952800/0x7ef423838fba342c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39a1 expref: 60 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.297569:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f8e8aa4100) 00010000:00010000:1.0:1787384545.297573:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787384545.297577:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3952800, rc 0) 00000100:00100000:1.0:1787384545.301495:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+60:12370:x1874208182325248:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 7188us (10370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384545.301513:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 183 00000100:00100000:0.0:1787384545.311186:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384545.311348:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182325632 00000100:00100000:1.0:1787384545.311361:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182325632 00000100:00100000:1.0:1787384545.311440:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 48 00000100:00100000:1.0:1787384545.311453:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+60:12370:x1874208182325632:12345-192.168.203.45@tcp:35:lfs.0 00000001:00080000:1.0:1787384545.311958:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967458 00000100:00100000:0.0:1787384545.312413:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+62:12370:x1874208182325632:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 960us (1238us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1787384545.312442:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 48 00000020:00080000:0.0:1787384545.312448:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787384545.319836:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384545.320016:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182325760 00000100:00100000:0.0:1787384545.320030:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182325760 00000100:00100000:0.0:1787384545.320130:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 16 00000100:00100000:0.0:1787384545.320143:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+62:12370:x1874208182325760:12345-192.168.203.45@tcp:103:lfs.0 00010000:00010000:0.0:1787384545.320164:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787384545.320197:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953800/0x7ef423838fba33bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3985 expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384545.320224:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba3417 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce399a expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384545.320240:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba32b9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce393f expref: 60 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384545.320251:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c294f500) 00010000:00010000:0.0:1787384545.320257:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384545.320351:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+59:12370:x1874208182325760:12345-192.168.203.45@tcp:103:lfs.0 Request processed in 212us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384545.320361:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 16 00000100:00100000:2.0:1787384545.329365:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384545.329469:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182325888 00000100:00100000:0.0:1787384545.329482:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182325888 00000100:00100000:0.0:1787384545.329560:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 184 00000100:00100000:0.0:1787384545.329573:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+59:12370:x1874208182325888:12345-192.168.203.45@tcp:58:lfs.0 00010000:00010000:0.0:1787384545.329761:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba3433 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384545.329851:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba3433 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384545.329866:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba3433 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787384545.330012:0:8195:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1787384545.330366:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+59:12370:x1874208182325888:12345-192.168.203.45@tcp:58:lfs.0 Request processed in 793us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384545.330376:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 184 00000100:00100000:1.0:1787384545.378071:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384545.378334:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182326016 00000100:00100000:3.0:1787384545.378347:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182326016 00000100:00100000:3.0:1787384545.378431:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 185 00000100:00100000:3.0:1787384545.378442:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+59:12372:x1874208182326016:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:3.0:1787384545.378471:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384545.378498:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba343a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce39a8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.378582:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba3441 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.378600:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba3441 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.378613:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba3441 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.378632:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba3448 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.378640:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba3448 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.378681:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba3448 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.378773:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba344f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.378844:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba344f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.378851:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba344f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384545.378907:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787384545.378921:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787384545.378946:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba344f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.378961:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba344f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.378969:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba3441 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.378977:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba3441 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.378985:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba3441 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.378992:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cce00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384545.378996:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba3441 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.379013:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba3441 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.379028:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f8e8aa4100) 00010000:00010000:3.0:1787384545.379031:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384545.379211:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba3441 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.379220:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba3441 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.379237:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba3448 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.379243:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba3448 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.379249:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba3448 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.379254:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cd600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384545.379258:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba3448 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.379264:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba3448 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.379272:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f7c294f900) 00010000:00010000:3.0:1787384545.379275:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384545.379278:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba3448 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.379295:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba3448 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.379337:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba343a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39a8 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.379351:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba344f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39a8 expref: 60 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.379359:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c294f500) 00010000:00010000:3.0:1787384545.379361:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787384545.379364:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cdc00, rc 0) 00000100:00100000:3.0:1787384545.379446:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+60:12372:x1874208182326016:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 1005us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384545.379455:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 185 00000040:00080000:2.0:1787384545.655083:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787384545.655097:0:13801:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787384545.655152:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787384545.655163:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787384545.655649:0:13801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42e8700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1874208203360512:192.168.203.45@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787384545.661158:0:13801:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2956f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787384545.661366:0:13801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42e8700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1874208203360512:192.168.203.45@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787384545.663626:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384545.664954:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182326144 00000100:00100000:2.0:1787384545.664968:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182326144 00000100:00100000:2.0:1787384545.665047:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 186 00000100:00100000:2.0:1787384545.665058:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+60:12383:x1874208182326144:12345-192.168.203.45@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787384545.665090:0:6522:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787384545.665237:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+60:12383:x1874208182326144:12345-192.168.203.45@tcp:53:lhsmtool_posix.0 Request processed in 179us (1618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384545.665245:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 186 00000100:00100000:0.0:1787384545.672014:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384545.672127:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182326272 00000100:00100000:3.0:1787384545.672137:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182326272 00000100:00100000:3.0:1787384545.672202:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 187 00000100:00100000:3.0:1787384545.672211:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+60:12383:x1874208182326272:12345-192.168.203.45@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787384545.672296:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3456 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.672313:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3456 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.672325:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3456 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.672395:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba345d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.672404:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba345d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.672412:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba345d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.672438:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba3464 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.672448:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba3464 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.672454:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba3464 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384545.672498:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787384545.672503:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787384545.672514:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba3464 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.672525:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3456 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.672531:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3456 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.672538:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3456 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.672554:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cda00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384545.672558:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3456 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.672566:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3456 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.672578:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98f7c3a9cf00) 00010000:00010000:3.0:1787384545.672581:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384545.672586:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3456 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.672593:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba3456 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.672606:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba345d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.672613:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba345d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.672619:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba345d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.672624:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cd600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384545.672627:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba345d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.672633:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba345d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.672649:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff98f7c294f900) 00010000:00010000:3.0:1787384545.672652:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384545.672655:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba345d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.672676:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba345d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.672691:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba3464 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.672696:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba3464 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.672701:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba3464 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.672705:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cce00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384545.672708:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba3464 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.672713:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba3464 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.672720:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c294f500) 00010000:00010000:3.0:1787384545.672722:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384545.672725:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba3464 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.672729:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba3464 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384545.672870:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+60:12383:x1874208182326272:12345-192.168.203.45@tcp:34:lhsmtool_posix.0 Request processed in 658us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384545.672879:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 187 00000100:00100000:1.0:1787384545.683648:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384545.694904:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182326528 00000100:00100000:2.0:1787384545.694932:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182326528 00000100:00100000:2.0:1787384545.695015:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 188 00000100:00100000:2.0:1787384545.695026:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3adb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+60:12383:x1874208182326528:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787384545.695049:0:14031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384545.695076:0:14031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba346b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce39af expref: -99 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.695188:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba3472 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.695204:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba3472 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.695215:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba3472 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384545.695227:0:14031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787384545.695332:0:14031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba3472 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.695340:0:14031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba3472 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.695347:0:14031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba3472 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.695353:0:14031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965b400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384545.695358:0:14031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba3472 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.695364:0:14031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba3472 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.695393:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c294f500) 00010000:00010000:2.0:1787384545.695396:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787384545.695400:0:14031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba3472 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.695406:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba3472 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.695461:0:14031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba346b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39af expref: 62 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.695471:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98f7c3a9cf00) 00010000:00010000:2.0:1787384545.695474:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787384545.695477:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba346b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39af expref: 62 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.695486:0:14031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965ac00, rc 0) 00000100:00100000:2.0:1787384545.695547:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3adb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+61:12383:x1874208182326528:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 524us (11907us total) trans 4294967460 rc 301/301 00000100:00100000:2.0:1787384545.695555:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 188 00000100:00100000:0.0:1787384545.707665:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384545.707761:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182326656 00000100:00100000:3.0:1787384545.707773:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182326656 00000100:00100000:3.0:1787384545.707868:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 189 00000100:00100000:3.0:1787384545.707878:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+61:12383:x1874208182326656:12345-192.168.203.45@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787384545.707922:0:8195:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787384545.708042:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+61:12383:x1874208182326656:12345-192.168.203.45@tcp:53:lhsmtool_posix.0 Request processed in 166us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384545.708051:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 189 00000100:00100000:1.0:1787384545.716738:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384545.716816:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182326912 00000100:00100000:3.0:1787384545.716827:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182326912 00000100:00100000:3.0:1787384545.716889:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 190 00000100:00100000:3.0:1787384545.716899:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+61:12383:x1874208182326912:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787384545.716929:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384545.716933:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787384545.716959:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952800/0x7ef423838fba342c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39a1 expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.716976:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f8e8aa4100) 00010000:00010000:3.0:1787384545.716981:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787384545.716993:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba3480 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce39b6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787384545.717375:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:3.0:1787384545.717524:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba3487 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.717538:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba3487 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.717547:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba3487 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.717596:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba3480 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39b6 expref: 63 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.717609:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba3487 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39b6 expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.717616:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98f7c294f900) 00010000:00010000:3.0:1787384545.717619:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787384545.717622:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cd600, rc 0) 00000100:00100000:3.0:1787384545.717677:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+62:12383:x1874208182326912:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 780us (945us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1787384545.717685:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 190 00000100:00100000:2.0:1787384545.739640:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384545.740080:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182327168 00000100:00100000:3.0:1787384545.740091:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182327168 00000100:00100000:3.0:1787384545.740155:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 191 00000100:00100000:3.0:1787384545.740166:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+62:12383:x1874208182327168:12345-192.168.203.45@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787384545.740219:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384545.740256:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd600/0x7ef423838fba3487 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39b6 expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.740273:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98f7c294f900) 00010000:00010000:3.0:1787384545.740282:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787384545.740304:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba3495 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.740316:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba3495 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.740325:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba3495 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.740338:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba349c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x6c89d0f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.740345:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba349c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x6c89d0f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.740352:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba349c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x6c89d0f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.740394:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba3495 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.740401:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba3495 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.740407:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba3495 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.740413:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cce00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384545.740422:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba3495 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.740429:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba3495 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.740437:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f8e8aa4100) 00010000:00010000:3.0:1787384545.740440:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384545.740443:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba3495 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.740449:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cce00/0x7ef423838fba3495 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.740459:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba349c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x6c89d0f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.740464:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba349c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6c89d0f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.740468:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba349c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6c89d0f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.740473:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cda00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384545.740476:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba349c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6c89d0f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.740481:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba349c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6c89d0f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.740488:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x6c89d0f1 (ffff98f7c294f200) 00010000:00010000:3.0:1787384545.740491:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384545.740499:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba349c lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x6c89d0f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.740504:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cda00/0x7ef423838fba349c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x6c89d0f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384545.740596:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+61:12383:x1874208182327168:12345-192.168.203.45@tcp:36:lhsmtool_posix.0 Request processed in 431us (963us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787384545.740604:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 191 00000100:00100000:2.0:1787384545.747343:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384545.747466:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182327296 00000100:00100000:3.0:1787384545.747476:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182327296 00000100:00100000:3.0:1787384545.747529:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 192 00000100:00100000:3.0:1787384545.747539:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+61:12383:x1874208182327296:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787384545.747558:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384545.747582:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba34a3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce39bd expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.747614:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba34aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.747628:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba34aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.747641:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba34aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.747741:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba34a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39bd expref: 63 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.747759:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba34aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39bd expref: 62 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.747805:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98f7c294fb00) 00010000:00010000:3.0:1787384545.747809:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787384545.747813:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2090c00, rc 0) 00000100:00100000:3.0:1787384545.747875:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+62:12383:x1874208182327296:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 337us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384545.747882:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 192 00000100:00100000:2.0:1787384545.751735:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384545.751835:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182327552 00000100:00100000:3.0:1787384545.751845:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182327552 00000100:00100000:3.0:1787384545.751899:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 193 00000100:00100000:3.0:1787384545.751920:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+62:12383:x1874208182327552:12345-192.168.203.45@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787384545.751997:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba34b1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.752012:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba34b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.752023:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba34b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787384545.752192:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1787384545.752202:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 440832423005ns, next at 441832420766ns, rc = 0 00000004:00010000:3.0:1787384545.752250:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000e7916da reply state 000000002a1ff004 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba34b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.752263:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba34b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.752272:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98f7c294fb00) 00010000:00010000:3.0:1787384545.752288:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787384545.752291:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787384545.752386:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+64:12383:x1874208182327552:12345-192.168.203.45@tcp:36:lhsmtool_posix.0 Request processed in 478us (660us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1787384545.752394:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 193 00000100:00100000:2.0:1787384545.761750:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384545.761856:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182327680 00000100:00100000:0.0:1787384545.761867:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182327680 00000100:00100000:0.0:1787384545.761932:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 194 00000100:00100000:0.0:1787384545.761941:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+64:12383:x1874208182327680:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787384545.761965:0:8195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384545.761985:0:8195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba34b8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce39c4 expref: -99 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384545.762051:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba34b8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39c4 expref: 65 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384545.762066:0:8195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba34b8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39c4 expref: 65 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384545.762102:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98f7c294fb00) 00010000:00010000:0.0:1787384545.762106:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787384545.762110:0:8195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6140c00, rc 0) 00000100:00100000:0.0:1787384545.762169:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+65:12383:x1874208182327680:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 229us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384545.762177:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 194 00000100:00100000:2.0:1787384545.765340:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384545.765434:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182327808 00000100:00100000:0.0:1787384545.765443:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182327808 00000100:00100000:0.0:1787384545.765511:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 58 00000100:00100000:0.0:1787384545.765522:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+6:2416:x1874208182327808:12345-192.168.203.45@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787384545.765741:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:2416:x1874208182327808:12345-192.168.203.45@tcp:2:lhsmtool_posix.0 Request processed in 220us (409us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787384545.765749:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 58 00000100:00080000:1.0:1787384545.765851:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787384545.768671:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384545.768752:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182328064 00000100:00100000:3.0:1787384545.768761:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182328064 00000100:00100000:3.0:1787384545.768853:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 49 00000100:00100000:3.0:1787384545.768862:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+65:12383:x1874208182328064:12345-192.168.203.45@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787384545.769339:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+66:12383:x1874208182328064:12345-192.168.203.45@tcp:35:lhsmtool_posix.0 Request processed in 476us (675us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1787384545.769347:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 49 00000100:00100000:3.0:1787384545.772538:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384545.772639:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182328320 00000100:00100000:1.0:1787384545.772648:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182328320 00000100:00100000:1.0:1787384545.772709:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 195 00000100:00100000:1.0:1787384545.772719:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+66:12383:x1874208182328320:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787384545.773025:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+66:12383:x1874208182328320:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 Request processed in 305us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384545.773401:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 195 00000100:00100000:2.0:1787384545.776085:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384545.776238:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182328448 00000100:00100000:1.0:1787384545.776248:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182328448 00000100:00100000:1.0:1787384545.776304:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 196 00000100:00100000:1.0:1787384545.776320:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+66:12383:x1874208182328448:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787384545.776340:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384545.776358:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba34bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce39cb expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.776420:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba34c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.776437:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba34c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.776447:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba34c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384545.776497:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787384545.776521:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba34c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.776552:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba34bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39cb expref: 68 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.776569:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba34c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39cb expref: 67 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.776578:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98f7c294fb00) 00010000:00010000:1.0:1787384545.776581:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787384545.776584:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3952c00, rc 0) 00000100:00100000:1.0:1787384545.776737:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+67:12383:x1874208182328448:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 417us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384545.776755:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 196 00000100:00100000:3.0:1787384545.780632:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384545.780704:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182328576 00000100:00100000:0.0:1787384545.780714:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182328576 00000100:00100000:0.0:1787384545.780774:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 59 00000100:00100000:0.0:1787384545.780810:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee115f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:2416:x1874208182328576:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787384545.780836:0:8890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384545.780857:0:8890:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000124fd424/0x7ef423838fba34cd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce39d2 expref: -99 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787384545.780881:0:8890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8952e1, blocks: 0x0 00010000:00010000:0.0:1787384545.780901:0:8890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=440s v=(0 0) 00010000:00010000:0.0:1787384545.780915:0:8890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384545.780940:0:8890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000124fd424/0x7ef423838fba34cd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39d2 expref: 8 pid: 8890 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384545.780959:0:8890:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000124fd424/0x7ef423838fba34cd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39d2 expref: 8 pid: 8890 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384545.780972:0:8890:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6141c00, rc 0) 00000100:00100000:0.0:1787384545.781303:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee115f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+8:2416:x1874208182328576:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 496us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384545.781310:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 59 00000100:00100000:3.0:1787384545.784345:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384545.784446:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182328832 00000100:00100000:0.0:1787384545.784456:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182328832 00000100:00100000:0.0:1787384545.784521:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 197 00000100:00100000:0.0:1787384545.784531:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c426b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+67:12383:x1874208182328832:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787384545.784631:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c426b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+67:12383:x1874208182328832:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 Request processed in 101us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384545.784638:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 197 00000100:00100000:3.0:1787384545.800359:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384545.800532:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182328960 00000100:00100000:0.0:1787384545.800543:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182328960 00000100:00100000:0.0:1787384545.800600:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 60 00000100:00100000:0.0:1787384545.800610:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+8:12383:x1874208182328960:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787384545.800628:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384545.800646:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba34d4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce39d9 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384545.800675:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000124fd424/0x7ef423838fba34cd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39d2 expref: 9 pid: 8890 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384545.800695:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384545.800699:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384545.800704:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba34d4 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39d9 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384545.800737:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000124fd424/0x7ef423838fba34cd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39d2 expref: 9 pid: 8890 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384545.800750:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000124fd424/0x7ef423838fba34cd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39d2 expref: 9 pid: 8890 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384545.800765:0:8435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a6c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1874208203360640:192.168.203.45@tcp:104: 00000100:00100000:0.0:1787384545.800882:0:8435:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f87c9900 going to sleep for 11 seconds 00000100:00100000:3.0:1787384545.803702:0:8435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a6c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1874208203360640:192.168.203.45@tcp:104: 00010000:00010000:3.0:1787384545.803737:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba34d4 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39d9 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.803757:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6141e00, rc 0) 00000100:00100000:3.0:1787384545.803842:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+9:12383:x1874208182328960:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 3233us (3491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384545.803851:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 60 00000100:00100000:0.0:1787384545.809556:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384545.809643:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182329088 00000100:00100000:1.0:1787384545.809654:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182329088 00010000:00010000:1.0:1787384545.809696:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000124fd424/0x7ef423838fba34cd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39d2 expref: 9 pid: 8890 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384545.809741:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 86 00000100:00100000:1.0:1787384545.809750:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+9:2415:x1874208182329088:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384545.809764:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384545.809803:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000124fd424/0x7ef423838fba34cd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39d2 expref: 9 pid: 8890 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.809817:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000124fd424/0x7ef423838fba34cd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39d2 expref: 9 pid: 8890 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.809849:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000124fd424/0x7ef423838fba34cd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39d2 expref: 9 pid: 8890 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.809866:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384545.809870:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384545.809878:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba34d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39d9 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.809889:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba34d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39d9 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.809950:0:6508:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba34d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39d9 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384545.809964:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7f07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6508:1874208203360768:192.168.203.45@tcp:105: 00000100:00100000:1.0:1787384545.810106:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c2fd30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384545.816942:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384545.817183:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7f07100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6508:1874208203360768:192.168.203.45@tcp:105: 00010000:00010000:1.0:1787384545.817207:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384545.817280:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+8:2415:x1874208182329088:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 7530us (7732us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384545.817290:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 86 00000100:00100000:3.0:1787384545.817484:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182329216 00000100:00100000:3.0:1787384545.817492:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182329216 00002000:00100000:3.0:1787384545.817543:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff98f8d9144380 x1874208182329216/t0(0) o4->55e96ad5-fd9d-44d4-856e-5db0c40b1329@192.168.203.45@tcp:576/0 lens 504/0 e 0 to 0 dl 1787384556 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787384545.817553:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98f8d9144380 with x1874208182329216 ext(0->8) 00002000:00010000:3.0:1787384545.817559:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98f8d9144380 00000100:00100000:3.0:1787384545.817595:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 4 00000100:00100000:3.0:1787384545.817603:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+8:2416:x1874208182329216:12345-192.168.203.45@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787384545.819112:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+10:2416:x1874208182329216:12345-192.168.203.45@tcp:4:lhsmtool_posix.0 Request processed in 1501us (2169us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1787384545.819123:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 4 00002000:00100000:3.0:1787384545.819133:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff98f8d9144380 x1874208182329216/t4294967315(0) o4->55e96ad5-fd9d-44d4-856e-5db0c40b1329@192.168.203.45@tcp:576/0 lens 504/448 e 0 to 0 dl 1787384556 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787384545.819142:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98f8d9144380 with x1874208182329216 ext(0->8) 00002000:00010000:3.0:1787384545.819147:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98f8d9144380 00000100:00100000:3.0:1787384545.824052:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384545.824148:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182329344 00000100:00100000:1.0:1787384545.824157:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182329344 00000100:00100000:1.0:1787384545.824215:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 198 00000100:00100000:1.0:1787384545.824225:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+67:12383:x1874208182329344:12345-192.168.203.45@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787384545.827098:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967463 is committed 00000004:00080000:3.0:1787384545.827116:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:3.0:1787384545.827188:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1787384545.827208:0:6501:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98f7c2956900 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1787384545.827213:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff98f8c3266b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98f7c2956540 00000020:00080000:3.0:1787384545.827216:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff98f8c3266400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98f7c48a9400 00000100:00100000:1.0:1787384545.827452:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7f07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203360896:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787384545.827527:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384545.827581:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203360896 00000100:00100000:1.0:1787384545.827588:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203360896 00000100:00100000:1.0:1787384545.827639:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787384545.827649:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203360896:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787384545.827763:0:8438:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787384545.827767:0:8438:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787384545 00002000:00010000:1.0:1787384545.827770:0:8438:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787384545.827772:0:8438:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1787384545 -> 1787384545 00002000:00010000:1.0:1787384545.827814:0:8438:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000020:00080000:3.0:1787384545.828002:0:6553:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1787384545.828036:0:6553:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1787384545.828424:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3651:x1874208203360896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 774us (906us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787384545.828434:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1787384545.828461:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787384545.828473:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9b55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203361024:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787384545.828503:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1787384545.828561:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98f8f7f07100/2, rc 0, transno 4294967316 00000100:00100000:1.0:1787384545.828567:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7f07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203360896:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787384545.828582:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203361024 00000100:00100000:1.0:1787384545.828586:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203361024 00000100:00100000:1.0:1787384545.828621:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787384545.828628:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d8533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3652:x1874208203361024:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787384545.828648:0:8890:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:1.0:1787384545.828676:0:8890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a8952dd, atime: 0x6a8952de, ctime: 0x6a8952dd, blocks: 0x8 00010000:00010000:1.0:1787384545.828685:0:8890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000134ec9d2/0x7ef423838fba34db lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.828700:0:8890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1787384545.828704:0:8890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384545.828710:0:8890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000134ec9d2/0x7ef423838fba34db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.828727:0:8890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000134ec9d2/0x7ef423838fba34db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.828736:0:8890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000134ec9d2/0x7ef423838fba34db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.828754:0:8890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000134ec9d2/0x7ef423838fba34db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.828772:0:8890:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787384545.829184:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba3345 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.829194:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba3345 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.829200:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba3345 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.829205:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384545.829209:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba3345 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.829217:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba3345 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.829239:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c294f500) 00010000:00010000:2.0:1787384545.829242:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384545.829246:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba3345 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.829251:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba3345 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.829267:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952600/0x7ef423838fba3368 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.829274:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952600/0x7ef423838fba3368 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.829280:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952600/0x7ef423838fba3368 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.829296:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3952600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384545.829299:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952600/0x7ef423838fba3368 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.829304:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952600/0x7ef423838fba3368 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.829313:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c294f500) 00010000:00010000:2.0:1787384545.829315:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384545.829317:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952600/0x7ef423838fba3368 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.829322:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952600/0x7ef423838fba3368 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.829333:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba33ae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.829338:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba33ae lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.829343:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba33ae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.829349:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cc000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384545.829351:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba33ae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.829356:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba33ae lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.829371:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c294f500) 00010000:00010000:2.0:1787384545.829373:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384545.829376:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba33ae lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.829381:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc000/0x7ef423838fba33ae lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.829391:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba34b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.829396:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba34b1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.829401:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba34b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.829405:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2090400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384545.829407:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba34b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.829413:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba34b1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.829420:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98f7c294fb00) 00010000:00010000:2.0:1787384545.829422:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787384545.829424:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba34b1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.829429:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba34b1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384545.830116:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d8533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3652:x1874208203361024:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1485us (1609us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787384545.830125:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1787384545.830151:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787384545.830161:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384545.830167:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000134ec9d2/0x7ef423838fba34db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.830175:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3952000 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384545.830179:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000134ec9d2/0x7ef423838fba34db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.830187:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000134ec9d2/0x7ef423838fba34db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.830199:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000134ec9d2/0x7ef423838fba34db lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.830205:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000134ec9d2/0x7ef423838fba34db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787384545.830355:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98f8d9b55880/2, rc 0, transno 4294967308 00000100:00100000:2.0:1787384545.830363:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9b55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203361024:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1787384545.830556:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384545.830558:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384545.830560:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384545.830669:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+19:12383:x1874208182329344:12345-192.168.203.45@tcp:44:lhsmtool_posix.0 Request processed in 6443us (6633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384545.830679:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 198 00000100:00100000:2.0:1787384545.842105:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384545.842145:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182329472 00000100:00100000:2.0:1787384545.842154:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182329472 00000100:00100000:2.0:1787384545.842208:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 63 00000100:00100000:2.0:1787384545.842218:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+10:2414:x1874208182329472:12345-192.168.203.45@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787384545.847365:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:2.0:1787384545.847380:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:2.0:1787384545.847484:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:2414:x1874208182329472:12345-192.168.203.45@tcp:16:lhsmtool_posix.0 Request processed in 5263us (5385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384545.847495:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 63 00000100:00100000:0.0:1787384545.864204:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384545.864272:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182329728 00000100:00100000:1.0:1787384545.864282:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182329728 00000100:00100000:1.0:1787384545.864330:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 199 00000100:00100000:1.0:1787384545.864337:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9144a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+19:12383:x1874208182329728:12345-192.168.203.45@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787384545.864383:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384545.864407:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba34c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39cb expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.864420:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98f7c294fb00) 00010000:00010000:1.0:1787384545.864424:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787384545.864450:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba34e2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.864462:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba34e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.864470:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba34e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787384545.864571:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000059ded842 reply state 0000000038783e58 transno 4294967464 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba34e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.864598:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba34e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.864604:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98f7c294fb00) 00010000:00010000:1.0:1787384545.864606:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787384545.864608:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787384545.864718:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9144a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+20:12383:x1874208182329728:12345-192.168.203.45@tcp:36:lhsmtool_posix.0 Request processed in 381us (521us total) trans 4294967464 rc 0/0 00000100:00100000:1.0:1787384545.864725:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 199 00000100:00100000:0.0:1787384545.873283:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384545.873749:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182329856 00000100:00100000:1.0:1787384545.873759:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182329856 00000100:00100000:1.0:1787384545.873993:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 64 00000100:00100000:1.0:1787384545.874004:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:2416:x1874208182329856:12345-192.168.203.45@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787384545.874178:0:8890:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787384545.874182:0:8890:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1787384545 -> 1787384544 00002000:00010000:1.0:1787384545.874284:0:8890:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787384542 00002000:00010000:1.0:1787384545.874286:0:8890:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1787384545 -> 1787384544 00002000:00010000:1.0:1787384545.874289:0:8890:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1787384545.874347:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+8:2416:x1874208182329856:12345-192.168.203.45@tcp:2:lhsmtool_posix.0 Request processed in 344us (1079us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1787384545.874355:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 64 00000100:00100000:0.0:1787384545.882288:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384545.885846:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182330112 00000100:00100000:1.0:1787384545.885860:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182330112 00000100:00100000:1.0:1787384545.885932:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 200 00000100:00100000:1.0:1787384545.885942:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9147100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+20:12383:x1874208182330112:12345-192.168.203.45@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787384545.886010:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba34e9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.886126:0:14031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba34aa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39bd expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.886136:0:14031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba34e9 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.886175:0:14031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba34aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39bd expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.886191:0:14031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba34aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39bd expref: 20 pid: 6523 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384545.886205:0:14031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d8532a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14031:1874208203361152:192.168.203.45@tcp:104: 00000100:00100000:1.0:1787384545.886292:0:14031:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c2fd3240 going to sleep for 11 seconds 00000100:00100000:1.0:1787384545.890652:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384545.890848:0:14031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d8532a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14031:1874208203361152:192.168.203.45@tcp:104: 00010000:00010000:3.0:1787384545.890873:0:14031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba34e9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384545.890922:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182330240 00000100:00100000:3.0:1787384545.890929:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182330240 00010000:00010000:3.0:1787384545.890964:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba34aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39bd expref: 21 pid: 6523 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384545.890991:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 87 00000100:00100000:3.0:1787384545.891001:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b44050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+21:2415:x1874208182330240:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384545.891016:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384545.891022:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba34aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39bd expref: 21 pid: 6523 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.891044:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba34aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39bd expref: 21 pid: 6523 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.891063:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba34aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39bd expref: 21 pid: 6523 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.891078:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98f7c294fb00) 00010000:00010000:3.0:1787384545.891082:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba34e9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.891091:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba34e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.891097:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba34e9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.891118:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384545.891174:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b44050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+20:2415:x1874208182330240:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 173us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384545.891182:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 87 00010000:00010000:3.0:1787384545.891389:0:14031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba34e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.891396:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba34e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.891438:0:14031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba34e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.891446:0:14031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba34e9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.891452:0:14031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba34e9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.891457:0:14031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3952c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384545.891462:0:14031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba34e9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.891470:0:14031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba34e9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.891480:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98f7c294fb00) 00010000:00010000:3.0:1787384545.891483:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787384545.891487:0:14031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba34e9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.891494:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba34e9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384545.891547:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9147100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+19:12383:x1874208182330112:12345-192.168.203.45@tcp:55:lhsmtool_posix.0 Request processed in 5607us (9267us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787384545.891556:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 200 00000100:00100000:1.0:1787384545.894711:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384545.897893:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182330368 00000100:00100000:3.0:1787384545.897918:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182330368 00000100:00100000:3.0:1787384545.897984:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 65 00000100:00100000:3.0:1787384545.897994:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d8533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+8:2416:x1874208182330368:12345-192.168.203.45@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787384545.898049:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000962cb950/0x7ef423838fba34f0 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.898068:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba34d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39d9 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.898076:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384545.898081:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787384545.898085:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000962cb950/0x7ef423838fba34f0 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.898122:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba34d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39d9 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.898137:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba34d4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39d9 expref: 8 pid: 8435 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384545.898151:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9b55f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874208203361280:192.168.203.45@tcp:104: 00000100:00100000:3.0:1787384545.898248:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7240b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787384545.902011:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9b55f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874208203361280:192.168.203.45@tcp:104: 00010000:00010000:3.0:1787384545.902055:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000962cb950/0x7ef423838fba34f0 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384545.902250:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384545.902453:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182330496 00000100:00100000:3.0:1787384545.902460:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182330496 00010000:00010000:3.0:1787384545.902494:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba34d4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39d9 expref: 9 pid: 8435 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384545.902535:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 88 00000100:00100000:3.0:1787384545.902543:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d8532300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+9:2416:x1874208182330496:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384545.902556:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384545.902575:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba34d4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39d9 expref: 9 pid: 8435 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.902588:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba34d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39d9 expref: 9 pid: 8435 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.902610:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba34d4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39d9 expref: 9 pid: 8435 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.902624:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787384545.902628:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787384545.902633:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000962cb950/0x7ef423838fba34f0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.902660:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000962cb950/0x7ef423838fba34f0 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.902693:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384545.902741:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d8532300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+8:2416:x1874208182330496:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 198us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384545.902749:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 88 00010000:00010000:0.0:1787384545.902816:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000962cb950/0x7ef423838fba34f0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384545.902826:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000962cb950/0x7ef423838fba34f0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384545.902857:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000962cb950/0x7ef423838fba34f0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384545.902865:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000962cb950/0x7ef423838fba34f0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384545.902872:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000962cb950/0x7ef423838fba34f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384545.902879:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2091400 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384545.902883:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000962cb950/0x7ef423838fba34f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384545.902891:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000962cb950/0x7ef423838fba34f0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384545.902903:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000962cb950/0x7ef423838fba34f0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384545.902921:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000962cb950/0x7ef423838fba34f0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384545.902969:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d8533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:2416:x1874208182330368:12345-192.168.203.45@tcp:1:lhsmtool_posix.0 Request processed in 4977us (8267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384545.902977:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 65 00000100:00100000:0.0:1787384545.905960:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384545.906190:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182330752 00000100:00100000:1.0:1787384545.906200:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182330752 00000100:00100000:1.0:1787384545.906261:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 201 00000100:00100000:1.0:1787384545.906271:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9175880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+19:12383:x1874208182330752:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787384545.906353:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba34f7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.906371:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba333e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3962 expref: 19 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.906400:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba34f7 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.906434:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba333e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3962 expref: 19 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.906447:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba333e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3962 expref: 19 pid: 8195 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384545.906462:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d8531f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1874208203361408:192.168.203.45@tcp:104: 00000100:00100000:1.0:1787384545.906545:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c2fd3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787384545.912174:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d8531f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1874208203361408:192.168.203.45@tcp:104: 00010000:00010000:3.0:1787384545.912203:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba34f7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384545.921993:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384545.927741:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182330880 00000100:00100000:3.0:1787384545.927754:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182330880 00010000:00010000:3.0:1787384545.927845:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba333e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3962 expref: 20 pid: 8195 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384545.927883:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 89 00000100:00100000:3.0:1787384545.927892:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+20:2416:x1874208182330880:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384545.927915:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384545.927922:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba333e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3962 expref: 20 pid: 8195 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.927934:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba333e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3962 expref: 20 pid: 8195 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.927957:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba333e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3962 expref: 20 pid: 8195 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.927978:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c294f500) 00010000:00010000:3.0:1787384545.927984:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba34f7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.927994:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba34f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.928000:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba34f7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.928025:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384545.928091:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+19:2416:x1874208182330880:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 200us (6107us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384545.928099:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 89 00010000:00010000:3.0:1787384545.928226:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba34f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.928234:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba34f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.928399:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba34fe lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.928413:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba34b8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39c4 expref: 19 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.928420:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba34fe lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.928449:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba34b8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39c4 expref: 19 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.928469:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba34b8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39c4 expref: 19 pid: 8195 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384545.928484:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9b55f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1874208203361536:192.168.203.45@tcp:104: 00000100:00100000:3.0:1787384545.928545:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7240c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787384545.932565:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9b55f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1874208203361536:192.168.203.45@tcp:104: 00010000:00010000:3.0:1787384545.932594:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba34fe lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384545.938611:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384545.940143:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182331008 00000100:00100000:3.0:1787384545.940155:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182331008 00010000:00010000:3.0:1787384545.940196:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba34b8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39c4 expref: 20 pid: 8195 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384545.940235:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 90 00000100:00100000:3.0:1787384545.940244:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+20:2415:x1874208182331008:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384545.940258:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384545.940265:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba34b8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39c4 expref: 20 pid: 8195 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.940279:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba34b8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39c4 expref: 20 pid: 8195 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.940302:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba34b8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39c4 expref: 20 pid: 8195 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.940336:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98f7c294fb00) 00010000:00010000:3.0:1787384545.940341:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba34fe lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.940351:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba34fe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.940358:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba34fe lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.940382:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384545.940436:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+19:2415:x1874208182331008:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 191us (1833us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384545.940443:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 90 00010000:00010000:3.0:1787384545.942213:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba34fe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.942227:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba34fe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787384545.942336:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:3.0:1787384545.942454:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000001:00080000:3.0:1787384545.942492:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:3.0:1787384545.942576:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9b55f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1874208203361664:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787384545.942633:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384545.942676:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f5769180 going to sleep for 11 seconds 00000100:00100000:2.0:1787384545.943353:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203361664 00000100:00100000:2.0:1787384545.943362:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203361664 00000100:00100000:2.0:1787384545.943413:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787384545.943421:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6521:x1874208203361664:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787384545.943517:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6521:x1874208203361664:12345-0@lo:1000:mdt00_000.0 Request processed in 96us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384545.943525:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1787384545.944970:0:6521:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:3.0:1787384545.945119:0:6521:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98f8f7f07100, transno 4294967316 00000100:00100000:3.0:1787384545.945141:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9b55f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1874208203361664:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1787384545.945303:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00000100:00100000:3.0:1787384545.945376:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9b55f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1874208203361792:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787384545.945430:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384545.945460:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f5769600 going to sleep for 11 seconds 00000100:00100000:2.0:1787384545.946046:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203361792 00000100:00100000:2.0:1787384545.946054:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203361792 00000100:00100000:2.0:1787384545.946106:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787384545.946115:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fc25f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6521:x1874208203361792:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787384545.946260:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fc25f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6521:x1874208203361792:12345-0@lo:1000:mdt00_000.0 Request processed in 145us (828us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1787384545.946268:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787384545.946957:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9b55f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1874208203361792:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1787384545.947002:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba34fe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.947012:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba34fe lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.947020:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba34fe lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.947025:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2091800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384545.947428:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba34fe lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.947438:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba34fe lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.947455:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98f7c294fb00) 00010000:00010000:3.0:1787384545.947458:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787384545.947462:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba34fe lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.947468:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba34fe lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.947494:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba3433 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.947515:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba3433 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.947522:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba3433 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.947528:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6141200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384545.947531:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba3433 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.947538:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba3433 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.947546:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c294f500) 00010000:00010000:3.0:1787384545.947548:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787384545.947552:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba3433 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.947558:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba3433 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.947582:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba3505 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.947595:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba344f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39a8 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.947604:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba3505 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.947638:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba344f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39a8 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.947660:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba344f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39a8 expref: 22 pid: 6521 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384545.947674:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9b57480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1874208203361920:192.168.203.45@tcp:104: 00000100:00100000:3.0:1787384545.947746:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f5769600 going to sleep for 11 seconds 00000100:00100000:3.0:1787384545.959224:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384545.959285:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182331136 00000100:00100000:1.0:1787384545.959294:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182331136 00010000:00010000:1.0:1787384545.959333:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba344f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39a8 expref: 23 pid: 6521 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384545.959374:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 91 00000100:00100000:1.0:1787384545.959384:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+23:2415:x1874208182331136:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384545.959399:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384545.959405:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba344f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39a8 expref: 23 pid: 6521 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.959418:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba344f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39a8 expref: 23 pid: 6521 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.959441:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c294f500) 00010000:00010000:1.0:1787384545.959454:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba3505 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.959464:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba3505 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.959472:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba3505 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.959492:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384545.959543:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+23:2415:x1874208182331136:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 160us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384545.959550:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 91 00010000:00010000:1.0:1787384545.959598:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba344f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39a8 expref: 22 pid: 6521 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384545.959613:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9b57480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1874208203361920:192.168.203.45@tcp:104: 00010000:00010000:1.0:1787384545.959632:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba3505 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.959641:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba3505 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.959648:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba3505 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.959671:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba3505 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.959679:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba3505 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.959697:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba3505 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.959703:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2091400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384545.959708:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba3505 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.959717:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba3505 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.959726:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c294f500) 00010000:00010000:1.0:1787384545.959729:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384545.959733:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba3505 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.959740:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba3505 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.959751:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba34f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.959757:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba34f7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.959764:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba34f7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.959770:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3952400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384545.959772:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba34f7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.959813:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba34f7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.959822:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c294f500) 00010000:00010000:1.0:1787384545.959825:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787384545.959828:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba34f7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384545.959834:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba34f7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384545.959973:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9175880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+21:12383:x1874208182330752:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 Request processed in 53703us (54021us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1787384545.959981:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 201 00000020:00080000:1.0:1787384545.959985:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787384545.960066:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787384545.960071:0:13801:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787384545.960489:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1787384545.960499:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787384545.966222:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384545.967096:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182331392 00000100:00100000:3.0:1787384545.967107:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182331392 00000100:00100000:3.0:1787384545.967170:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 50 00000100:00100000:3.0:1787384545.967180:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9506c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+21:12383:x1874208182331392:12345-192.168.203.45@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787384545.967430:0:6525:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787384545.967462:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967470 00010000:00010000:3.0:1787384545.967495:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba350c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.967511:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba350c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.967522:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba350c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.968307:0:6525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba350c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.968318:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba350c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.968325:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba350c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384545.968352:0:6525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787384545.968446:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9506c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+23:12383:x1874208182331392:12345-192.168.203.45@tcp:35:lhsmtool_posix.0 Request processed in 1265us (2231us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1787384545.968455:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 50 00000020:00080000:3.0:1787384545.968461:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787384545.971314:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384545.971327:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba350c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.971339:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2090c00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:2.0:1787384545.971343:0:8453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba350c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.971353:0:8453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba350c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.971373:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98f7c294fb00) 00010000:00010000:2.0:1787384545.971376:0:8453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787384545.971380:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba350c lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.971385:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba350c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384545.971402:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384545.971403:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384545.971405:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384546.232666:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787384546.279769:0:14665:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787384546.279792:0:14665:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787384546.279817:0:14665:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787384546.279823:0:14665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787384546.462179:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384546.462344:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182331648 00000100:00100000:0.0:1787384546.462354:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182331648 00000100:00100000:0.0:1787384546.462427:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 202 00000100:00100000:0.0:1787384546.462437:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+23:12393:x1874208182331648:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:0.0:1787384546.462460:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384546.462481:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba3513 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce39e0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.462585:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba351a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.462599:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba351a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.462610:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba351a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384546.462621:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1787384546.462721:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba3513 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39e0 expref: 26 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.462739:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba351a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39e0 expref: 25 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.462765:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f8e8aa4100) 00010000:00010000:0.0:1787384546.462768:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787384546.462772:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6141a00, rc 0) 00000100:00100000:0.0:1787384546.462852:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+25:12393:x1874208182331648:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 416us (683us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1787384546.462859:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 202 00000100:00080000:1.0:1787384546.463156:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787384546.466101:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384546.466179:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182331776 00000100:00100000:0.0:1787384546.466198:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182331776 00000100:00100000:0.0:1787384546.466257:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 203 00000100:00100000:0.0:1787384546.466267:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+25:12393:x1874208182331776:12345-192.168.203.45@tcp:34:lfs.0 00010000:00010000:0.0:1787384546.466345:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3528 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.466361:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3528 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.466373:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3528 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.466386:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba352f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.466393:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba352f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.466399:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba352f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.466492:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3536 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.466501:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3536 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.466508:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3536 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787384546.466553:0:14031:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3536 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.466565:0:14031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3528 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.466570:0:14031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3528 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.466577:0:14031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3528 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.466583:0:14031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384546.466587:0:14031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3528 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.466594:0:14031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3528 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.466606:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f8e8aa4100) 00010000:00010000:0.0:1787384546.466609:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384546.466613:0:14031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3528 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.466626:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3528 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.466641:0:14031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba352f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.466647:0:14031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba352f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.466653:0:14031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba352f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.466658:0:14031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384546.466661:0:14031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba352f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.466667:0:14031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba352f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.466675:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f7c3a9d900) 00010000:00010000:0.0:1787384546.466677:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384546.466680:0:14031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba352f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.466685:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba352f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.466699:0:14031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3536 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.466705:0:14031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3536 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.466716:0:14031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3536 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.466721:0:14031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140e00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384546.466723:0:14031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3536 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.466730:0:14031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3536 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.466736:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c3a9dd00) 00010000:00010000:0.0:1787384546.466739:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384546.466741:0:14031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3536 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.466746:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3536 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384546.466849:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+25:12393:x1874208182331776:12345-192.168.203.45@tcp:34:lfs.0 Request processed in 583us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384546.466857:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 203 00000100:00100000:0.0:1787384546.525367:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384546.525409:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182332032 00000100:00100000:0.0:1787384546.525418:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182332032 00000100:00100000:0.0:1787384546.525471:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 204 00000100:00100000:0.0:1787384546.525481:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+25:12396:x1874208182332032:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:0.0:1787384546.525502:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384546.525523:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba353d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce39e7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.525613:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3544 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.525628:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3544 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.525640:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3544 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.525655:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba354b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.525662:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba354b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.525669:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba354b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.525795:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba3552 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.528107:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba3552 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.528120:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba3552 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384546.528135:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787384546.529428:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3544 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.529442:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3544 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.529461:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3544 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.529468:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384546.529473:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3544 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.529481:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3544 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.529496:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f8e8aa4100) 00010000:00010000:0.0:1787384546.529499:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384546.529503:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3544 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.529510:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3544 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.529521:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba354b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.529526:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba354b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.529531:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba354b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.529536:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384546.529539:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba354b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.529554:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba354b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.529564:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f7c3a9dd00) 00010000:00010000:0.0:1787384546.529566:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384546.529569:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba354b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.529575:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba354b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.529628:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba353d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39e7 expref: 28 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.529643:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba3552 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39e7 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.529650:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c3a9d900) 00010000:00010000:0.0:1787384546.529652:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787384546.529654:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6140a00, rc 0) 00000100:00100000:0.0:1787384546.529728:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+27:12396:x1874208182332032:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 4248us (4369us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1787384546.529737:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 204 00000100:00100000:3.0:1787384546.533571:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384546.533662:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182332160 00000100:00100000:0.0:1787384546.533671:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182332160 00000100:00100000:0.0:1787384546.533726:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 205 00000100:00100000:0.0:1787384546.533736:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+27:12396:x1874208182332160:12345-192.168.203.45@tcp:54:lfs.0 00010000:00010000:0.0:1787384546.533840:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba3560 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.533856:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba3560 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.533993:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba3560 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.534166:0:8195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba3560 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.534175:0:8195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba3560 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.534181:0:8195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba3560 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.534256:0:8195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6141800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384546.534261:0:8195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba3560 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.534268:0:8195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba3560 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.534280:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c3a9d900) 00010000:00010000:0.0:1787384546.534283:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787384546.534288:0:8195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba3560 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.534293:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba3560 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384546.534417:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+27:12396:x1874208182332160:12345-192.168.203.45@tcp:54:lfs.0 Request processed in 681us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384546.534425:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 205 00000100:00100000:2.0:1787384546.543983:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384546.544018:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182332416 00000100:00100000:2.0:1787384546.544038:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182332416 00000100:00100000:2.0:1787384546.544097:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 51 00000100:00100000:2.0:1787384546.544107:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+27:12396:x1874208182332416:12345-192.168.203.45@tcp:35:lfs.0 00000100:00100000:2.0:1787384546.544505:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+28:12396:x1874208182332416:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 397us (530us total) trans 4294967474 rc 0/0 00000100:00100000:2.0:1787384546.544514:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 51 00000100:00100000:3.0:1787384546.574454:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384546.574551:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182332672 00000100:00100000:1.0:1787384546.574560:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182332672 00000100:00100000:1.0:1787384546.574641:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 206 00000100:00100000:1.0:1787384546.574650:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+28:11929:x1874208182332672:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:1.0:1787384546.574676:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384546.574697:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953800/0x7ef423838fba3567 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce39ee expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384546.575171:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba356e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384546.575255:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba3552 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39e7 expref: 29 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384546.575267:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba356e lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384546.575300:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba3552 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39e7 expref: 29 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384546.575314:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba3552 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39e7 expref: 29 pid: 6521 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384546.575328:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d8530a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1874208203362048:192.168.203.45@tcp:104: 00000100:00100000:1.0:1787384546.575411:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f8749a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787384546.579385:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384546.579419:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d8530a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1874208203362048:192.168.203.45@tcp:104: 00010000:00010000:3.0:1787384546.579445:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba356e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384546.579477:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182332800 00000100:00100000:0.0:1787384546.579484:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182332800 00010000:00010000:0.0:1787384546.579519:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba3552 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39e7 expref: 30 pid: 6521 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384546.579558:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 92 00000100:00100000:0.0:1787384546.579568:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d8531f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+30:2415:x1874208182332800:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787384546.579581:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384546.579588:0:10399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba3552 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39e7 expref: 30 pid: 6521 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.579600:0:10399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba3552 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39e7 expref: 30 pid: 6521 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.579621:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba3552 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39e7 expref: 30 pid: 6521 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.579637:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c3a9d900) 00010000:00010000:0.0:1787384546.579642:0:10399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba356e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.579651:0:10399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba356e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.579773:0:10399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba356e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384546.580145:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384546.580204:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d8531f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+29:2415:x1874208182332800:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 636us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384546.580212:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 92 00010000:00010000:3.0:1787384546.580366:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba356e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384546.580374:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba356e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384546.580391:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787384546.580564:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953800/0x7ef423838fba3567 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39ee expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384546.580580:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba356e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39ee expref: 29 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384546.580588:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c3a9d900) 00010000:00010000:3.0:1787384546.580598:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787384546.580601:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3952400, rc 0) 00000100:00100000:3.0:1787384546.580641:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+29:11929:x1874208182332672:12345-192.168.203.45@tcp:101:bash.0 Request processed in 5992us (6195us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1787384546.580648:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 206 00000100:00100000:1.0:1787384546.583359:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384546.583423:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182332928 00000100:00100000:0.0:1787384546.583433:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182332928 00000100:00100000:0.0:1787384546.583518:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 207 00000100:00100000:0.0:1787384546.583529:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d8532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+29:11929:x1874208182332928:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:0.0:1787384546.583551:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384546.583570:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba357c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce39f5 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.583607:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba3583 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.583620:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba3583 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.583630:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba3583 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.583826:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140200/0x7ef423838fba357c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39f5 expref: 31 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.583845:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba3583 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39f5 expref: 30 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.583853:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c3a9d900) 00010000:00010000:0.0:1787384546.583856:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787384546.583866:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6140000, rc 0) 00000100:00100000:2.0:1787384546.584052:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d8532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+30:11929:x1874208182332928:12345-192.168.203.45@tcp:101:bash.0 Request processed in 524us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384546.584060:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 207 00000100:00100000:2.0:1787384546.586699:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384546.587121:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182333184 00000100:00100000:0.0:1787384546.587130:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182333184 00000100:00100000:0.0:1787384546.587222:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 208 00000100:00100000:0.0:1787384546.587232:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+30:11929:x1874208182333184:12345-192.168.203.45@tcp:36:bash.0 00010000:00010000:0.0:1787384546.587454:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba358a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.587466:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba358a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.587474:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba358a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787384546.587505:0:8195:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000004:00010000:0.0:1787384546.587519:0:8195:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006ecfe422 reply state 000000003ec1ec72 transno 4294967477 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba358a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.587528:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba358a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.587533:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c3a9d900) 00010000:00010000:0.0:1787384546.587535:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787384546.587537:0:8195:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787384546.587562:0:8195:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967477 00000100:00100000:0.0:1787384546.587650:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+34:11929:x1874208182333184:12345-192.168.203.45@tcp:36:bash.0 Request processed in 420us (959us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1787384546.587659:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 208 00000020:00080000:0.0:1787384546.587664:0:8195:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787384546.589756:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384546.589862:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182333312 00000100:00100000:3.0:1787384546.589879:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182333312 00000100:00100000:3.0:1787384546.589945:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 209 00000100:00100000:3.0:1787384546.589955:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+34:11929:x1874208182333312:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:3.0:1787384546.589974:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384546.589992:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba3591 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce39fc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384546.590052:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba3591 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39fc expref: 35 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384546.590066:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba3591 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39fc expref: 35 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384546.590084:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c3a9d900) 00010000:00010000:3.0:1787384546.590087:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787384546.590091:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2090c00, rc 0) 00000100:00100000:3.0:1787384546.590192:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+35:11929:x1874208182333312:12345-192.168.203.45@tcp:101:bash.0 Request processed in 238us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384546.590199:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 209 00000100:00100000:1.0:1787384546.595553:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384546.595622:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182333440 00000100:00100000:0.0:1787384546.595644:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182333440 00000100:00100000:0.0:1787384546.595689:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 66 00000100:00100000:0.0:1787384546.595695:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d8530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:11929:x1874208182333440:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:0.0:1787384546.595711:0:8890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384546.595726:0:8890:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b722f718/0x7ef423838fba3598 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3a03 expref: -99 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787384546.595747:0:8890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a8952e0, atime: 0x6a8952de, ctime: 0x6a8952e0, blocks: 0x8 00010000:00010000:0.0:1787384546.595764:0:8890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1787384546.595768:0:8890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384546.595773:0:8890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b722f718/0x7ef423838fba3598 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a03 expref: 8 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.595812:0:8890:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b722f718/0x7ef423838fba3598 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a03 expref: 8 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.595826:0:8890:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6140200, rc 0) 00000100:00100000:0.0:1787384546.595882:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d8530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+8:11929:x1874208182333440:12345-192.168.203.45@tcp:101:bash.0 Request processed in 187us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384546.595887:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 66 00000100:00100000:2.0:1787384546.599455:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384546.599565:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182333568 00000100:00100000:1.0:1787384546.599575:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182333568 00002000:00010000:1.0:1787384546.599630:0:8443:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:1.0:1787384546.599648:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98f8f91d8380 with x1874208182333568 ext(0->18446744073709551615) 00002000:00010000:1.0:1787384546.599660:0:8443:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98f8f91d8380. 00000100:00100000:1.0:1787384546.599694:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 5 00000100:00100000:1.0:1787384546.599704:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+8:2415:x1874208182333568:12345-192.168.203.45@tcp:10:bash.0 00002000:00010000:1.0:1787384546.600020:0:8443:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787384546.600024:0:8443:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1787384544 -> 1787384545 00002000:00010000:1.0:1787384546.600037:0:8443:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1787384542 -> 1787384542 00002000:00010000:1.0:1787384546.600040:0:8443:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1787384544 -> 1787384545 00002000:00010000:1.0:1787384546.600042:0:8443:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1787384546.600106:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+9:2415:x1874208182333568:12345-192.168.203.45@tcp:10:bash.0 Request processed in 402us (659us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1787384546.600114:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 5 00002000:00010000:1.0:1787384546.600118:0:8443:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:1.0:1787384546.600121:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98f8f91d8380 with x1874208182333568 ext(0->18446744073709551615) 00002000:00010000:1.0:1787384546.600125:0:8443:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98f8f91d8380. 00000100:00100000:3.0:1787384546.691361:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384546.692089:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182333696 00000100:00100000:2.0:1787384546.692099:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182333696 00000100:00100000:2.0:1787384546.692167:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 210 00000100:00100000:2.0:1787384546.692176:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+35:12411:x1874208182333696:12345-192.168.203.45@tcp:34:lfs.0 00010000:00010000:2.0:1787384546.692256:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba359f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384546.692272:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba359f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384546.692283:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba359f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384546.692297:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba35a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384546.692304:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba35a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384546.692310:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba35a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384546.692392:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba35ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384546.692401:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba35ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384546.692407:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba35ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787384546.692443:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba35ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384546.692453:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba359f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384546.692459:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba359f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384546.692478:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba359f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384546.692483:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965a200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384546.692488:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba359f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384546.692495:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba359f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384546.692507:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f8e8aa4100) 00010000:00010000:2.0:1787384546.692509:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384546.692513:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba359f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384546.692525:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba359f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384546.692536:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba35a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384546.692542:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba35a6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384546.692548:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba35a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384546.692553:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965a600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384546.692556:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba35a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384546.692561:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba35a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384546.692568:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f8e8aa5300) 00010000:00010000:2.0:1787384546.692570:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384546.692572:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba35a6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384546.692584:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba35a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384546.692597:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba35ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384546.692602:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba35ad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384546.692612:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba35ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384546.692624:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965b400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384546.692627:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba35ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384546.692633:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba35ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384546.692640:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c3a9d900) 00010000:00010000:2.0:1787384546.692643:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384546.692645:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba35ad lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384546.692651:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba35ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384546.692729:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+35:12411:x1874208182333696:12345-192.168.203.45@tcp:34:lfs.0 Request processed in 554us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384546.692737:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 210 00000100:00100000:2.0:1787384546.739847:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384546.739973:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182333952 00000100:00100000:0.0:1787384546.739983:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182333952 00000100:00100000:0.0:1787384546.740044:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 211 00000100:00100000:0.0:1787384546.740054:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+35:12414:x1874208182333952:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:0.0:1787384546.740075:0:8195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384546.740095:0:8195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141600/0x7ef423838fba35b4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3a0a expref: -99 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.740177:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba35bb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.740191:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba35bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.740201:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba35bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.740228:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba35c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.740235:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba35c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.740242:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba35c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.740350:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba35c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.740360:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba35c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.740367:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba35c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384546.740377:0:8195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787384546.740450:0:8195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba35bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.740458:0:8195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba35bb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.740472:0:8195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba35bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.740478:0:8195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384546.740482:0:8195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba35bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.740490:0:8195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba35bb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.740503:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f8e8aa4100) 00010000:00010000:0.0:1787384546.740506:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384546.740510:0:8195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba35bb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.740517:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba35bb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.740530:0:8195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba35c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.740537:0:8195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba35c2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.740544:0:8195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba35c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.740549:0:8195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6141800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384546.740552:0:8195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba35c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.740569:0:8195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba35c2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.740590:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f7c3a9db00) 00010000:00010000:0.0:1787384546.740593:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384546.740596:0:8195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba35c2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.740601:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba35c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.740641:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141600/0x7ef423838fba35b4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a0a expref: 38 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.740655:0:8195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba35c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a0a expref: 37 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.740662:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c3a9d900) 00010000:00010000:0.0:1787384546.740664:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787384546.740667:0:8195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6140e00, rc 0) 00000100:00100000:0.0:1787384546.740731:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+37:12414:x1874208182333952:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 677us (891us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1787384546.740739:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 211 00000100:00100000:1.0:1787384546.744051:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787384546.744075:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203362176:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787384546.744145:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384546.744665:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203362176 00000100:00100000:2.0:1787384546.744675:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203362176 00000100:00100000:2.0:1787384546.744742:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787384546.744751:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203362176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787384546.744772:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00080000:1.0:1787384546.744925:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787384546.745014:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203362176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 265us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384546.745039:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787384546.745129:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203362176:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787384546.748044:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203362304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787384546.748116:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384546.748201:0:13608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203362304 00000100:00100000:3.0:1787384546.748228:0:13608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203362304 00000100:00100000:3.0:1787384546.748278:0:13608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787384546.748286:0:13608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3654:x1874208203362304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787384546.748304:0:13608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:3.0:1787384546.756570:0:13608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3654:x1874208203362304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8272us (8441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384546.756597:0:13608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787384546.757595:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384546.757655:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182334080 00000100:00100000:0.0:1787384546.757665:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182334080 00000100:00100000:0.0:1787384546.757722:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 212 00000100:00100000:0.0:1787384546.757732:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+37:12414:x1874208182334080:12345-192.168.203.45@tcp:54:lfs.0 00010000:00010000:0.0:1787384546.757852:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba35d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.757868:0:14031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba356e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39ee expref: 37 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.757878:0:14031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba35d7 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.757925:0:14031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba356e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39ee expref: 37 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.757940:0:14031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba356e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39ee expref: 37 pid: 6522 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384546.757955:0:14031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9175180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14031:1874208203362432:192.168.203.45@tcp:104: 00000100:00100000:0.0:1787384546.758038:0:14031:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f87c9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787384546.758282:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203362304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787384546.764308:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384546.764841:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182334336 00000100:00100000:1.0:1787384546.764863:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182334336 00000100:00100000:1.0:1787384546.764923:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 52 00000100:00100000:1.0:1787384546.764933:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+38:6184:x1874208182334336:12345-192.168.203.45@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787384546.764949:0:14031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9175180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14031:1874208203362432:192.168.203.45@tcp:104: 00010000:00010000:0.0:1787384546.765039:0:14031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba35d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384546.765451:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+39:6184:x1874208182334336:12345-192.168.203.45@tcp:35:ldlm_bl.0 Request processed in 517us (1149us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1787384546.765460:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 52 00000100:00100000:0.0:1787384546.771520:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384546.774354:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182334464 00000100:00100000:2.0:1787384546.774370:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182334464 00010000:00010000:2.0:1787384546.774423:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba356e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39ee expref: 39 pid: 6522 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384546.774468:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 93 00000100:00100000:2.0:1787384546.774479:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9175180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+39:2415:x1874208182334464:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384546.774494:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384546.774501:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba356e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39ee expref: 39 pid: 6522 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384546.774515:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba356e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39ee expref: 39 pid: 6522 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384546.774535:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952400/0x7ef423838fba356e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39ee expref: 39 pid: 6522 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384546.774554:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c3a9d900) 00010000:00010000:2.0:1787384546.774558:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba35d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384546.774568:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba35d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384546.774574:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba35d7 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384546.775199:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384546.775274:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9175180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+38:2415:x1874208182334464:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 795us (3764us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384546.775282:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 93 00010000:00010000:0.0:1787384546.777473:0:14031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba35d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.777491:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba35d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.777544:0:14031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba35d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.777569:0:14031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba35d7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.777587:0:14031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba35d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.777594:0:14031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6141400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384546.777599:0:14031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba35d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.777606:0:14031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba35d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.777623:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c3a9d900) 00010000:00010000:0.0:1787384546.777626:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787384546.777631:0:14031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba35d7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.777636:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba35d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384546.777731:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+37:12414:x1874208182334080:12345-192.168.203.45@tcp:54:lfs.0 Request processed in 19985us (20125us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384546.777741:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 212 00000100:00100000:0.0:1787384546.781426:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384546.781490:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182334720 00000100:00100000:2.0:1787384546.781501:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182334720 00000100:00100000:2.0:1787384546.781556:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 53 00000100:00100000:2.0:1787384546.781566:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9174380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+37:12414:x1874208182334720:12345-192.168.203.45@tcp:35:lfs.0 00000100:00100000:2.0:1787384546.781846:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9174380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+38:12414:x1874208182334720:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 281us (430us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1787384546.781854:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 53 00000100:00100000:1.0:1787384546.917700:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384546.919010:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182334976 00000100:00100000:0.0:1787384546.919025:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182334976 00000100:00100000:0.0:1787384546.919107:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 213 00000100:00100000:0.0:1787384546.919118:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+38:12425:x1874208182334976:12345-192.168.203.45@tcp:101:cat.0 00010000:00010000:0.0:1787384546.919162:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384546.919185:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba35de lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3a11 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.919264:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba35e5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.919279:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba35e5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.919291:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba35e5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.919305:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba35ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.919312:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba35ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.919319:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba35ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.919427:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba35f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.919436:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba35f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.919442:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba35f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384546.919450:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:0.0:1787384546.919525:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba35e5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.919532:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba35e5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.919539:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba35e5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.919544:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6141800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384546.919548:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba35e5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.919555:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba35e5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.919566:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f8e8aa4100) 00010000:00010000:0.0:1787384546.919569:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384546.919573:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba35e5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.919579:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba35e5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.919591:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba35ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.919597:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba35ec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.919603:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba35ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.919608:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384546.919617:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba35ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.919624:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba35ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.919633:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f7c3a9db00) 00010000:00010000:0.0:1787384546.919635:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384546.919638:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba35ec lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.919643:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba35ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.919683:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba35de lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a11 expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.919696:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba35f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a11 expref: 40 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.919703:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c3a9d900) 00010000:00010000:0.0:1787384546.919705:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787384546.919708:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6141c00, rc 0) 00000100:00100000:0.0:1787384546.920047:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+40:12425:x1874208182334976:12345-192.168.203.45@tcp:101:cat.0 Request processed in 929us (2355us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1787384546.920064:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 213 00000100:00100000:0.0:1787384546.936532:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384546.936636:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182335232 00000100:00100000:3.0:1787384546.936646:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182335232 00000100:00100000:3.0:1787384546.936715:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 54 00000100:00100000:3.0:1787384546.936726:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+40:12425:x1874208182335232:12345-192.168.203.45@tcp:35:cat.0 00000100:00100000:3.0:1787384546.938315:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+41:12425:x1874208182335232:12345-192.168.203.45@tcp:35:cat.0 Request processed in 1584us (1786us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1787384546.938327:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 54 00000100:00100000:1.0:1787384546.986112:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384546.986907:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182335488 00000100:00100000:0.0:1787384546.986918:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182335488 00000100:00100000:0.0:1787384546.986989:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 214 00000100:00100000:0.0:1787384546.987012:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+41:12426:x1874208182335488:12345-192.168.203.45@tcp:36:rm.0 00010000:00010000:0.0:1787384546.987078:0:8195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1787384546.987104:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba3591 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39fc expref: 41 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.987125:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba35f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a11 expref: 40 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.987136:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba35c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a0a expref: 39 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.987146:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba3583 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39f5 expref: 38 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.987154:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c3a9d900) 00010000:00010000:0.0:1787384546.987158:0:8195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787384546.987178:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba3601 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.987190:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba3601 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.987199:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba3601 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.987222:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3608 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.987230:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3608 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.987244:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3608 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.987321:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba360f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.987329:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba360f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.987337:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba360f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787384546.987535:0:8195:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1787384546.987545:0:8195:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 442067765291ns, next at 443067762986ns, rc = 0 00010000:00010000:1.0:1787384546.999032:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba3616 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384546.999056:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba3616 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384546.999067:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba3616 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384546.999076:0:8195:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba3616 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384546.999081:0:8195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba3616 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384546.999086:0:8195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba3616 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384546.999107:0:8195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384546.999129:0:8195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba360f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384546.999134:0:8195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba360f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384546.999153:0:8195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba360f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384546.999159:0:8195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6141800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384546.999163:0:8195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba360f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384546.999170:0:8195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba360f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384546.999182:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c3a9d900) 00010000:00010000:1.0:1787384546.999185:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787384546.999188:0:8195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba360f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384546.999193:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141800/0x7ef423838fba360f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384546.999213:0:8195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba3601 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384546.999220:0:8195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba3601 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384546.999224:0:8195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba3601 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384546.999229:0:8195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6141400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384546.999232:0:8195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba3601 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384546.999248:0:8195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba3601 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384546.999258:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f8e8aa4100) 00010000:00010000:1.0:1787384546.999260:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384546.999263:0:8195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba3601 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384546.999269:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba3601 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787384546.999279:0:8195:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000046c2e203 reply state 00000000b61fae61 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3608 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384546.999289:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3608 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384546.999295:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f7c3a9db00) 00010000:00010000:1.0:1787384546.999297:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787384546.999300:0:8195:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787384546.999399:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+39:12426:x1874208182335488:12345-192.168.203.45@tcp:36:rm.0 Request processed in 12385us (13291us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1787384546.999408:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 214 00010000:00010000:0.0:1787384546.999600:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384546.999607:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba3616 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.999613:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3953c00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384546.999616:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba3616 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.999623:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba3616 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.999632:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c3a9d900) 00010000:00010000:0.0:1787384546.999635:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787384546.999638:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba3616 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.999644:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba3616 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384546.999661:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384546.999663:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384546.999665:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384547.080881:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384547.080982:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182335744 00000100:00100000:0.0:1787384547.080993:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182335744 00000100:00100000:0.0:1787384547.081064:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 215 00000100:00100000:0.0:1787384547.081073:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+39:12432:x1874208182335744:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:0.0:1787384547.081097:0:14031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384547.081117:0:14031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba361d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3a18 expref: -99 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.081219:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3624 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.081235:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3624 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.081246:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3624 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.081256:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba362b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.081262:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba362b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.081270:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba362b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787384547.081581:0:14031:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:0.0:1787384547.081733:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba3632 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.081742:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba3632 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.081749:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba3632 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.081825:0:14031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3624 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.081832:0:14031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3624 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.081839:0:14031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3624 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.081844:0:14031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140e00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384547.081848:0:14031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3624 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.081854:0:14031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3624 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.081866:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f8e8aa4100) 00010000:00010000:0.0:1787384547.081869:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384547.081873:0:14031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3624 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.081880:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3624 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787384547.081915:0:14031:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a7cde05e reply state 00000000b5ce35e7 transno 4294967485 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba362b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.081928:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba362b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.081935:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f7c3a9db00) 00010000:00010000:0.0:1787384547.081937:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787384547.081939:0:14031:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787384547.081969:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140000/0x7ef423838fba361d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a18 expref: 42 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.081983:0:14031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba3632 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a18 expref: 41 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.081990:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f7c3a9d000) 00010000:00010000:0.0:1787384547.081992:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787384547.081994:0:14031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6141200, rc 0) 00000100:00100000:0.0:1787384547.082055:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+42:12432:x1874208182335744:12345-192.168.203.45@tcp:101:bash.0 Request processed in 982us (1184us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1787384547.082064:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 215 00000100:00100000:3.0:1787384547.087020:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384547.087139:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182335872 00000100:00100000:0.0:1787384547.087150:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182335872 00000100:00100000:0.0:1787384547.087215:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 67 00000100:00100000:0.0:1787384547.087226:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:2413:x1874208182335872:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:0.0:1787384547.087242:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384547.087260:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cff0852/0x7ef423838fba3640 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3a1f expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787384547.087297:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384547.087315:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=442s v=(0 0) 00010000:00010000:0.0:1787384547.087319:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384547.087329:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cff0852/0x7ef423838fba3640 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a1f expref: 8 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.087349:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004cff0852/0x7ef423838fba3640 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a1f expref: 8 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.087362:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6140c00, rc 0) 00000100:00100000:0.0:1787384547.087424:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+8:2413:x1874208182335872:12345-192.168.203.45@tcp:101:bash.0 Request processed in 200us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384547.087431:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 67 00000100:00080000:1.0:1787384547.087630:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787384547.092766:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384547.092916:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182336000 00000100:00100000:0.0:1787384547.092926:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182336000 00000100:00100000:0.0:1787384547.092982:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 68 00000100:00100000:0.0:1787384547.092992:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4105880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+8:12432:x1874208182336000:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:0.0:1787384547.093011:0:8890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384547.093029:0:8890:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0a131ef/0x7ef423838fba3647 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3a26 expref: -99 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.093060:0:8890:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004cff0852/0x7ef423838fba3640 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a1f expref: 9 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.093088:0:8890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384547.093092:0:8890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384547.093098:0:8890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0a131ef/0x7ef423838fba3647 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a26 expref: 9 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.093133:0:8890:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004cff0852/0x7ef423838fba3640 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a1f expref: 9 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.093147:0:8890:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004cff0852/0x7ef423838fba3640 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a1f expref: 9 pid: 8438 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384547.093161:0:8890:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9177100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8890:1874208203362560:192.168.203.45@tcp:104: 00000100:00100000:0.0:1787384547.093266:0:8890:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d121e240 going to sleep for 11 seconds 00000100:00100000:2.0:1787384547.101028:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384547.101155:0:8890:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9177100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8890:1874208203362560:192.168.203.45@tcp:104: 00010000:00010000:0.0:1787384547.101191:0:8890:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f0a131ef/0x7ef423838fba3647 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a26 expref: 9 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.101211:0:8890:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6140000, rc 0) 00000100:00100000:0.0:1787384547.101272:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4105880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+9:12432:x1874208182336000:12345-192.168.203.45@tcp:101:bash.0 Request processed in 8281us (8515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384547.101282:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 68 00000100:00100000:3.0:1787384547.101567:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182336128 00000100:00100000:3.0:1787384547.101648:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182336128 00010000:00010000:3.0:1787384547.101682:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004cff0852/0x7ef423838fba3640 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a1f expref: 9 pid: 8438 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384547.101719:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 94 00000100:00100000:3.0:1787384547.101729:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b45850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+9:2415:x1874208182336128:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384547.101742:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384547.101762:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004cff0852/0x7ef423838fba3640 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a1f expref: 9 pid: 8438 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.102038:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004cff0852/0x7ef423838fba3640 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a1f expref: 9 pid: 8438 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.102063:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cff0852/0x7ef423838fba3640 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a1f expref: 9 pid: 8438 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.102077:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384547.102081:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384547.102089:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f0a131ef/0x7ef423838fba3647 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a26 expref: 8 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.102099:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0a131ef/0x7ef423838fba3647 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a26 expref: 8 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.104221:0:6508:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f0a131ef/0x7ef423838fba3647 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a26 expref: 8 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384547.104246:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91da680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6508:1874208203362688:192.168.203.45@tcp:105: 00000100:00100000:2.0:1787384547.104388:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2956f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787384547.110868:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384547.110996:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91da680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6508:1874208203362688:192.168.203.45@tcp:105: 00010000:00010000:1.0:1787384547.111022:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384547.111079:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b45850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+8:2415:x1874208182336128:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 9350us (10060us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384547.111106:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 94 00000100:00100000:0.0:1787384547.114460:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182336384 00000100:00100000:0.0:1787384547.114473:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182336384 00000100:00100000:0.0:1787384547.114545:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 55 00000100:00100000:0.0:1787384547.114570:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+42:12432:x1874208182336384:12345-192.168.203.45@tcp:35:bash.0 00000100:00100000:0.0:1787384547.114996:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+43:12432:x1874208182336384:12345-192.168.203.45@tcp:35:bash.0 Request processed in 427us (4137us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1787384547.115004:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 55 00010000:00010000:2.0:1787384547.255000:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384547.255008:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203362816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787384547.255095:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384547.255225:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787384547.255233:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203362944:0@lo:400:kworker.0 00000100:00100000:1.0:1787384547.255265:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384547.259054:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203362816 00000100:00100000:2.0:1787384547.259070:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203362816 00000100:00080000:1.0:1787384547.259144:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787384547.259160:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787384547.259171:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4106a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1874208203362816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787384547.259204:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384547.259292:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4106a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1874208203362816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (4196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384547.259314:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787384547.259339:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203362944 00000100:00100000:2.0:1787384547.259343:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203362944 00000100:00100000:2.0:1787384547.259371:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1787384547.259378:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3651:x1874208203362944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384547.259415:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3651:x1874208203362944:12345-0@lo:400:kworker.0 Request processed in 37us (4148us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384547.259421:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1787384547.259537:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203362944:0@lo:400:kworker.0 00000100:00100000:1.0:1787384547.259562:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203362816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787384547.260295:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203363072:0@lo:400:kworker.0 00000100:00100000:2.0:1787384547.260342:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384547.260374:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203363584:0@lo:400:kworker.0 00000100:00100000:2.0:1787384547.260400:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384547.260419:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4305880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203364096:0@lo:400:kworker.0 00000100:00100000:2.0:1787384547.260442:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384547.260462:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787384547.260468:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9175180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203363200:0@lo:400:kworker.0 00000100:00100000:2.0:1787384547.260536:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384547.260555:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4269500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203363712:0@lo:400:kworker.0 00000100:00100000:2.0:1787384547.260578:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384547.260594:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874208203364224:0@lo:400:kworker.0 00000100:00100000:2.0:1787384547.260615:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384547.260641:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203363200 00000100:00100000:2.0:1787384547.260645:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203363200 00000100:00100000:2.0:1787384547.260692:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787384547.260701:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203363200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384547.260755:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203363200:12345-0@lo:400:kworker.0 Request processed in 55us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384547.260762:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787384547.260840:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9175180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203363200:0@lo:400:kworker.0 00000100:00100000:2.0:1787384547.260864:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203363072 00000100:00100000:2.0:1787384547.260868:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203363072 00000100:00100000:2.0:1787384547.260886:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203363584 00000100:00100000:2.0:1787384547.260888:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203363584 00000100:00100000:2.0:1787384547.260916:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203364096 00000100:00100000:2.0:1787384547.260919:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203364096 00000100:00100000:2.0:1787384547.260930:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203363712 00000100:00100000:2.0:1787384547.260932:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203363712 00000100:00100000:2.0:1787384547.260942:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203364224 00000100:00100000:2.0:1787384547.260943:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203364224 00000100:00100000:2.0:1787384547.260955:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1787384547.260960:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f54fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203363072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384547.260995:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f54fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203363072:12345-0@lo:400:kworker.0 Request processed in 35us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384547.261002:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1787384547.261014:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1787384547.261020:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203363584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384547.261047:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203363584:12345-0@lo:400:kworker.0 Request processed in 27us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384547.261053:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1787384547.261063:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1787384547.261069:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874208203364096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384547.261095:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874208203364096:12345-0@lo:400:kworker.0 Request processed in 26us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384547.261107:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1787384547.261120:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1787384547.261126:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203363712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384547.261156:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203363712:12345-0@lo:400:kworker.0 Request processed in 30us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384547.261161:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1787384547.261173:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1787384547.261178:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874208203364224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384547.261202:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874208203364224:12345-0@lo:400:kworker.0 Request processed in 24us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384547.261208:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00010000:00080000:2.0:1787384547.261235:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4269500 x1874208203363712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384547.261245:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4269500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203363712:0@lo:400:kworker.0 00010000:00080000:2.0:1787384547.261254:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7e6b100 x1874208203364224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384547.261262:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874208203364224:0@lo:400:kworker.0 00000100:00100000:2.0:1787384547.261273:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203363072:0@lo:400:kworker.0 00000100:00100000:2.0:1787384547.261282:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203363584:0@lo:400:kworker.0 00000100:00100000:2.0:1787384547.261290:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4305880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203364096:0@lo:400:kworker.0 00000100:00080000:1.0:1787384547.261604:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787384547.261608:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384547.261621:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9146d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203363328:0@lo:400:kworker.0 00000100:00100000:1.0:1787384547.261654:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384547.261691:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203363840:0@lo:400:kworker.0 00000100:00100000:1.0:1787384547.261717:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384547.261735:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203364352:0@lo:400:kworker.0 00000100:00100000:1.0:1787384547.261754:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384547.261770:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787384547.261803:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9147480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203363456:0@lo:400:kworker.0 00000100:00100000:1.0:1787384547.261838:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384547.261855:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203363968:0@lo:400:kworker.0 00000100:00100000:1.0:1787384547.261876:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384547.261912:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203363456 00000100:00100000:1.0:1787384547.261916:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203363456 00000100:00100000:1.0:1787384547.261955:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787384547.261962:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203363456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384547.262000:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203363456:12345-0@lo:400:kworker.0 Request processed in 38us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384547.262006:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787384547.262024:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203363840 00000100:00100000:1.0:1787384547.262027:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203363840 00000100:00100000:1.0:1787384547.262046:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203364352 00000100:00100000:1.0:1787384547.262049:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203364352 00000100:00100000:1.0:1787384547.262068:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203363968 00000100:00100000:1.0:1787384547.262070:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203363968 00000100:00100000:1.0:1787384547.262084:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787384547.262090:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d8532300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203363840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384547.262119:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d8532300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203363840:12345-0@lo:400:kworker.0 Request processed in 29us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384547.262125:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787384547.262136:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787384547.262141:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d8531f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203364352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384547.262164:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d8531f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203364352:12345-0@lo:400:kworker.0 Request processed in 24us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384547.262169:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787384547.262179:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787384547.262184:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1874208203363968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384547.262209:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1874208203363968:12345-0@lo:400:kworker.0 Request processed in 25us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384547.262214:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:1.0:1787384547.262226:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787384547.262236:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787384547.262266:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9147480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203363456:0@lo:400:kworker.0 00000100:00100000:1.0:1787384547.262278:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203363968:0@lo:400:kworker.0 00000100:00100000:1.0:1787384547.262285:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203363840:0@lo:400:kworker.0 00000100:00100000:1.0:1787384547.262293:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203364352:0@lo:400:kworker.0 00000100:00100000:1.0:1787384547.262321:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203363328 00000100:00100000:1.0:1787384547.262323:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203363328 00000100:00100000:1.0:1787384547.262340:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1787384547.262346:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203363328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384547.262379:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203363328:12345-0@lo:400:kworker.0 Request processed in 33us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384547.262385:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1787384547.262409:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9146d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203363328:0@lo:400:kworker.0 00000100:00100000:3.0:1787384547.310755:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384547.312694:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182336512 00000100:00100000:1.0:1787384547.312706:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182336512 00000100:00100000:1.0:1787384547.312862:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 216 00000100:00100000:1.0:1787384547.312874:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+43:12448:x1874208182336512:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:1.0:1787384547.312909:0:8195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384547.312930:0:8195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952600/0x7ef423838fba364e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3a2d expref: -99 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384547.312991:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba3655 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384547.313005:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba3655 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384547.313046:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba3655 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384547.313096:0:8195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1787384547.313100:0:8195:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787384547.313118:0:8195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba3655 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384547.313141:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952600/0x7ef423838fba364e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a2d expref: 45 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384547.313158:0:8195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba3655 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a2d expref: 44 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384547.313166:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f8e8aa4100) 00010000:00010000:1.0:1787384547.313169:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787384547.313172:0:8195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3953c00, rc 0) 00000100:00100000:1.0:1787384547.313244:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+44:12448:x1874208182336512:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 373us (2499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384547.313251:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 216 00000100:00100000:1.0:1787384547.324556:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384547.324654:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182336768 00000100:00100000:0.0:1787384547.324664:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182336768 00000100:00100000:0.0:1787384547.324732:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 217 00000100:00100000:0.0:1787384547.324743:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+44:12448:x1874208182336768:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:0.0:1787384547.324764:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384547.324807:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba365c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3a34 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.324934:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba3663 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.324947:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba3663 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.324957:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba3663 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384547.324969:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787384547.325078:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba365c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a34 expref: 47 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.325096:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba3663 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a34 expref: 46 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.325121:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f7c3a9d000) 00010000:00010000:0.0:1787384547.325124:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787384547.325127:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6140800, rc 0) 00000100:00100000:0.0:1787384547.325184:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+46:12448:x1874208182336768:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 443us (637us total) trans 4294967487 rc 0/0 00000100:00100000:0.0:1787384547.325192:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 217 00000100:00100000:3.0:1787384547.331494:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384547.331614:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182337024 00000100:00100000:0.0:1787384547.331623:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182337024 00000100:00100000:0.0:1787384547.331725:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 218 00000100:00100000:0.0:1787384547.331735:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+46:12448:x1874208182337024:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:0.0:1787384547.331759:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384547.331794:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141000/0x7ef423838fba3671 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3a3b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.331912:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba3678 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.331927:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba3678 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.331939:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba3678 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384547.331951:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787384547.332057:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141000/0x7ef423838fba3671 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a3b expref: 49 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.332095:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba3678 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a3b expref: 48 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.332103:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f7c3a9d000) 00010000:00010000:0.0:1787384547.332106:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787384547.332110:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6141e00, rc 0) 00000100:00100000:0.0:1787384547.332178:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+48:12448:x1874208182337024:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 445us (693us total) trans 4294967488 rc 0/0 00000100:00100000:0.0:1787384547.332186:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 218 00000100:00100000:1.0:1787384547.337331:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384547.337611:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182337152 00000100:00100000:3.0:1787384547.337620:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182337152 00000100:00100000:3.0:1787384547.337682:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 17 00000100:00100000:3.0:1787384547.337693:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+48:2416:x1874208182337152:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384547.337709:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384547.337732:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba3663 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a34 expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.337750:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f7c3a9d000) 00010000:00010000:3.0:1787384547.337978:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384547.338041:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+47:2416:x1874208182337152:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 349us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384547.338049:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 17 00000100:00100000:1.0:1787384547.346397:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384547.346490:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182337280 00000100:00100000:2.0:1787384547.346500:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182337280 00000100:00100000:2.0:1787384547.346571:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 69 00000100:00100000:2.0:1787384547.346581:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+8:2415:x1874208182337280:12345-192.168.203.45@tcp:1:lfs.0 00010000:00010000:2.0:1787384547.346627:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a34b8689/0x7ef423838fba3686 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.346647:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f0a131ef/0x7ef423838fba3647 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a26 expref: 8 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.346656:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384547.346661:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787384547.346665:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a34b8689/0x7ef423838fba3686 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.346701:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f0a131ef/0x7ef423838fba3647 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a26 expref: 8 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.346716:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f0a131ef/0x7ef423838fba3647 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a26 expref: 8 pid: 8890 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384547.346731:0:8435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4305880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874208203364480:192.168.203.45@tcp:104: 00000100:00100000:2.0:1787384547.346859:0:8435:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2956000 going to sleep for 11 seconds 00000100:00100000:2.0:1787384547.349350:0:8435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4305880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1874208203364480:192.168.203.45@tcp:104: 00010000:00010000:2.0:1787384547.349380:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a34b8689/0x7ef423838fba3686 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384547.350904:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384547.351125:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182337408 00000100:00100000:3.0:1787384547.351134:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182337408 00002000:00100000:3.0:1787384547.351175:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff98f8d9146d80 x1874208182337408/t0(0) o4->55e96ad5-fd9d-44d4-856e-5db0c40b1329@192.168.203.45@tcp:578/0 lens 504/0 e 0 to 0 dl 1787384558 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787384547.351187:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98f8d9146d80 with x1874208182337408 ext(0->8) 00010000:00010000:3.0:1787384547.351194:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f0a131ef/0x7ef423838fba3647 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a26 expref: 9 pid: 8890 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.351209:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f0a131ef/0x7ef423838fba3647 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a26 expref: 9 pid: 8890 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787384547.351217:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98f8d9146d80 00000100:00100000:3.0:1787384547.351248:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 3 00000100:00100000:3.0:1787384547.351256:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+9:2416:x1874208182337408:12345-192.168.203.45@tcp:4:lfs.0 00000100:00100000:3.0:1787384547.352142:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+11:2416:x1874208182337408:12345-192.168.203.45@tcp:4:lfs.0 Request processed in 881us (1247us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787384547.352154:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 3 00002000:00100000:3.0:1787384547.352162:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff98f8d9146d80 x1874208182337408/t4294967309(0) o4->55e96ad5-fd9d-44d4-856e-5db0c40b1329@192.168.203.45@tcp:578/0 lens 504/448 e 0 to 0 dl 1787384558 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787384547.352171:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98f8d9146d80 with x1874208182337408 ext(0->8) 00010000:00010000:3.0:1787384547.352179:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f0a131ef/0x7ef423838fba3647 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a26 expref: 11 pid: 8890 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.352203:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f0a131ef/0x7ef423838fba3647 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a26 expref: 11 pid: 8890 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787384547.352211:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff98f8d9146d80 00000100:00100000:1.0:1787384547.358496:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384547.358580:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182337536 00000100:00100000:2.0:1787384547.358603:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182337536 00010000:00010000:2.0:1787384547.358641:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f0a131ef/0x7ef423838fba3647 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a26 expref: 11 pid: 8890 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384547.358690:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 95 00000100:00100000:2.0:1787384547.358701:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9147480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+11:2415:x1874208182337536:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384547.358717:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787384547.358734:0:6509:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787384547.358737:0:6509:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787384546 00002000:00010000:2.0:1787384547.358740:0:6509:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787384546 00002000:00010000:2.0:1787384547.358742:0:6509:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1787384546 00002000:00010000:2.0:1787384547.358744:0:6509:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1787384547.358751:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f0a131ef/0x7ef423838fba3647 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a26 expref: 11 pid: 8890 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.358765:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f0a131ef/0x7ef423838fba3647 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a26 expref: 11 pid: 8890 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.358840:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0a131ef/0x7ef423838fba3647 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a26 expref: 11 pid: 8890 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.358857:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787384547.358861:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787384547.358867:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a34b8689/0x7ef423838fba3686 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.358876:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a34b8689/0x7ef423838fba3686 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.358920:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384547.358976:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9147480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+10:2415:x1874208182337536:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 277us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384547.358985:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 95 00010000:00010000:1.0:1787384547.359802:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a34b8689/0x7ef423838fba3686 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384547.359838:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a34b8689/0x7ef423838fba3686 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384547.359863:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a34b8689/0x7ef423838fba3686 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384547.359871:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a34b8689/0x7ef423838fba3686 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384547.359879:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a34b8689/0x7ef423838fba3686 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384547.359886:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965a600 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384547.359890:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a34b8689/0x7ef423838fba3686 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384547.359908:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a34b8689/0x7ef423838fba3686 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384547.359924:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a34b8689/0x7ef423838fba3686 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384547.359932:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a34b8689/0x7ef423838fba3686 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384547.360017:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+9:2415:x1874208182337280:12345-192.168.203.45@tcp:1:lfs.0 Request processed in 13436us (13629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384547.360034:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 69 00000100:00100000:1.0:1787384547.367677:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384547.367762:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182337792 00000100:00100000:0.0:1787384547.367816:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182337792 00000100:00100000:0.0:1787384547.367871:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 56 00000100:00100000:0.0:1787384547.367881:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9505c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+47:12448:x1874208182337792:12345-192.168.203.45@tcp:35:lfs.0 00000004:00010000:0.0:1787384547.367949:0:6524:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba3678 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a3b expref: 47 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787384547.368154:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1787384547.368188:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:2.0:1787384547.368489:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00010000:00010000:2.0:1787384547.368525:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba368d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.368539:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba3632 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a18 expref: 51 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.368548:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba368d lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.368592:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba3632 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a18 expref: 51 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.368606:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba3632 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a18 expref: 51 pid: 14031 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384547.368620:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4305880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1874208203364608:192.168.203.45@tcp:104: 00000100:00100000:2.0:1787384547.368745:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2956000 going to sleep for 11 seconds 00000100:00100000:3.0:1787384547.372736:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384547.372839:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182337920 00000100:00100000:1.0:1787384547.372849:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182337920 00010000:00010000:1.0:1787384547.372887:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba3632 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a18 expref: 52 pid: 14031 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384547.372943:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 96 00000100:00100000:1.0:1787384547.372953:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+52:2416:x1874208182337920:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384547.372968:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384547.372974:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba3632 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a18 expref: 52 pid: 14031 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384547.372984:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4305880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1874208203364608:192.168.203.45@tcp:104: 00010000:00010000:1.0:1787384547.372986:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba3632 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a18 expref: 52 pid: 14031 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384547.373004:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba3632 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a18 expref: 52 pid: 14031 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.373008:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba368d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384547.373018:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f7c3a9d000) 00010000:00010000:1.0:1787384547.373023:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba368d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384547.373032:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba368d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384547.373062:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba368d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384547.373090:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787384547.373137:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba368d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384547.373143:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+51:2416:x1874208182337920:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 192us (416us total) trans 0 rc 0/0 00010000:00010000:0.0:1787384547.373145:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba368d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384547.373151:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 96 00000001:00080000:0.0:1787384547.373253:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000001:00080000:0.0:1787384547.373365:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:0.0:1787384547.373447:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e68380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1874208203364736:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787384547.373497:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384547.373527:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d121e240 going to sleep for 11 seconds 00000100:00100000:1.0:1787384547.373548:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203364736 00000100:00100000:1.0:1787384547.373553:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203364736 00000100:00100000:1.0:1787384547.373663:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787384547.373670:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6524:x1874208203364736:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787384547.373756:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6524:x1874208203364736:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 86us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384547.373763:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787384547.374144:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e68380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1874208203364736:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787384547.374270:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00000100:00100000:3.0:1787384547.374317:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35daa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1874208203364864:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787384547.374348:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384547.374372:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d829a300 going to sleep for 11 seconds 00000100:00100000:1.0:1787384547.374421:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203364864 00000100:00100000:1.0:1787384547.374426:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203364864 00000100:00100000:1.0:1787384547.374461:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787384547.374468:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6524:x1874208203364864:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787384547.374671:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6524:x1874208203364864:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 203us (321us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787384547.374679:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787384547.375333:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35daa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1874208203364864:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787384547.375385:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:3.0:1787384547.375424:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba368d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.375434:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba368d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.375441:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba368d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.375447:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965a200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384547.375452:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba368d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.375459:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba368d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.375486:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f7c3a9d000) 00010000:00010000:3.0:1787384547.375488:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787384547.375493:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba368d lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.375499:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba368d lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787384547.375597:0:6524:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787384547.375655:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1787384547.375973:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 442456193240ns, next at 443456190455ns, rc = 0 00000001:00080000:3.0:1787384547.375981:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:3.0:1787384547.376010:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f7c3a9d000) 00010000:00010000:3.0:1787384547.376014:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787384547.376083:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba3678 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a3b expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384547.376193:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9505c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+54:12448:x1874208182337792:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 8312us (8533us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1787384547.376203:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 56 00000020:00080000:3.0:1787384547.376208:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787384547.381096:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384547.381188:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182338048 00000100:00100000:1.0:1787384547.381198:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182338048 00000100:00100000:1.0:1787384547.381254:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 219 00000100:00100000:1.0:1787384547.381263:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+54:12448:x1874208182338048:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:1.0:1787384547.381286:0:8195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384547.381324:0:8195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba3694 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3a42 expref: -99 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384547.381379:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba3694 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a42 expref: 55 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384547.381392:0:8195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba3694 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a42 expref: 55 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384547.381410:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f8edc2e700) 00010000:00010000:1.0:1787384547.381414:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787384547.381417:0:8195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3952c00, rc 0) 00000100:00100000:1.0:1787384547.381474:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+55:12448:x1874208182338048:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 211us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384547.381481:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 219 00000100:00100000:1.0:1787384547.393249:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384547.393341:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182338304 00000100:00100000:3.0:1787384547.393351:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182338304 00000100:00100000:3.0:1787384547.393415:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 57 00000100:00100000:3.0:1787384547.393426:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+55:12448:x1874208182338304:12345-192.168.203.45@tcp:35:lfs.0 00000100:00100000:3.0:1787384547.393658:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+56:12448:x1874208182338304:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 233us (418us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1787384547.393680:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 57 00000100:00100000:3.0:1787384547.487985:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384547.488151:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182338432 00000100:00100000:2.0:1787384547.488174:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182338432 00000100:00100000:2.0:1787384547.488225:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 220 00000100:00100000:2.0:1787384547.488234:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c80fa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+56:12458:x1874208182338432:12345-192.168.203.45@tcp:34:lfs.0 00010000:00010000:2.0:1787384547.488313:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba369b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.488330:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba369b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.488342:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba369b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.488352:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba36a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.488359:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba36a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.488365:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba36a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.488431:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba36a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.488440:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba36a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.488447:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba36a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787384547.488493:0:14031:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba36a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.488517:0:14031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba369b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.488523:0:14031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba369b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.488529:0:14031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba369b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.488535:0:14031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965ac00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384547.488538:0:14031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba369b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.488544:0:14031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba369b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.488554:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f8e8aa4100) 00010000:00010000:2.0:1787384547.488557:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384547.488573:0:14031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba369b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.488579:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba369b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.488591:0:14031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba36a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.488596:0:14031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba36a2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.488601:0:14031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba36a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.488611:0:14031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965be00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384547.488614:0:14031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba36a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.488619:0:14031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba36a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.488627:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f7c3a9db00) 00010000:00010000:2.0:1787384547.488629:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384547.488631:0:14031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba36a2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.488637:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba36a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.488645:0:14031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba36a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.488650:0:14031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba36a9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.488656:0:14031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba36a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.488660:0:14031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965a400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384547.488662:0:14031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba36a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.488669:0:14031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba36a9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.488687:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f8edc2e700) 00010000:00010000:2.0:1787384547.488689:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384547.488692:0:14031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba36a9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.488697:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba36a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384547.488869:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c80fa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+56:12458:x1874208182338432:12345-192.168.203.45@tcp:34:lfs.0 Request processed in 541us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384547.488880:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 220 00000100:00100000:1.0:1787384547.545735:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384547.545962:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182338688 00000100:00100000:0.0:1787384547.545971:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182338688 00000100:00100000:0.0:1787384547.546036:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 221 00000100:00100000:0.0:1787384547.546046:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+56:12461:x1874208182338688:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:0.0:1787384547.546074:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384547.546093:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141000/0x7ef423838fba36b0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3a49 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.546162:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba36b7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.546176:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba36b7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.546186:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba36b7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.546197:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba36be lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.546204:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba36be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.546216:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba36be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.546320:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba36c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.546348:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba36c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.546355:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba36c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384547.546366:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787384547.546442:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba36b7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.546450:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba36b7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.546457:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba36b7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.546463:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140e00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384547.546467:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba36b7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.546474:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba36b7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.546485:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f8e8aa4100) 00010000:00010000:0.0:1787384547.546489:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384547.546494:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba36b7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.546499:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba36b7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.546512:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba36be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.546525:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba36be lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.546531:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba36be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.546536:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6141e00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384547.546540:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba36be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.546546:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba36be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.546555:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f7c3a9db00) 00010000:00010000:0.0:1787384547.546557:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384547.546560:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba36be lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.546566:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba36be lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.546617:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141000/0x7ef423838fba36b0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a49 expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.546631:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba36c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a49 expref: 58 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.546639:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f8edc2e700) 00010000:00010000:0.0:1787384547.546642:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787384547.546650:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6141200, rc 0) 00000100:00100000:0.0:1787384547.548236:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+58:12461:x1874208182338688:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 2184us (2505us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1787384547.548247:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 221 00000100:00100000:1.0:1787384547.559669:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384547.559827:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182338816 00000100:00100000:0.0:1787384547.559838:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182338816 00000100:00100000:0.0:1787384547.559906:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 222 00000100:00100000:0.0:1787384547.559917:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+58:12461:x1874208182338816:12345-192.168.203.45@tcp:54:lfs.0 00010000:00010000:0.0:1787384547.559985:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141000/0x7ef423838fba36d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.560002:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141000/0x7ef423838fba36d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.560013:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141000/0x7ef423838fba36d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.560065:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141000/0x7ef423838fba36d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.560073:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141000/0x7ef423838fba36d3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.560080:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141000/0x7ef423838fba36d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.560086:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6141000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384547.560090:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141000/0x7ef423838fba36d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.560097:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141000/0x7ef423838fba36d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.560123:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f8edc2e700) 00010000:00010000:0.0:1787384547.560126:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787384547.560131:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141000/0x7ef423838fba36d3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.560136:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141000/0x7ef423838fba36d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384547.560227:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+58:12461:x1874208182338816:12345-192.168.203.45@tcp:54:lfs.0 Request processed in 310us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384547.560235:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 222 00000100:00100000:3.0:1787384547.565073:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384547.565150:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182339072 00000100:00100000:2.0:1787384547.565160:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182339072 00000100:00100000:2.0:1787384547.565219:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 58 00000100:00100000:2.0:1787384547.565229:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+58:12461:x1874208182339072:12345-192.168.203.45@tcp:35:lfs.0 00000100:00100000:2.0:1787384547.565498:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+59:12461:x1874208182339072:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 270us (435us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1787384547.565507:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 58 00000100:00100000:1.0:1787384547.661035:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384547.661200:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182339328 00000100:00100000:2.0:1787384547.661210:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182339328 00000100:00100000:2.0:1787384547.661272:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 223 00000100:00100000:2.0:1787384547.661282:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+59:12471:x1874208182339328:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:2.0:1787384547.661306:0:14031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384547.661309:0:14031:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787384547.661335:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953c00/0x7ef423838fba3655 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a2d expref: 59 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.661373:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f8e8aa4100) 00010000:00010000:2.0:1787384547.661379:0:14031:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787384547.661394:0:14031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba36da lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3a50 expref: -99 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.661497:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba36e1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.661511:0:14031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba36c5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a49 expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.661519:0:14031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba36e1 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.661546:0:14031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba36c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a49 expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.661573:0:14031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba36c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a49 expref: 59 pid: 6522 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384547.661588:0:14031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4307480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14031:1874208203364992:192.168.203.45@tcp:104: 00000100:00100000:2.0:1787384547.661693:0:14031:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2956240 going to sleep for 11 seconds 00000100:00100000:2.0:1787384547.664838:0:14031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4307480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14031:1874208203364992:192.168.203.45@tcp:104: 00010000:00010000:2.0:1787384547.664868:0:14031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba36e1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384547.665281:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384547.665415:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182339456 00000100:00100000:3.0:1787384547.665422:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182339456 00010000:00010000:3.0:1787384547.665457:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba36c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a49 expref: 60 pid: 6522 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384547.665522:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 97 00000100:00100000:3.0:1787384547.665532:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb124e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+60:2416:x1874208182339456:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384547.665546:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384547.665552:0:10399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba36c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a49 expref: 60 pid: 6522 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.665574:0:10399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba36c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a49 expref: 60 pid: 6522 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.665594:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141200/0x7ef423838fba36c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a49 expref: 60 pid: 6522 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.665610:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f8edc2e700) 00010000:00010000:3.0:1787384547.665615:0:10399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba36e1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.665625:0:10399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba36e1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.665651:0:10399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba36e1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.665681:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384547.665738:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb124e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+59:2416:x1874208182339456:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 207us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384547.665745:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 97 00010000:00010000:0.0:1787384547.665813:0:14031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba36e1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.665821:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba36e1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384547.665840:0:14031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787384547.665972:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba36da lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a50 expref: 60 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.665986:0:14031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba36e1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a50 expref: 59 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.665992:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f8edc2e700) 00010000:00010000:0.0:1787384547.665995:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787384547.665997:0:14031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965be00, rc 0) 00000100:00100000:0.0:1787384547.666021:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+59:12471:x1874208182339328:12345-192.168.203.45@tcp:101:bash.0 Request processed in 4742us (5007us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1787384547.666038:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 223 00000100:00100000:1.0:1787384547.670137:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384547.670234:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182339584 00000100:00100000:3.0:1787384547.670244:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182339584 00000100:00100000:3.0:1787384547.670325:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 224 00000100:00100000:3.0:1787384547.670335:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+59:12471:x1874208182339584:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:3.0:1787384547.670357:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384547.670375:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba36ef lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3a57 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.670404:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba36f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.670416:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba36f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.670427:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba36f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.670533:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba36ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a57 expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.670551:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba36f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a57 expref: 60 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.670579:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f8edc2e700) 00010000:00010000:3.0:1787384547.670582:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787384547.670586:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2091800, rc 0) 00000100:00100000:3.0:1787384547.670647:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+60:12471:x1874208182339584:12345-192.168.203.45@tcp:101:bash.0 Request processed in 312us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384547.670654:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 224 00000100:00100000:1.0:1787384547.674049:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384547.674232:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182339840 00000100:00100000:3.0:1787384547.674240:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182339840 00000100:00100000:3.0:1787384547.674301:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 225 00000100:00100000:3.0:1787384547.674312:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+60:12471:x1874208182339840:12345-192.168.203.45@tcp:36:bash.0 00010000:00010000:3.0:1787384547.674520:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba36fd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.674535:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba36fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.674545:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba36fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787384547.674596:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967502 00000004:00010000:3.0:1787384547.674616:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d9e5907d reply state 00000000818c18b9 transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba36fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.674628:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba36fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.674636:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f8edc2e700) 00010000:00010000:3.0:1787384547.674639:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787384547.674655:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787384547.674751:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+63:12471:x1874208182339840:12345-192.168.203.45@tcp:36:bash.0 Request processed in 439us (708us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1787384547.674758:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 225 00000020:00080000:3.0:1787384547.674763:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787384547.682305:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384547.682453:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182339968 00000100:00100000:0.0:1787384547.682512:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182339968 00000100:00100000:0.0:1787384547.682666:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 226 00000100:00100000:0.0:1787384547.682678:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+63:12471:x1874208182339968:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:0.0:1787384547.682701:0:14031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384547.682721:0:14031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141000/0x7ef423838fba3704 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3a5e expref: -99 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.682834:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba370b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.682850:0:14031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba36e1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a50 expref: 64 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.682859:0:14031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba370b lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.682901:0:14031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba36e1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a50 expref: 64 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.682915:0:14031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba36e1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a50 expref: 64 pid: 14031 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384547.682929:0:14031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e6aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14031:1874208203365120:192.168.203.45@tcp:104: 00000100:00100000:0.0:1787384547.683027:0:14031:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c6163a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787384547.686536:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384547.686690:0:14031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e6aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14031:1874208203365120:192.168.203.45@tcp:104: 00010000:00010000:0.0:1787384547.686733:0:14031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba370b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384547.687008:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182340096 00000100:00100000:3.0:1787384547.687027:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182340096 00010000:00010000:3.0:1787384547.687065:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba36e1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a50 expref: 65 pid: 14031 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384547.687108:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 98 00000100:00100000:3.0:1787384547.687118:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4307480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+65:2416:x1874208182340096:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384547.687132:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384547.687139:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba36e1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a50 expref: 65 pid: 14031 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.687152:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba36e1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a50 expref: 65 pid: 14031 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.687176:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba36e1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a50 expref: 65 pid: 14031 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.687192:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f8edc2e700) 00010000:00010000:3.0:1787384547.687197:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba370b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.687207:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba370b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.687226:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba370b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.687257:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384547.687316:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4307480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+64:2416:x1874208182340096:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 199us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384547.687325:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 98 00010000:00010000:0.0:1787384547.687439:0:14031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba370b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.687446:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba370b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384547.687498:0:14031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787384547.687503:0:14031:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787384547.687523:0:14031:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba370b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.687553:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141000/0x7ef423838fba3704 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a5e expref: 64 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.687567:0:14031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba370b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a5e expref: 63 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.687574:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f8edc2e700) 00010000:00010000:0.0:1787384547.687576:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787384547.687579:0:14031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6141e00, rc 0) 00000100:00100000:0.0:1787384547.687603:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+63:12471:x1874208182339968:12345-192.168.203.45@tcp:101:bash.0 Request processed in 4929us (5308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384547.687609:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 226 00000100:00100000:3.0:1787384547.692631:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384547.693032:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182340352 00000100:00100000:2.0:1787384547.693042:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182340352 00000100:00100000:2.0:1787384547.693101:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 59 00000100:00100000:2.0:1787384547.693111:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+63:12471:x1874208182340352:12345-192.168.203.45@tcp:35:bash.0 00000100:00100000:2.0:1787384547.693335:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+64:12471:x1874208182340352:12345-192.168.203.45@tcp:35:bash.0 Request processed in 225us (712us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1787384547.693343:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 59 00000100:00100000:2.0:1787384547.757285:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384547.757387:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182340480 00000100:00100000:3.0:1787384547.757398:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182340480 00000100:00100000:3.0:1787384547.757463:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 227 00000100:00100000:3.0:1787384547.757474:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+64:12477:x1874208182340480:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:3.0:1787384547.757500:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384547.757522:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba3712 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3a65 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.757590:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba3719 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.757605:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba3719 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.757618:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba3719 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384547.757666:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1787384547.757670:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787384547.757689:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba3719 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.757735:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba3712 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a65 expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.757755:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba3719 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a65 expref: 65 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.757765:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f8e8aa4100) 00010000:00010000:3.0:1787384547.757768:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787384547.757771:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2090c00, rc 0) 00000100:00100000:3.0:1787384547.758062:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+65:12477:x1874208182340480:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 588us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384547.758071:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 227 00000100:00100000:1.0:1787384547.767259:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787384547.767286:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203365248:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787384547.767352:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384547.767465:0:13608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203365248 00000100:00100000:2.0:1787384547.767472:0:13608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203365248 00000100:00100000:2.0:1787384547.767522:0:13608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787384547.767530:0:13608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203365248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787384547.767552:0:13608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384547.767606:0:13608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203365248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384547.767614:0:13608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787384547.768028:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203365248:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787384547.770835:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384547.770987:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182340608 00000100:00100000:2.0:1787384547.770996:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182340608 00000100:00100000:2.0:1787384547.771168:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 228 00000100:00100000:2.0:1787384547.771179:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+65:12477:x1874208182340608:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:2.0:1787384547.771197:0:8195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384547.771216:0:8195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba3720 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3a6c expref: -99 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.771277:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3727 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.771301:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3727 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.771311:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3727 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.771323:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba372e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.771330:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba372e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.771336:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba372e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.771401:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba3735 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.771408:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba3735 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.771414:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba3735 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384547.771453:0:8195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787384547.771458:0:8195:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787384547.771476:0:8195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba3735 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.771487:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba3735 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.771507:0:8195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3727 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.771514:0:8195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3727 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.771520:0:8195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3727 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.771526:0:8195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965be00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384547.771530:0:8195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3727 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.771538:0:8195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3727 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.771550:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f8e8aa4100) 00010000:00010000:2.0:1787384547.771553:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384547.771558:0:8195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3727 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.771564:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3727 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.771576:0:8195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba372e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.771582:0:8195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba372e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.771588:0:8195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba372e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.771597:0:8195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965ba00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384547.771600:0:8195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba372e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.771606:0:8195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba372e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.771614:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f7c3a9db00) 00010000:00010000:2.0:1787384547.771617:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384547.771620:0:8195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba372e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.771625:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba372e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.771648:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba3720 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a6c expref: 67 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.772354:0:8195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba3735 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a6c expref: 66 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.772365:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f8edc2e700) 00010000:00010000:2.0:1787384547.772367:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787384547.772370:0:8195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965ac00, rc 0) 00000100:00100000:2.0:1787384547.772439:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+66:12477:x1874208182340608:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 1263us (1665us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384547.772448:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 228 00000100:00100000:1.0:1787384547.781022:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384547.781308:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182340864 00000100:00100000:0.0:1787384547.781319:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182340864 00000100:00100000:0.0:1787384547.781381:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 229 00000100:00100000:0.0:1787384547.781391:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+66:12477:x1874208182340864:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:0.0:1787384547.781425:0:14031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384547.781444:0:14031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141000/0x7ef423838fba373c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3a73 expref: -99 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.781548:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3743 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.781563:0:14031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba370b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a5e expref: 67 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.781571:0:14031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba3735 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a6c expref: 67 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.781579:0:14031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3743 lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.781611:0:14031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba3735 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a6c expref: 67 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.781624:0:14031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba3735 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a6c expref: 67 pid: 8195 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384547.781637:0:14031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e69f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14031:1874208203365376:192.168.203.45@tcp:104: 00010000:00010000:0.0:1787384547.781828:0:14031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba370b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a5e expref: 67 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.781839:0:14031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba370b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a5e expref: 67 pid: 14031 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384547.781865:0:14031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e69180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14031:1874208203365504:192.168.203.45@tcp:104: 00000100:00100000:0.0:1787384547.788745:0:14031:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c6163a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787384547.790691:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384547.791026:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182340992 00000100:00100000:2.0:1787384547.791061:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182340992 00010000:00010000:2.0:1787384547.791099:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba3735 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a6c expref: 68 pid: 8195 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384547.791136:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 99 00000100:00100000:2.0:1787384547.791146:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb127b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+68:2415:x1874208182340992:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384547.791160:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384547.791167:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba3735 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a6c expref: 68 pid: 8195 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.791180:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba3735 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a6c expref: 68 pid: 8195 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.791202:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f8edc2e700) 00010000:00010000:2.0:1787384547.791208:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3743 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.791216:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3743 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.791223:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384547.791287:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb127b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+68:2415:x1874208182340992:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 142us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384547.791295:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 99 00000100:00100000:2.0:1787384547.797267:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00010000:00010000:0.0:1787384547.797438:0:14031:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.45@tcp) returned -22 from blocking AST (req@000000007d94cbb6 x1874208203365376) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba3735 lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a6c expref: 67 pid: 8195 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.797463:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ac00/0x7ef423838fba3735 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a6c expref: 67 pid: 8195 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384547.797479:0:14031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e69f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14031:1874208203365376:192.168.203.45@tcp:104: 00000100:00100000:0.0:1787384547.797493:0:14031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e69180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14031:1874208203365504:192.168.203.45@tcp:104: 00010000:00010000:0.0:1787384547.797516:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f8edc2e700) 00010000:00010000:0.0:1787384547.797522:0:14031:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3743 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.797531:0:14031:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3743 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.797539:0:14031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3743 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384547.799565:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182341120 00000100:00100000:3.0:1787384547.799580:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182341120 00010000:00010000:3.0:1787384547.799625:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba370b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a5e expref: 67 pid: 14031 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384547.799681:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 100 00000100:00100000:3.0:1787384547.799692:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b47850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+67:2416:x1874208182341120:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384547.799707:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384547.799714:0:10399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba370b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a5e expref: 67 pid: 14031 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.799727:0:10399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba370b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a5e expref: 67 pid: 14031 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.799766:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141e00/0x7ef423838fba370b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a5e expref: 67 pid: 14031 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.799812:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f8edc2e700) 00010000:00010000:3.0:1787384547.799818:0:10399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3743 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.799828:0:10399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3743 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.799836:0:10399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3743 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.799865:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787384547.799878:0:14031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3743 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.799889:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3743 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384547.799930:0:14031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787384547.800058:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141000/0x7ef423838fba373c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a73 expref: 68 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.800073:0:14031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3743 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a73 expref: 67 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384547.800081:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f8edc2e700) 00010000:00010000:0.0:1787384547.800084:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787384547.800086:0:14031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6140e00, rc 0) 00000100:00100000:0.0:1787384547.800152:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+67:12477:x1874208182340864:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 18762us (19138us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1787384547.800160:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 229 00000100:00100000:2.0:1787384547.800240:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b47850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+66:2416:x1874208182341120:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 549us (2981us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384547.800247:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 100 00000100:00100000:1.0:1787384547.811301:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384547.811389:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182341376 00000100:00100000:3.0:1787384547.811399:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182341376 00000100:00100000:3.0:1787384547.811464:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 18 00000100:00100000:3.0:1787384547.811475:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb125500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+66:12477:x1874208182341376:12345-192.168.203.45@tcp:103:lfs.0 00010000:00010000:3.0:1787384547.811489:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384547.811514:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952c00/0x7ef423838fba3694 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a42 expref: 66 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.811533:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f8edc2e700) 00010000:00010000:3.0:1787384547.811537:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384547.811596:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb125500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+65:12477:x1874208182341376:12345-192.168.203.45@tcp:103:lfs.0 Request processed in 122us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384547.811604:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 18 00000100:00100000:1.0:1787384547.813767:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384547.817508:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182341504 00000100:00100000:3.0:1787384547.817523:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182341504 00000100:00100000:3.0:1787384547.817606:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 230 00000100:00100000:3.0:1787384547.817617:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+65:12477:x1874208182341504:12345-192.168.203.45@tcp:58:lfs.0 00010000:00010000:3.0:1787384547.817744:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba3751 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.817763:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba3751 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384547.817792:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba3751 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787384547.823246:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1787384547.823420:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+65:12477:x1874208182341504:12345-192.168.203.45@tcp:58:lfs.0 Request processed in 5801us (9658us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384547.823432:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 230 00000100:00100000:0.0:1787384547.832224:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384547.832309:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182341632 00000100:00100000:2.0:1787384547.832319:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182341632 00000100:00100000:2.0:1787384547.832374:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 231 00000100:00100000:2.0:1787384547.832383:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+65:12477:x1874208182341632:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:2.0:1787384547.832403:0:8195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384547.832421:0:8195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba3758 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3a7a expref: -99 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.832471:0:8195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba3751 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.832482:0:8195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba3758 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a7a expref: 66 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.832499:0:8195:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba3751 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.832511:0:8195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba3758 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a7a expref: 66 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.832523:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f8edc2e700) 00010000:00010000:2.0:1787384547.832526:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787384547.832530:0:8195:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba3758 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a7a expref: 66 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384547.832554:0:8195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965bc00, rc 0) 00000100:00100000:2.0:1787384547.832661:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+66:12477:x1874208182341632:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 278us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384547.832668:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 231 00000040:00080000:2.0:1787384547.895759:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1787384548.022996:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787384548.023005:0:13801:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787384548.023034:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1787384548.023042:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787384548.023180:0:13801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4307480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1874208203365632:192.168.203.45@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787384548.023287:0:13801:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2956180 going to sleep for 11 seconds 00000100:00100000:2.0:1787384548.027230:0:13801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4307480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1874208203365632:192.168.203.45@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787384548.033204:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384548.034142:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182341760 00000100:00100000:2.0:1787384548.034154:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182341760 00000100:00100000:2.0:1787384548.034237:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 232 00000100:00100000:2.0:1787384548.034248:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+66:12478:x1874208182341760:12345-192.168.203.45@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787384548.034280:0:14031:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787384548.034385:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+66:12478:x1874208182341760:12345-192.168.203.45@tcp:53:lhsmtool_posix.0 Request processed in 140us (1191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384548.034394:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 232 00000100:00080000:1.0:1787384548.034467:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787384548.058220:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384548.058376:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182341888 00000100:00100000:2.0:1787384548.058386:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182341888 00000100:00100000:2.0:1787384548.058443:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 233 00000100:00100000:2.0:1787384548.058452:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+66:12478:x1874208182341888:12345-192.168.203.45@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787384548.058532:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba375f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.058550:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba375f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.058564:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba375f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.058579:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3766 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.058586:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3766 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.058592:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3766 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.058612:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba376d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.058620:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba376d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.058626:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba376d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384548.058671:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787384548.058675:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787384548.058686:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba376d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.058696:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba375f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.058707:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba375f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.058714:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba375f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.058720:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965ba00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384548.058725:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba375f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.058732:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba375f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.058744:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98f7c3a9cf00) 00010000:00010000:2.0:1787384548.058746:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384548.058750:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba375f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.058756:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba375f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.058769:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3766 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.058819:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3766 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.058828:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3766 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.058833:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965be00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384548.058843:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3766 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.058848:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3766 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.058857:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff98f8e8aa5300) 00010000:00010000:2.0:1787384548.058859:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384548.058862:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3766 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.058868:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3766 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.058882:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba376d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.058888:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba376d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.058905:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba376d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.058909:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965a400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384548.058912:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba376d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.058917:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba376d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.058925:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f8edc2e700) 00010000:00010000:2.0:1787384548.058927:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384548.058935:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba376d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.058940:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba376d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384548.059167:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+66:12478:x1874208182341888:12345-192.168.203.45@tcp:34:lhsmtool_posix.0 Request processed in 714us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384548.059176:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 233 00000100:00100000:3.0:1787384548.069439:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384548.070947:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182342144 00000100:00100000:2.0:1787384548.070960:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182342144 00000100:00100000:2.0:1787384548.071025:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 234 00000100:00100000:2.0:1787384548.071035:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+66:12478:x1874208182342144:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787384548.071055:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384548.071076:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba3774 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3a81 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.071170:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba377b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.071184:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba377b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.071195:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba377b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384548.071206:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787384548.071281:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba377b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.071288:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba377b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.071307:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba377b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.071313:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965a200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384548.071318:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba377b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.071326:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba377b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.071340:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f8edc2e700) 00010000:00010000:2.0:1787384548.071342:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787384548.071346:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba377b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.071352:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba377b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.071393:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba3774 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a81 expref: 68 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.071403:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98f7c3a9cf00) 00010000:00010000:2.0:1787384548.071406:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787384548.071409:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba3774 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a81 expref: 68 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.071419:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965ba00, rc 0) 00000100:00100000:2.0:1787384548.071479:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+67:12478:x1874208182342144:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 445us (2047us total) trans 4294967506 rc 301/301 00000100:00100000:2.0:1787384548.071498:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 234 00000100:00100000:3.0:1787384548.074680:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384548.074842:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182342272 00000100:00100000:0.0:1787384548.074851:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182342272 00000100:00100000:0.0:1787384548.074914:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 235 00000100:00100000:0.0:1787384548.074924:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+67:12478:x1874208182342272:12345-192.168.203.45@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787384548.074958:0:6521:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787384548.075066:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+67:12478:x1874208182342272:12345-192.168.203.45@tcp:53:lhsmtool_posix.0 Request processed in 143us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384548.075074:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 235 00000100:00100000:1.0:1787384548.078822:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384548.078967:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182342528 00000100:00100000:2.0:1787384548.078976:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182342528 00000100:00100000:2.0:1787384548.079035:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 236 00000100:00100000:2.0:1787384548.079044:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+67:12478:x1874208182342528:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787384548.079061:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384548.079064:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787384548.079087:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba3719 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a65 expref: 67 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.079103:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f8e8aa4100) 00010000:00010000:2.0:1787384548.079107:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787384548.079120:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba3789 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3a88 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787384548.079439:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:2.0:1787384548.079557:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba3790 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.079568:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba3790 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.079577:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba3790 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.079621:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba3789 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a88 expref: 69 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.079652:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba3790 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a88 expref: 68 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.079659:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98f8e8aa5300) 00010000:00010000:2.0:1787384548.079662:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787384548.079664:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965a200, rc 0) 00000100:00100000:2.0:1787384548.079723:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+68:12478:x1874208182342528:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 681us (950us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1787384548.079730:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 236 00000100:00100000:3.0:1787384548.085626:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384548.085712:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182342784 00000100:00100000:0.0:1787384548.085733:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182342784 00000100:00100000:0.0:1787384548.085810:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 237 00000100:00100000:0.0:1787384548.085820:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+68:12478:x1874208182342784:12345-192.168.203.45@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787384548.085875:0:14031:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384548.085909:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba3790 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a88 expref: 68 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.085925:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98f8e8aa5300) 00010000:00010000:0.0:1787384548.085934:0:14031:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787384548.085953:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba379e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.085965:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba379e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.085974:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba379e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.086040:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba37a5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x385dfd4b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.086049:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba37a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x385dfd4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.086056:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba37a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x385dfd4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.086095:0:14031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba379e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.086102:0:14031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba379e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.086114:0:14031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba379e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.086120:0:14031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384548.086123:0:14031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba379e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.086130:0:14031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba379e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.086139:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f8e8aa4100) 00010000:00010000:0.0:1787384548.086142:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384548.086145:0:14031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba379e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.086151:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba379e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.086161:0:14031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba37a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x385dfd4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.086167:0:14031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba37a5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x385dfd4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.086172:0:14031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba37a5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x385dfd4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.086177:0:14031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384548.086179:0:14031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba37a5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x385dfd4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.086196:0:14031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba37a5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x385dfd4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.086204:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x385dfd4b (ffff98f7c3a9dc00) 00010000:00010000:0.0:1787384548.086206:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384548.086208:0:14031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba37a5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x385dfd4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.086214:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba37a5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x385dfd4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384548.086293:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+67:12478:x1874208182342784:12345-192.168.203.45@tcp:36:lhsmtool_posix.0 Request processed in 473us (675us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787384548.086301:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 237 00000100:00100000:0.0:1787384548.090417:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384548.090499:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182342912 00000100:00100000:1.0:1787384548.090508:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182342912 00000100:00100000:1.0:1787384548.090567:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 238 00000100:00100000:1.0:1787384548.090575:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+67:12478:x1874208182342912:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787384548.090593:0:8195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384548.090614:0:8195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953800/0x7ef423838fba37ac lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3a8f expref: -99 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384548.090645:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953e00/0x7ef423838fba37b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384548.090656:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953e00/0x7ef423838fba37b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384548.090666:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953e00/0x7ef423838fba37b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384548.090769:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953800/0x7ef423838fba37ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a8f expref: 69 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384548.090830:0:8195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953e00/0x7ef423838fba37b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a8f expref: 68 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384548.090850:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98f8edc2e000) 00010000:00010000:1.0:1787384548.090852:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787384548.090856:0:8195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3953e00, rc 0) 00000100:00100000:1.0:1787384548.090914:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+68:12478:x1874208182342912:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 339us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384548.090921:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 238 00000100:00100000:2.0:1787384548.093485:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384548.093574:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182343168 00000100:00100000:3.0:1787384548.093583:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182343168 00000100:00100000:3.0:1787384548.093641:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 239 00000100:00100000:3.0:1787384548.093653:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+68:12478:x1874208182343168:12345-192.168.203.45@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787384548.093724:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba37ba lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.093738:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba37ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.093750:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba37ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787384548.093958:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:3.0:1787384548.093981:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 443174201442ns, next at 444174199463ns, rc = 0 00000004:00010000:3.0:1787384548.094032:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000040197460 reply state 0000000001fe9aa9 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba37ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.094044:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba37ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.094052:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98f8edc2e000) 00010000:00010000:3.0:1787384548.094056:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787384548.094059:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787384548.094149:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+70:12478:x1874208182343168:12345-192.168.203.45@tcp:36:lhsmtool_posix.0 Request processed in 498us (672us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1787384548.094157:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 239 00000100:00100000:3.0:1787384548.100371:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384548.100501:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182343296 00000100:00100000:1.0:1787384548.100511:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182343296 00000100:00100000:1.0:1787384548.100574:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 240 00000100:00100000:1.0:1787384548.100585:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+70:12478:x1874208182343296:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787384548.100609:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384548.100627:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953800/0x7ef423838fba37c1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3a96 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384548.100685:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953800/0x7ef423838fba37c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a96 expref: 71 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384548.100698:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953800/0x7ef423838fba37c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a96 expref: 71 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384548.100715:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98f8edc2e000) 00010000:00010000:1.0:1787384548.100719:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787384548.100722:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3953800, rc 0) 00000100:00100000:1.0:1787384548.100971:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+71:12478:x1874208182343296:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 387us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384548.100996:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 240 00000100:00100000:1.0:1787384548.103415:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384548.103500:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182343424 00000100:00100000:0.0:1787384548.103509:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182343424 00000100:00100000:0.0:1787384548.103568:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 70 00000100:00100000:0.0:1787384548.103576:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+9:2416:x1874208182343424:12345-192.168.203.45@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787384548.103935:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+10:2416:x1874208182343424:12345-192.168.203.45@tcp:2:lhsmtool_posix.0 Request processed in 357us (527us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1787384548.103943:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 70 00000100:00080000:1.0:1787384548.104168:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787384548.110931:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384548.111111:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182343680 00000100:00100000:2.0:1787384548.111120:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182343680 00000100:00100000:2.0:1787384548.111174:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 60 00000100:00100000:2.0:1787384548.111183:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+71:12478:x1874208182343680:12345-192.168.203.45@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787384548.111418:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+72:12478:x1874208182343680:12345-192.168.203.45@tcp:35:lhsmtool_posix.0 Request processed in 236us (494us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1787384548.111426:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 60 00000100:00100000:2.0:1787384548.122968:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384548.123164:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182343936 00000100:00100000:1.0:1787384548.123174:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182343936 00000100:00100000:1.0:1787384548.123234:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 241 00000100:00100000:1.0:1787384548.123245:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+72:12478:x1874208182343936:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787384548.123352:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+72:12478:x1874208182343936:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 Request processed in 109us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384548.123359:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 241 00000100:00100000:1.0:1787384548.126657:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384548.126751:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182344064 00000100:00100000:0.0:1787384548.126759:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182344064 00000100:00100000:0.0:1787384548.126860:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 242 00000100:00100000:0.0:1787384548.126870:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+72:12478:x1874208182344064:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787384548.126914:0:14031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384548.126933:0:14031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba37c8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3a9d expref: -99 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.126993:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba37cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.127004:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba37cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.127027:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba37cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384548.127071:0:14031:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787384548.127089:0:14031:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba37cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.127115:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140c00/0x7ef423838fba37c8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a9d expref: 74 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.127133:0:14031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba37cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a9d expref: 73 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.127141:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98f8edc2e000) 00010000:00010000:0.0:1787384548.127144:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787384548.127148:0:14031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6140800, rc 0) 00000100:00100000:0.0:1787384548.127406:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+73:12478:x1874208182344064:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 536us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384548.127413:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 242 00000100:00100000:2.0:1787384548.130376:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384548.130452:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182344192 00000100:00100000:0.0:1787384548.130460:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182344192 00000100:00100000:0.0:1787384548.130517:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 71 00000100:00100000:0.0:1787384548.130527:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+10:2415:x1874208182344192:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787384548.130545:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384548.130566:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000074e05b0/0x7ef423838fba37d6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3aa4 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787384548.130590:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8952e3, blocks: 0x0 00010000:00010000:0.0:1787384548.130607:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1787384548.130612:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384548.130621:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000074e05b0/0x7ef423838fba37d6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3aa4 expref: 11 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.130639:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000074e05b0/0x7ef423838fba37d6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3aa4 expref: 11 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.130652:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6141400, rc 0) 00000100:00100000:0.0:1787384548.130713:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+11:2415:x1874208182344192:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 186us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384548.130720:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 71 00000100:00100000:3.0:1787384548.144211:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384548.144458:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182344448 00000100:00100000:1.0:1787384548.144468:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182344448 00000100:00100000:1.0:1787384548.144532:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 243 00000100:00100000:1.0:1787384548.144541:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+73:12478:x1874208182344448:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787384548.144645:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+73:12478:x1874208182344448:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 Request processed in 104us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384548.144653:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 243 00000100:00100000:2.0:1787384548.157425:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384548.157507:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182344576 00000100:00100000:3.0:1787384548.157516:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182344576 00000100:00100000:3.0:1787384548.157575:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 72 00000100:00100000:3.0:1787384548.157585:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+11:12478:x1874208182344576:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787384548.157602:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384548.157617:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7fff1a7/0x7ef423838fba37dd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3aab expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.157648:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000074e05b0/0x7ef423838fba37d6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3aa4 expref: 12 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.157658:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384548.157676:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384548.157682:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7fff1a7/0x7ef423838fba37dd lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3aab expref: 12 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.157717:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000074e05b0/0x7ef423838fba37d6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3aa4 expref: 12 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.157730:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000074e05b0/0x7ef423838fba37d6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3aa4 expref: 12 pid: 8438 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384548.157743:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874208203365760:192.168.203.45@tcp:104: 00000100:00100000:3.0:1787384548.157874:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d829ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1787384548.161411:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1874208203365760:192.168.203.45@tcp:104: 00010000:00010000:0.0:1787384548.161447:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a7fff1a7/0x7ef423838fba37dd lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3aab expref: 12 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.161468:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cc000, rc 0) 00000100:00100000:0.0:1787384548.161546:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+12:12478:x1874208182344576:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 3961us (4130us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384548.161555:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 72 00000100:00100000:2.0:1787384548.165086:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384548.165247:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182344704 00000100:00100000:0.0:1787384548.165256:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182344704 00010000:00010000:0.0:1787384548.165300:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000074e05b0/0x7ef423838fba37d6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3aa4 expref: 12 pid: 8438 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384548.165344:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 101 00000100:00100000:0.0:1787384548.165353:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4306300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+12:2416:x1874208182344704:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787384548.165366:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384548.165385:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000074e05b0/0x7ef423838fba37d6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3aa4 expref: 12 pid: 8438 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.165397:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000074e05b0/0x7ef423838fba37d6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3aa4 expref: 12 pid: 8438 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.165419:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000074e05b0/0x7ef423838fba37d6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3aa4 expref: 12 pid: 8438 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.165436:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384548.165440:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384548.165447:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a7fff1a7/0x7ef423838fba37dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3aab expref: 11 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.165456:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7fff1a7/0x7ef423838fba37dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3aab expref: 11 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.165505:0:6509:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a7fff1a7/0x7ef423838fba37dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3aab expref: 11 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384548.165519:0:6509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e6a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6509:1874208203365888:192.168.203.45@tcp:105: 00000100:00100000:0.0:1787384548.165601:0:6509:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c6163a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787384548.175515:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384548.175765:0:6509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e6a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6509:1874208203365888:192.168.203.45@tcp:105: 00010000:00010000:0.0:1787384548.175819:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384548.175873:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4306300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+11:2416:x1874208182344704:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 10519us (10797us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384548.175884:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 101 00000100:00100000:3.0:1787384548.176570:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182344832 00000100:00100000:3.0:1787384548.176579:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182344832 00002000:00100000:3.0:1787384548.176621:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff98f7c4306a00 x1874208182344832/t0(0) o4->55e96ad5-fd9d-44d4-856e-5db0c40b1329@192.168.203.45@tcp:579/0 lens 504/0 e 0 to 0 dl 1787384559 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787384548.176631:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98f7c4306a00 with x1874208182344832 ext(0->12) 00002000:00010000:3.0:1787384548.176636:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98f7c4306a00 00000100:00100000:3.0:1787384548.176706:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 6 00000100:00100000:3.0:1787384548.176714:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+11:2416:x1874208182344832:12345-192.168.203.45@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787384548.177611:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+13:2416:x1874208182344832:12345-192.168.203.45@tcp:4:lhsmtool_posix.0 Request processed in 893us (2101us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1787384548.177621:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 6 00002000:00100000:3.0:1787384548.177630:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff98f7c4306a00 x1874208182344832/t4294967321(0) o4->55e96ad5-fd9d-44d4-856e-5db0c40b1329@192.168.203.45@tcp:579/0 lens 504/448 e 0 to 0 dl 1787384559 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787384548.177652:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98f7c4306a00 with x1874208182344832 ext(0->12) 00002000:00010000:3.0:1787384548.177657:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98f7c4306a00 00000100:00100000:2.0:1787384548.184967:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384548.185061:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182344960 00000100:00100000:3.0:1787384548.185070:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182344960 00000100:00100000:3.0:1787384548.185131:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 244 00000100:00100000:3.0:1787384548.185141:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+73:12478:x1874208182344960:12345-192.168.203.45@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787384548.186773:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967509 is committed 00000004:00080000:2.0:1787384548.186826:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:2.0:1787384548.186864:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1787384548.186878:0:6501:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98f7c41c3240 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1787384548.186883:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff98f7c209e100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98f7c41c36c0 00000020:00080000:2.0:1787384548.186886:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff98f7c209e600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98f7c20b5e00 00000004:00080000:2.0:1787384548.186921:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:2.0:1787384548.186949:0:6501:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98f8f5769180 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1787384548.186952:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff98f7c209e500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98f8f5769000 00000020:00080000:2.0:1787384548.186955:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff98f7c209ef00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98f7c2b52000 00000020:00080000:2.0:1787384548.186967:0:6501:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00010000:00010000:0.0:1787384548.187046:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba34e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187057:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba34e2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187065:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba34e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187071:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3952000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384548.187075:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba34e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187082:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba34e2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187098:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff98f7c294fb00) 00010000:00010000:0.0:1787384548.187107:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384548.187112:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba34e2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187119:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952000/0x7ef423838fba34e2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187146:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba358a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187152:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba358a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187158:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba358a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187163:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140a00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384548.187166:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba358a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187173:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba358a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187181:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff98f7c3a9d900) 00010000:00010000:0.0:1787384548.187183:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384548.187186:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba358a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187191:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba358a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187205:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3608 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187221:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3608 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187226:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3608 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187243:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384548.187247:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3608 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187253:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3608 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187262:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f7c3a9db00) 00010000:00010000:0.0:1787384548.187264:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384548.187267:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3608 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187273:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140400/0x7ef423838fba3608 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187286:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba362b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187292:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba362b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187297:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba362b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187302:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6141c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384548.187309:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba362b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187315:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba362b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187322:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f7c3a9db00) 00010000:00010000:0.0:1787384548.187324:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384548.187327:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba362b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187332:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba362b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187354:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba36fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187360:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba36fd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187365:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba36fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187369:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2091400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384548.187371:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba36fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187376:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba36fd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187382:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f8edc2e700) 00010000:00010000:0.0:1787384548.187384:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384548.187391:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba36fd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187396:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba36fd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187405:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba37ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187410:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba37ba lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187415:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba37ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187419:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cdc00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384548.187421:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba37ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187426:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba37ba lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187432:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98f8edc2e000) 00010000:00010000:0.0:1787384548.187434:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787384548.187436:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba37ba lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.187441:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cdc00/0x7ef423838fba37ba lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787384548.187831:0:6553:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1787384548.187899:0:6553:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787384548.187909:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787384548.187925:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203366272:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787384548.187988:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384548.188134:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203366272 00000100:00100000:3.0:1787384548.188140:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203366272 00000100:00100000:2.0:1787384548.188229:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203366016:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787384548.188268:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384548.188344:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203366144:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787384548.192603:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203366016 00000100:00100000:3.0:1787384548.192620:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203366016 00000100:00100000:3.0:1787384548.192677:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787384548.192687:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3652:x1874208203366272:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787384548.192717:0:8438:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:3.0:1787384548.192748:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a8952e2, atime: 0x6a8952e2, ctime: 0x6a8952e2, blocks: 0x8 00010000:00010000:3.0:1787384548.192756:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071fbbd72/0x7ef423838fba37e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.192771:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1787384548.192792:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384548.192798:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071fbbd72/0x7ef423838fba37e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.192831:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071fbbd72/0x7ef423838fba37e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.192840:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071fbbd72/0x7ef423838fba37e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.192847:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071fbbd72/0x7ef423838fba37e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.192864:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787384548.193056:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3652:x1874208203366272:12345-0@lo:6:osp-syn-1-0.0 Request processed in 370us (5068us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787384548.193063:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787384548.193081:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787384548.193087:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3653:x1874208203366016:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787384548.193099:0:8438:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:3.0:1787384548.193111:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcd92aba/0x7ef423838fba37eb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.193127:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b722f718/0x7ef423838fba3598 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a03 expref: 12 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.193134:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1787384548.193137:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787384548.193140:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dcd92aba/0x7ef423838fba37eb lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.193177:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b722f718/0x7ef423838fba3598 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a03 expref: 12 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.193191:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b722f718/0x7ef423838fba3598 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a03 expref: 12 pid: 8890 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384548.193206:0:8438:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1874208203366400:192.168.203.45@tcp:104: 00000100:00100000:3.0:1787384548.193278:0:8438:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d829ae40 going to sleep for 11 seconds 00010000:00010000:3.0:1787384548.193294:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384548.193300:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071fbbd72/0x7ef423838fba37e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.193308:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cda00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:3.0:1787384548.193312:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071fbbd72/0x7ef423838fba37e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.193321:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071fbbd72/0x7ef423838fba37e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.193337:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071fbbd72/0x7ef423838fba37e4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.193344:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071fbbd72/0x7ef423838fba37e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.193372:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384548.193374:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384548.193376:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787384548.193584:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98f7c35d9f80/2, rc 0, transno 4294967311 00000100:00100000:3.0:1787384548.193592:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203366272:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787384548.193677:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+21:12478:x1874208182344960:12345-192.168.203.45@tcp:44:lhsmtool_posix.0 Request processed in 8537us (8718us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384548.193685:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 244 00000100:00100000:3.0:1787384548.196747:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384548.198356:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203366144 00000100:00100000:2.0:1787384548.198368:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203366144 00000100:00100000:2.0:1787384548.198414:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787384548.198424:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3654:x1874208203366144:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787384548.198563:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787384548.198566:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1787384547 00002000:00010000:2.0:1787384548.198569:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787384548.198571:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1787384547 -> 1787384547 00002000:00010000:2.0:1787384548.198573:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787384548.198645:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3654:x1874208203366144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 222us (1903us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1787384548.198653:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:3.0:1787384548.198967:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98f8cb127b80/2, rc 0, transno 4294967322 00000100:00100000:3.0:1787384548.198975:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203366144:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787384548.199251:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384548.199288:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384548.199304:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182345344 00000100:00100000:2.0:1787384548.199313:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182345344 00000100:00100000:2.0:1787384548.199334:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 127 00000100:00100000:2.0:1787384548.199341:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4305500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+9:2414:x1874208182345344:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384548.199387:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4305500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+9:2414:x1874208182345344:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 46us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384548.199394:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 127 00000100:00100000:2.0:1787384548.199427:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384548.199489:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384548.199517:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384548.199535:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182345600 00000100:00100000:2.0:1787384548.199538:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182345600 00000100:00100000:2.0:1787384548.199567:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182345216 00000100:00100000:2.0:1787384548.199570:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182345216 00000100:00100000:2.0:1787384548.199584:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182345472 00000100:00100000:2.0:1787384548.199586:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182345472 00000100:00100000:2.0:1787384548.199601:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 351 00000100:00100000:2.0:1787384548.199607:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182345600:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384548.199637:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182345600:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 30us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384548.199644:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 351 00000100:00100000:2.0:1787384548.199657:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 352 00000100:00100000:2.0:1787384548.199662:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2414:x1874208182345216:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384548.199685:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2414:x1874208182345216:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 22us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384548.199692:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 352 00000100:00100000:2.0:1787384548.199703:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 353 00000100:00100000:2.0:1787384548.199715:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182345472:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384548.199740:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182345472:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 25us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384548.199746:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 353 00000100:00100000:3.0:1787384548.200282:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182345088 00000100:00100000:3.0:1787384548.200287:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182345088 00000100:00100000:3.0:1787384548.200330:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 391 00000100:00100000:3.0:1787384548.200338:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+13:2414:x1874208182345088:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384548.200375:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+13:2414:x1874208182345088:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 38us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384548.200381:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 391 00000100:00080000:3.0:1787384548.200967:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787384548.200973:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00080000:0.0:1787384548.204814:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1787384548.204851:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:2.0:1787384548.210235:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384548.210273:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384548.210359:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182345856 00000100:00100000:0.0:1787384548.210369:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182345856 00000100:00100000:0.0:1787384548.210423:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 76 00000100:00100000:0.0:1787384548.210434:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+13:2416:x1874208182345856:12345-192.168.203.45@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787384548.210847:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182345728 00000100:00100000:1.0:1787384548.210852:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182345728 00010000:00010000:1.0:1787384548.210879:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b722f718/0x7ef423838fba3598 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a03 expref: 14 pid: 8890 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384548.210925:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 102 00000100:00100000:1.0:1787384548.210933:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4305c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+14:2415:x1874208182345728:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384548.210951:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384548.210957:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b722f718/0x7ef423838fba3598 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a03 expref: 14 pid: 8890 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384548.210972:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b722f718/0x7ef423838fba3598 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a03 expref: 14 pid: 8890 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384548.210997:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787384548.211002:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787384548.211007:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dcd92aba/0x7ef423838fba37eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384548.211017:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dcd92aba/0x7ef423838fba37eb lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384548.211042:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384548.211090:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4305c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+14:2415:x1874208182345728:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 158us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384548.211097:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 102 00010000:00010000:3.0:1787384548.211381:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b722f718/0x7ef423838fba3598 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a03 expref: 13 pid: 8890 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384548.211396:0:8438:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1874208203366400:192.168.203.45@tcp:104: 00010000:00010000:3.0:1787384548.211423:0:8438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dcd92aba/0x7ef423838fba37eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.211435:0:8438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dcd92aba/0x7ef423838fba37eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.211442:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dcd92aba/0x7ef423838fba37eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.211451:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcd92aba/0x7ef423838fba37eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.211459:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dcd92aba/0x7ef423838fba37eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.211480:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787384548.211616:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3653:x1874208203366016:12345-0@lo:6:osp-syn-0-0.0 Request processed in 18528us (23347us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1787384548.211623:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:3.0:1787384548.211655:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98f8cb124e00/2, rc 0, transno 4294967323 00000100:00100000:3.0:1787384548.211661:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203366016:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1787384548.211864:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384548.211871:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dcd92aba/0x7ef423838fba37eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.211880:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cce00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384548.211884:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcd92aba/0x7ef423838fba37eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.211902:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcd92aba/0x7ef423838fba37eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.211918:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dcd92aba/0x7ef423838fba37eb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.211925:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dcd92aba/0x7ef423838fba37eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.211942:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384548.211944:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384548.211946:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787384548.214970:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:1.0:1787384548.214984:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:0.0:1787384548.215148:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:2416:x1874208182345856:12345-192.168.203.45@tcp:16:lhsmtool_posix.0 Request processed in 4710us (4868us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384548.215177:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 76 00000100:00100000:2.0:1787384548.218178:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384548.218261:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182346112 00000100:00100000:0.0:1787384548.218271:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182346112 00000100:00100000:0.0:1787384548.218328:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 245 00000100:00100000:0.0:1787384548.218337:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+21:12478:x1874208182346112:12345-192.168.203.45@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787384548.218389:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384548.218414:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140800/0x7ef423838fba37cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a9d expref: 21 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.218431:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98f8edc2e000) 00010000:00010000:0.0:1787384548.218435:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787384548.218463:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba37f2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.218477:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba37f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.218486:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba37f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787384548.218600:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000019c894a4 reply state 0000000069808296 transno 4294967510 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba37f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.218612:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba37f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.218617:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98f8edc2e000) 00010000:00010000:0.0:1787384548.218620:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787384548.218636:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787384548.218733:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+22:12478:x1874208182346112:12345-192.168.203.45@tcp:36:lhsmtool_posix.0 Request processed in 395us (562us total) trans 4294967510 rc 0/0 00000100:00100000:0.0:1787384548.218740:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 245 00000100:00100000:3.0:1787384548.221616:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384548.221698:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182346240 00000100:00100000:0.0:1787384548.221707:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182346240 00000100:00100000:0.0:1787384548.221760:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 77 00000100:00100000:0.0:1787384548.221768:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:2414:x1874208182346240:12345-192.168.203.45@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787384548.221963:0:8890:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787384548.221968:0:8890:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1787384547 -> 1787384546 00002000:00010000:0.0:1787384548.221970:0:8890:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1787384546 00002000:00010000:0.0:1787384548.221972:0:8890:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1787384547 -> 1787384546 00002000:00010000:0.0:1787384548.221974:0:8890:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1787384548.222041:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+8:2414:x1874208182346240:12345-192.168.203.45@tcp:2:lhsmtool_posix.0 Request processed in 271us (431us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1787384548.222048:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 77 00000100:00100000:3.0:1787384548.229722:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384548.229830:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182346496 00000100:00100000:0.0:1787384548.229840:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182346496 00000100:00100000:3.0:1787384548.229996:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 246 00000100:00100000:3.0:1787384548.230008:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+22:12478:x1874208182346496:12345-192.168.203.45@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787384548.230095:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159e00/0x7ef423838fba37f9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.230114:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953e00/0x7ef423838fba37b3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a8f expref: 22 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.230125:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159e00/0x7ef423838fba37f9 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.230161:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953e00/0x7ef423838fba37b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a8f expref: 22 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.230176:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953e00/0x7ef423838fba37b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a8f expref: 22 pid: 8195 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384548.230191:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35d9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1874208203366528:192.168.203.45@tcp:104: 00000100:00100000:3.0:1787384548.230275:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d829ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1787384548.232451:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35d9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1874208203366528:192.168.203.45@tcp:104: 00010000:00010000:3.0:1787384548.232479:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159e00/0x7ef423838fba37f9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384548.232856:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384548.233160:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182346624 00000100:00100000:2.0:1787384548.233169:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182346624 00010000:00010000:2.0:1787384548.233205:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953e00/0x7ef423838fba37b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a8f expref: 23 pid: 8195 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384548.233245:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 103 00000100:00100000:2.0:1787384548.233255:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+23:2416:x1874208182346624:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384548.233271:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384548.233278:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953e00/0x7ef423838fba37b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a8f expref: 23 pid: 8195 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.233291:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953e00/0x7ef423838fba37b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a8f expref: 23 pid: 8195 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.233312:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953e00/0x7ef423838fba37b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a8f expref: 23 pid: 8195 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.233328:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98f8edc2e000) 00010000:00010000:2.0:1787384548.233333:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159e00/0x7ef423838fba37f9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.233355:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159e00/0x7ef423838fba37f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.233361:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159e00/0x7ef423838fba37f9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.233395:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384548.233442:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+22:2416:x1874208182346624:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 188us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384548.233449:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 103 00010000:00010000:1.0:1787384548.233555:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159e00/0x7ef423838fba37f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384548.233564:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159e00/0x7ef423838fba37f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384548.233598:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159e00/0x7ef423838fba37f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384548.233610:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159e00/0x7ef423838fba37f9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384548.233615:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159e00/0x7ef423838fba37f9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384548.233620:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f902159e00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384548.233624:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159e00/0x7ef423838fba37f9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384548.233630:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159e00/0x7ef423838fba37f9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384548.233638:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98f8edc2e000) 00010000:00010000:1.0:1787384548.233641:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787384548.233644:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159e00/0x7ef423838fba37f9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384548.233649:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159e00/0x7ef423838fba37f9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384548.233687:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+21:12478:x1874208182346496:12345-192.168.203.45@tcp:55:lhsmtool_posix.0 Request processed in 3683us (3973us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787384548.233694:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 246 00000100:00100000:2.0:1787384548.239648:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384548.239734:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182346752 00000100:00100000:1.0:1787384548.239744:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182346752 00000100:00100000:1.0:1787384548.239823:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 78 00000100:00100000:1.0:1787384548.239833:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+8:2415:x1874208182346752:12345-192.168.203.45@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787384548.239874:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000007040e6b/0x7ef423838fba3800 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384548.240048:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a7fff1a7/0x7ef423838fba37dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3aab expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384548.240057:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384548.240062:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787384548.240066:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007040e6b/0x7ef423838fba3800 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384548.240102:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a7fff1a7/0x7ef423838fba37dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3aab expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384548.240116:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a7fff1a7/0x7ef423838fba37dd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3aab expref: 8 pid: 8436 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384548.240130:0:8435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9148700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1874208203366656:192.168.203.45@tcp:104: 00000100:00100000:1.0:1787384548.240206:0:8435:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f8749f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787384548.242448:0:8435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9148700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1874208203366656:192.168.203.45@tcp:104: 00010000:00010000:1.0:1787384548.242476:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000007040e6b/0x7ef423838fba3800 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384548.247573:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384548.247926:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182346880 00000100:00100000:0.0:1787384548.247936:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182346880 00010000:00010000:0.0:1787384548.247974:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a7fff1a7/0x7ef423838fba37dd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3aab expref: 9 pid: 8436 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384548.248025:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 104 00000100:00100000:0.0:1787384548.248034:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+9:2416:x1874208182346880:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787384548.248049:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384548.248070:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a7fff1a7/0x7ef423838fba37dd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3aab expref: 9 pid: 8436 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.248100:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a7fff1a7/0x7ef423838fba37dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3aab expref: 9 pid: 8436 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.248123:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7fff1a7/0x7ef423838fba37dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3aab expref: 9 pid: 8436 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.248140:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787384548.248145:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787384548.248151:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000007040e6b/0x7ef423838fba3800 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.248160:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007040e6b/0x7ef423838fba3800 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.248192:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384548.248245:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+8:2416:x1874208182346880:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 212us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384548.248253:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 104 00010000:00010000:2.0:1787384548.248503:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000007040e6b/0x7ef423838fba3800 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.248512:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007040e6b/0x7ef423838fba3800 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.248531:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000007040e6b/0x7ef423838fba3800 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.248540:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007040e6b/0x7ef423838fba3800 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.248548:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007040e6b/0x7ef423838fba3800 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.248568:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3953400 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:2.0:1787384548.248572:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007040e6b/0x7ef423838fba3800 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.248582:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007040e6b/0x7ef423838fba3800 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.248593:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007040e6b/0x7ef423838fba3800 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.248601:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007040e6b/0x7ef423838fba3800 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384548.248660:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:2415:x1874208182346752:12345-192.168.203.45@tcp:1:lhsmtool_posix.0 Request processed in 8828us (9020us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384548.248669:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 78 00000100:00100000:2.0:1787384548.255321:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384548.255409:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182347136 00000100:00100000:0.0:1787384548.255418:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182347136 00000100:00100000:0.0:1787384548.255483:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 247 00000100:00100000:0.0:1787384548.255495:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+21:12478:x1874208182347136:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787384548.255572:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba3807 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.255590:0:14031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba36f6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a57 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.255613:0:14031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba3807 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.255649:0:14031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba36f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a57 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.255662:0:14031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba36f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a57 expref: 21 pid: 6522 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384548.255677:0:14031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e6a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14031:1874208203366784:192.168.203.45@tcp:104: 00000100:00100000:0.0:1787384548.255760:0:14031:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2956900 going to sleep for 11 seconds 00000100:00100000:2.0:1787384548.258566:0:14031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e6a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14031:1874208203366784:192.168.203.45@tcp:104: 00010000:00010000:2.0:1787384548.258596:0:14031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba3807 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384548.259340:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384548.259409:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182347264 00000100:00100000:1.0:1787384548.259416:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182347264 00010000:00010000:1.0:1787384548.259448:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba36f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a57 expref: 22 pid: 6522 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384548.259499:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 105 00000100:00100000:1.0:1787384548.259508:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+22:2415:x1874208182347264:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384548.259520:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384548.259526:0:10399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba36f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a57 expref: 22 pid: 6522 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384548.259538:0:10399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba36f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a57 expref: 22 pid: 6522 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384548.259558:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091800/0x7ef423838fba36f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a57 expref: 22 pid: 6522 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384548.259572:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f8edc2e700) 00010000:00010000:1.0:1787384548.259577:0:10399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba3758 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a7a expref: 21 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384548.259588:0:10399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba3807 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384548.259595:0:10399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba3807 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384548.259603:0:10399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba3807 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384548.259627:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384548.259679:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+21:2415:x1874208182347264:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 173us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384548.259692:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 105 00010000:00010000:0.0:1787384548.260236:0:14031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba3807 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.260246:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba3807 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.260406:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba380e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.260419:0:14031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953800/0x7ef423838fba37c1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a96 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.260427:0:14031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba380e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.260455:0:14031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953800/0x7ef423838fba37c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a96 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.260479:0:14031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953800/0x7ef423838fba37c1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a96 expref: 21 pid: 6521 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384548.260492:0:14031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e69500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14031:1874208203366912:192.168.203.45@tcp:104: 00000100:00100000:0.0:1787384548.260556:0:14031:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2956900 going to sleep for 11 seconds 00000100:00100000:0.0:1787384548.263462:0:14031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e69500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14031:1874208203366912:192.168.203.45@tcp:104: 00010000:00010000:0.0:1787384548.263490:0:14031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba380e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384548.266243:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384548.266343:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182347392 00000100:00100000:0.0:1787384548.266352:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182347392 00010000:00010000:0.0:1787384548.266389:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953800/0x7ef423838fba37c1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a96 expref: 22 pid: 6521 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384548.266430:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 106 00000100:00100000:0.0:1787384548.266439:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b44c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+22:2415:x1874208182347392:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787384548.266452:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384548.266458:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953800/0x7ef423838fba37c1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a96 expref: 22 pid: 6521 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.266470:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953800/0x7ef423838fba37c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a96 expref: 22 pid: 6521 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.266491:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953800/0x7ef423838fba37c1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a96 expref: 22 pid: 6521 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.266517:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98f8edc2e000) 00010000:00010000:0.0:1787384548.266522:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba380e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.266530:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba380e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.266537:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba380e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384548.266657:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384548.266722:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b44c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+21:2415:x1874208182347392:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 282us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384548.266730:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 106 00010000:00010000:1.0:1787384548.272679:0:14031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba380e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384548.272697:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba380e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787384548.272835:0:14031:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:1.0:1787384548.272968:0:14031:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000001:00080000:1.0:1787384548.273005:0:14031:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:1.0:1787384548.273102:0:14031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9148700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14031:1874208203367040:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787384548.273166:0:14031:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384548.273210:0:14031:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f8749a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787384548.273377:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203367040 00000100:00100000:2.0:1787384548.273386:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203367040 00000100:00100000:2.0:1787384548.273438:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787384548.273462:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14031:x1874208203367040:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787384548.273552:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14031:x1874208203367040:12345-0@lo:1000:mdt00_004.0 Request processed in 92us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384548.273560:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787384548.273999:0:14031:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1787384548.274006:0:14031:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:3.0:1787384548.274048:0:14031:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98f8cb127b80, transno 4294967322 00000100:00100000:3.0:1787384548.274067:0:14031:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff98f8cb124e00 x1874208203366016/t4294967323(4294967323) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787384564 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384548.274093:0:14031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9148700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14031:1874208203367040:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1787384548.274205:0:14031:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00000100:00100000:3.0:1787384548.274257:0:14031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35da680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14031:1874208203367168:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787384548.274291:0:14031:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384548.274320:0:14031:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8c41e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787384548.274377:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203367168 00000100:00100000:2.0:1787384548.274382:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203367168 00000100:00100000:2.0:1787384548.274415:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787384548.274422:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:14031:x1874208203367168:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787384548.274513:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:14031:x1874208203367168:12345-0@lo:1000:mdt00_004.0 Request processed in 90us (220us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1787384548.274521:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787384548.275115:0:14031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35da680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14031:1874208203367168:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1787384548.275149:0:14031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba380e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.275160:0:14031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba380e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.275167:0:14031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba380e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.275173:0:14031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6141400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384548.275178:0:14031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba380e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.275186:0:14031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba380e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.275200:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98f8edc2e000) 00010000:00010000:3.0:1787384548.275203:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787384548.275208:0:14031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba380e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.275215:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141400/0x7ef423838fba380e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.275251:0:14031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba3751 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.275258:0:14031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba3751 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.275263:0:14031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba3751 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.275268:0:14031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2090400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384548.275271:0:14031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba3751 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.275277:0:14031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba3751 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.275284:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f8edc2e700) 00010000:00010000:3.0:1787384548.275287:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787384548.275294:0:14031:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba3758 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a7a expref: 24 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.275305:0:14031:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba3758 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a7a expref: 24 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.275313:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba3758 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a7a expref: 24 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.275342:0:14031:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba3758 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a7a expref: 24 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384548.275367:0:14031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91da300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14031:1874208203367296:192.168.203.45@tcp:105: 00000100:00100000:3.0:1787384548.275439:0:14031:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8c41e40 going to sleep for 11 seconds 00010000:00010000:3.0:1787384548.281694:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384548.282563:0:14031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91da300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14031:1874208203367296:192.168.203.45@tcp:105: 00010000:00010000:3.0:1787384548.282596:0:14031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba3751 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.282606:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba3751 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.282639:0:14031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f902158e00/0x7ef423838fba3815 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.282650:0:14031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f902158e00/0x7ef423838fba3815 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.282661:0:14031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f902158e00/0x7ef423838fba3815 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.282682:0:14031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f902158e00/0x7ef423838fba3815 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.282689:0:14031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f902158e00/0x7ef423838fba3815 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.282695:0:14031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f902158e00/0x7ef423838fba3815 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.282701:0:14031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f902158e00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384548.282720:0:14031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f902158e00/0x7ef423838fba3815 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.282727:0:14031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f902158e00/0x7ef423838fba3815 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.282738:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f8edc2e700) 00010000:00010000:3.0:1787384548.282741:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384548.282745:0:14031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f902158e00/0x7ef423838fba3815 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.282750:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f902158e00/0x7ef423838fba3815 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.282760:0:14031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba3807 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.282766:0:14031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba3807 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.282771:0:14031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba3807 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.282803:0:14031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140a00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384548.282807:0:14031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba3807 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.282813:0:14031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba3807 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.282821:0:14031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f8edc2e700) 00010000:00010000:3.0:1787384548.282823:0:14031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787384548.282833:0:14031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba3807 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.282839:0:14031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140a00/0x7ef423838fba3807 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384548.283006:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+24:12478:x1874208182347136:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 Request processed in 27512us (27692us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1787384548.283016:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 247 00000100:00100000:2.0:1787384548.283240:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384548.283269:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182347520 00000100:00100000:2.0:1787384548.283275:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182347520 00000100:00100000:2.0:1787384548.283313:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 61 00000100:00100000:2.0:1787384548.283321:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+25:12477:x1874208182347520:12345-192.168.203.45@tcp:49:lfs.0 00000100:00100000:2.0:1787384548.283398:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+25:12477:x1874208182347520:12345-192.168.203.45@tcp:49:lfs.0 Request processed in 78us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384548.283403:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 61 00000020:00080000:3.0:1787384548.283687:0:14031:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787384548.283959:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787384548.283965:0:13801:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787384548.284395:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787384548.284407:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787384548.295135:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384548.295219:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182347776 00000100:00100000:2.0:1787384548.295229:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182347776 00000100:00100000:2.0:1787384548.295285:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 62 00000100:00100000:2.0:1787384548.295296:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9506450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+24:12478:x1874208182347776:12345-192.168.203.45@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787384548.295538:0:6525:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787384548.295568:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967516 00010000:00010000:2.0:1787384548.295601:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba381c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.295633:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba381c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.295644:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba381c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.295653:0:6525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba381c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.295659:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba381c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.295814:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba381c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384548.295834:0:6525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787384548.295927:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9506450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+26:12478:x1874208182347776:12345-192.168.203.45@tcp:35:lhsmtool_posix.0 Request processed in 632us (800us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1787384548.295936:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 62 00000020:00080000:2.0:1787384548.295942:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787384548.296272:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384548.296279:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba381c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.296286:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965a600 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:3.0:1787384548.296290:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba381c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.296298:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba381c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.296311:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98f8edc2e000) 00010000:00010000:3.0:1787384548.296314:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787384548.296318:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba381c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.296324:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a600/0x7ef423838fba381c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.296336:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384548.296338:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384548.296339:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384548.299470:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384548.299750:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182348032 00000100:00100000:2.0:1787384548.299760:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182348032 00000100:00100000:2.0:1787384548.299903:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 248 00000100:00100000:2.0:1787384548.299913:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+26:12477:x1874208182348032:12345-192.168.203.45@tcp:58:lfs.0 00000040:00080000:2.0:1787384548.300082:0:8195:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1787384548.300161:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+26:12477:x1874208182348032:12345-192.168.203.45@tcp:58:lfs.0 Request processed in 249us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384548.300169:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 248 00000100:00100000:1.0:1787384548.376412:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384548.376504:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182348160 00000100:00100000:3.0:1787384548.376514:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182348160 00000100:00100000:3.0:1787384548.376574:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 249 00000100:00100000:3.0:1787384548.376583:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9148380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+26:12480:x1874208182348160:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:3.0:1787384548.376607:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384548.376625:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f902158e00/0x7ef423838fba3823 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3ab2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.376687:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f902158000/0x7ef423838fba382a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.376702:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f902158000/0x7ef423838fba382a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.376713:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f902158000/0x7ef423838fba382a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.376728:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159a00/0x7ef423838fba3831 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.376735:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159a00/0x7ef423838fba3831 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.376741:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159a00/0x7ef423838fba3831 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.376847:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159400/0x7ef423838fba3838 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.376858:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3743 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a73 expref: 27 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.376884:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159400/0x7ef423838fba3838 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.376923:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3743 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a73 expref: 27 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.376936:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3743 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a73 expref: 27 pid: 14031 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384548.376951:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91db100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1874208203367424:192.168.203.45@tcp:104: 00000100:00100000:3.0:1787384548.377030:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8c41600 going to sleep for 11 seconds 00000100:00100000:3.0:1787384548.380512:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384548.380589:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182348416 00000100:00100000:0.0:1787384548.380597:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182348416 00000100:00100000:0.0:1787384548.380647:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 63 00000100:00100000:0.0:1787384548.380656:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+28:6183:x1874208182348416:12345-192.168.203.45@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787384548.380898:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+29:6183:x1874208182348416:12345-192.168.203.45@tcp:35:ldlm_bl.0 Request processed in 233us (383us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1787384548.380906:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 63 00000100:00100000:1.0:1787384548.382683:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91db100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1874208203367424:192.168.203.45@tcp:104: 00010000:00010000:1.0:1787384548.382714:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159400/0x7ef423838fba3838 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384548.386221:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384548.386442:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182348544 00000100:00100000:1.0:1787384548.386451:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182348544 00010000:00010000:1.0:1787384548.386489:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3743 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a73 expref: 29 pid: 14031 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384548.386580:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 107 00000100:00100000:1.0:1787384548.386591:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+29:2416:x1874208182348544:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384548.386605:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384548.386613:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3743 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a73 expref: 29 pid: 14031 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384548.386643:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3743 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a73 expref: 29 pid: 14031 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384548.386675:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6140e00/0x7ef423838fba3743 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a73 expref: 29 pid: 14031 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384548.386693:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f8edc2e700) 00010000:00010000:1.0:1787384548.386698:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159400/0x7ef423838fba3838 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384548.386708:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159400/0x7ef423838fba3838 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384548.386716:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159400/0x7ef423838fba3838 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384548.386746:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384548.386850:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+28:2416:x1874208182348544:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 261us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384548.386858:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 107 00010000:00010000:3.0:1787384548.387023:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159400/0x7ef423838fba3838 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.387031:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159400/0x7ef423838fba3838 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384548.387083:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787384548.387087:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787384548.387105:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159400/0x7ef423838fba3838 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.387117:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159400/0x7ef423838fba3838 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.387127:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f902158000/0x7ef423838fba382a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.387145:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f902158000/0x7ef423838fba382a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.387152:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f902158000/0x7ef423838fba382a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.387157:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f902158000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384548.387161:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f902158000/0x7ef423838fba382a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.387168:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f902158000/0x7ef423838fba382a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.387178:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f8e8aa4100) 00010000:00010000:3.0:1787384548.387181:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384548.387185:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f902158000/0x7ef423838fba382a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.387191:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f902158000/0x7ef423838fba382a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.387202:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159a00/0x7ef423838fba3831 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.387207:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159a00/0x7ef423838fba3831 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.387213:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159a00/0x7ef423838fba3831 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.387217:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f902159a00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384548.387226:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159a00/0x7ef423838fba3831 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.387233:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159a00/0x7ef423838fba3831 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.387241:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff98f7c294f900) 00010000:00010000:3.0:1787384548.387244:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384548.387247:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159a00/0x7ef423838fba3831 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.387252:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159a00/0x7ef423838fba3831 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.387286:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f902158e00/0x7ef423838fba3823 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3ab2 expref: 28 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.387300:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159400/0x7ef423838fba3838 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3ab2 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384548.387307:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f8edc2e700) 00010000:00010000:3.0:1787384548.387309:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787384548.387312:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f902159400, rc 0) 00000100:00100000:3.0:1787384548.387338:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9148380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+27:12480:x1874208182348160:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 10757us (10936us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384548.387345:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 249 00000040:00080000:2.0:1787384549.279863:0:14717:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787384549.279878:0:14717:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787384549.280503:0:14717:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787384549.280513:0:14717:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787384549.302910:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787384549.302942:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787384549.302948:0:13801:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787384549.302987:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787384549.302997:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787384549.303131:0:13801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1874208203367552:192.168.203.45@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787384549.303229:0:13801:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c11ca780 going to sleep for 11 seconds 00000100:00100000:1.0:1787384549.304310:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787384549.304332:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203367680:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787384549.304382:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384549.304418:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203367680 00000100:00100000:1.0:1787384549.304425:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203367680 00000100:00100000:1.0:1787384549.304482:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787384549.304490:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203367680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787384549.304523:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787384549.304568:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203367680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384549.304575:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787384549.304623:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203367680:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787384549.306492:0:13801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1874208203367552:192.168.203.45@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787384549.313210:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384549.313330:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182348672 00000100:00100000:0.0:1787384549.313341:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182348672 00000100:00100000:0.0:1787384549.313405:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 250 00000100:00100000:0.0:1787384549.313416:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+27:12493:x1874208182348672:12345-192.168.203.45@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787384549.313451:0:14031:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787384549.313579:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:55e96ad5-fd9d-44d4-856e-5db0c40b1329+27:12493:x1874208182348672:12345-192.168.203.45@tcp:53:lhsmtool_posix.0 Request processed in 163us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384549.313587:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 250 00000100:00100000:1.0:1787384549.323295:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384549.323897:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182348928 00000100:00100000:2.0:1787384549.323917:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182348928 00000100:00100000:2.0:1787384549.323973:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 251 00000100:00100000:2.0:1787384549.323984:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+27:12493:x1874208182348928:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787384549.324014:0:8195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384549.324035:0:8195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba383f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3ab9 expref: -99 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384549.324141:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba3846 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384549.324156:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba3846 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384549.324168:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba3846 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384549.324179:0:8195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787384549.324298:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba383f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3ab9 expref: 30 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384549.324315:0:8195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba3846 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3ab9 expref: 29 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384549.324322:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f8edc2e700) 00010000:00010000:2.0:1787384549.324325:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787384549.324335:0:8195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965ba00, rc 0) 00000100:00100000:2.0:1787384549.324398:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+29:12493:x1874208182348928:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 415us (1110us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1787384549.324405:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 251 00000100:00100000:2.0:1787384549.343000:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384549.343067:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182349056 00000100:00100000:3.0:1787384549.343078:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182349056 00000100:00100000:2.0:1787384549.343105:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384549.343134:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 19 00000100:00100000:3.0:1787384549.343143:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+29:2416:x1874208182349056:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384549.343165:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384549.343200:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba3846 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3ab9 expref: 29 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384549.344048:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f8edc2e700) 00010000:00010000:3.0:1787384549.344052:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384549.344112:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+28:2416:x1874208182349056:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 968us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384549.344120:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 19 00000100:00100000:3.0:1787384549.344152:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182349312 00000100:00100000:3.0:1787384549.344156:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182349312 00000100:00100000:3.0:1787384549.344198:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 252 00000100:00100000:3.0:1787384549.345025:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+28:12493:x1874208182349312:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787384549.345100:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159a00/0x7ef423838fba3854 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384549.345116:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159a00/0x7ef423838fba3854 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384549.345127:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159a00/0x7ef423838fba3854 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384549.345445:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159a00/0x7ef423838fba3854 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384549.345454:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159a00/0x7ef423838fba3854 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384549.345460:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159a00/0x7ef423838fba3854 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384549.345479:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f902159a00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384549.345484:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159a00/0x7ef423838fba3854 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384549.345492:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159a00/0x7ef423838fba3854 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384549.345503:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f8edc2e700) 00010000:00010000:3.0:1787384549.345506:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787384549.345511:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159a00/0x7ef423838fba3854 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384549.345517:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159a00/0x7ef423838fba3854 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384549.345625:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+29:12493:x1874208182349312:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 Request processed in 609us (2517us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1787384549.345634:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 252 00000040:00080000:3.0:1787384549.345841:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787384549.345847:0:13801:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787384549.349541:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787384549.349562:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787384549.353386:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384549.353462:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182349568 00000100:00100000:2.0:1787384549.353471:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182349568 00000100:00100000:2.0:1787384549.353532:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 64 00000100:00100000:2.0:1787384549.353543:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+29:12493:x1874208182349568:12345-192.168.203.45@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787384549.353759:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+30:12493:x1874208182349568:12345-192.168.203.45@tcp:35:lhsmtool_posix.0 Request processed in 217us (381us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1787384549.353767:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 64 00000100:00100000:0.0:1787384549.817120:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787384549.817148:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203367808:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787384549.817231:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384549.817635:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203367808 00000100:00100000:3.0:1787384549.817645:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203367808 00000100:00100000:3.0:1787384549.817698:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787384549.817707:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203367808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787384549.817744:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787384549.817830:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203367808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384549.817850:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1787384549.819611:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203367808:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787384550.327342:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787384551.256639:0:14768:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787384551.256647:0:14768:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787384551.256675:0:14768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787384551.256682:0:14768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787384551.351979:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384551.453767:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384551.453824:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182349824 00000100:00100000:2.0:1787384551.453833:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182349824 00000100:00100000:2.0:1787384551.453905:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 253 00000100:00100000:2.0:1787384551.453915:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+30:12514:x1874208182349824:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:2.0:1787384551.453940:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384551.453960:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba385b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3ac0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384551.455162:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba3862 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384551.455183:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba3862 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384551.455206:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba3862 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384551.455222:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787384551.455347:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba385b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3ac0 expref: 33 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384551.458553:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba3862 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3ac0 expref: 32 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384551.458576:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f8edc2e700) 00010000:00010000:2.0:1787384551.458580:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787384551.458584:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965a200, rc 0) 00000100:00100000:2.0:1787384551.458656:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+32:12514:x1874208182349824:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 4739us (4894us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1787384551.458666:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 253 00000100:00080000:2.0:1787384551.458702:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384551.462748:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384551.463411:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182349952 00000100:00100000:3.0:1787384551.463421:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182349952 00000100:00100000:3.0:1787384551.463483:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 254 00000100:00100000:3.0:1787384551.463493:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+32:12514:x1874208182349952:12345-192.168.203.45@tcp:54:lfs.0 00010000:00010000:3.0:1787384551.463559:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f902158e00/0x7ef423838fba3870 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384551.463576:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f902158e00/0x7ef423838fba3870 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384551.463588:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f902158e00/0x7ef423838fba3870 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384551.463624:0:8195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f902158e00/0x7ef423838fba3870 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384551.463631:0:8195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f902158e00/0x7ef423838fba3870 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384551.463638:0:8195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f902158e00/0x7ef423838fba3870 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384551.463644:0:8195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f902158e00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384551.463649:0:8195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f902158e00/0x7ef423838fba3870 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384551.463657:0:8195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f902158e00/0x7ef423838fba3870 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384551.463676:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f8edc2e700) 00010000:00010000:3.0:1787384551.463679:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787384551.463683:0:8195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f902158e00/0x7ef423838fba3870 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384551.463690:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f902158e00/0x7ef423838fba3870 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384551.463758:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+32:12514:x1874208182349952:12345-192.168.203.45@tcp:54:lfs.0 Request processed in 266us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384551.463766:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 254 00000100:00100000:2.0:1787384551.569708:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384551.572077:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182350080 00000100:00100000:0.0:1787384551.572092:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182350080 00000100:00100000:0.0:1787384551.572242:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 79 00000100:00100000:0.0:1787384551.572253:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:2415:x1874208182350080:12345-192.168.203.45@tcp:101:cat.0 00010000:00010000:0.0:1787384551.572272:0:8890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384551.572294:0:8890:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009eaaa97/0x7ef423838fba3877 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3ac7 expref: -99 pid: 8890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787384551.572321:0:8890:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a8952e2, atime: 0x6a8952e2, ctime: 0x6a8952e2, blocks: 0x8 00010000:00010000:0.0:1787384551.572346:0:8890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1787384551.572351:0:8890:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384551.572376:0:8890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009eaaa97/0x7ef423838fba3877 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3ac7 expref: 8 pid: 8890 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384551.572394:0:8890:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000009eaaa97/0x7ef423838fba3877 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3ac7 expref: 8 pid: 8890 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384551.572428:0:8890:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6141800, rc 0) 00000100:00100000:0.0:1787384551.572642:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+8:2415:x1874208182350080:12345-192.168.203.45@tcp:101:cat.0 Request processed in 390us (2944us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384551.572650:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 79 00000100:00080000:2.0:1787384551.573114:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787384551.579631:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384551.580049:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182350208 00000100:00100000:3.0:1787384551.580058:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182350208 00002000:00100000:3.0:1787384551.580109:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff98f7c42f2a00 x1874208182350208/t0(0) o3->55e96ad5-fd9d-44d4-856e-5db0c40b1329@192.168.203.45@tcp:582/0 lens 488/0 e 0 to 0 dl 1787384562 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787384551.580119:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98f7c42f2a00 with x1874208182350208 ext(0->4095) 00002000:00010000:3.0:1787384551.580125:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98f7c42f2a00 00000100:00100000:3.0:1787384551.580258:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 7 00000100:00100000:3.0:1787384551.580272:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+8:2413:x1874208182350208:12345-192.168.203.45@tcp:3:cat.0 00000100:00100000:3.0:1787384551.580444:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+8:2413:x1874208182350208:12345-192.168.203.45@tcp:3:cat.0 Request processed in 176us (821us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787384551.580451:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 7 00002000:00100000:3.0:1787384551.580457:0:8444:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff98f7c42f2a00 x1874208182350208/t0(0) o3->55e96ad5-fd9d-44d4-856e-5db0c40b1329@192.168.203.45@tcp:582/0 lens 488/4536 e 0 to 0 dl 1787384562 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787384551.580464:0:8444:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98f7c42f2a00 with x1874208182350208 ext(0->4095) 00002000:00010000:3.0:1787384551.580481:0:8444:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98f7c42f2a00 00000100:00100000:3.0:1787384551.863298:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203367936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787384551.863526:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384551.867726:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203367936 00000100:00100000:0.0:1787384551.867741:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203367936 00000100:00100000:0.0:1787384551.867972:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787384551.867985:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3654:x1874208203367936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787384551.868082:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787384551.868171:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3654:x1874208203367936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 188us (4644us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384551.868180:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787384551.868248:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203367936:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787384551.868343:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787384551.868362:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203368064:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787384551.868398:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384551.868437:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203368064 00000100:00100000:0.0:1787384551.868442:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203368064 00000100:00100000:0.0:1787384551.868472:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787384551.868480:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203368064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787384551.868491:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787384551.868528:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203368064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384551.868536:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:0.0:1787384551.868566:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787384551.868596:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203368064:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787384552.375003:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384552.375313:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203368320:0@lo:400:kworker.0 00000100:00100000:1.0:1787384552.375378:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384552.375435:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9148a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203368832:0@lo:400:kworker.0 00000100:00100000:1.0:1787384552.375458:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384552.375479:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203369344:0@lo:400:kworker.0 00000100:00100000:1.0:1787384552.375533:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384552.375557:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787384552.375563:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203368448:0@lo:400:kworker.0 00000100:00100000:1.0:1787384552.375587:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384552.375603:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203368960:0@lo:400:kworker.0 00000100:00100000:1.0:1787384552.375621:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384552.375634:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874208203369472:0@lo:400:kworker.0 00000100:00100000:1.0:1787384552.375652:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384552.375674:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203368576:0@lo:400:kworker.0 00000100:00100000:1.0:1787384552.375694:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384552.375704:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203369088:0@lo:400:kworker.0 00000100:00100000:1.0:1787384552.375723:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384552.375737:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203369600:0@lo:400:kworker.0 00000100:00100000:1.0:1787384552.375758:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384552.375806:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1787384552.375812:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203368192:0@lo:400:kworker.0 00000100:00100000:1.0:1787384552.375837:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384552.375855:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203368704:0@lo:400:kworker.0 00000100:00100000:1.0:1787384552.375886:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384552.375899:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203369216:0@lo:400:kworker.0 00000100:00100000:1.0:1787384552.375918:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384552.375931:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203369728:0@lo:400:kworker.0 00000100:00100000:1.0:1787384552.375949:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384552.376037:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203368320 00000100:00100000:2.0:1787384552.376045:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203368320 00000100:00100000:2.0:1787384552.376081:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203368832 00000100:00100000:2.0:1787384552.376084:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203368832 00000100:00100000:2.0:1787384552.376113:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203369344 00000100:00100000:2.0:1787384552.376116:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203369344 00000100:00100000:2.0:1787384552.376129:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203368960 00000100:00100000:2.0:1787384552.376132:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203368960 00000100:00100000:2.0:1787384552.376143:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203369472 00000100:00100000:2.0:1787384552.376154:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203369472 00000100:00100000:2.0:1787384552.376172:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203368576 00000100:00100000:2.0:1787384552.376174:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203368576 00000100:00100000:2.0:1787384552.376189:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1787384552.376197:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203368320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384552.376253:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203368320:12345-0@lo:400:kworker.0 Request processed in 57us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384552.376260:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1787384552.376276:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1787384552.376282:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203368832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384552.376308:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203368832:12345-0@lo:400:kworker.0 Request processed in 27us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384552.376314:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1787384552.376325:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1787384552.376331:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874208203369344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384552.376356:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874208203369344:12345-0@lo:400:kworker.0 Request processed in 26us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384552.376362:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1787384552.376372:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1787384552.376377:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203368960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384552.376403:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203368960:12345-0@lo:400:kworker.0 Request processed in 26us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384552.376409:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1787384552.376421:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1787384552.376427:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874208203369472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384552.376453:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874208203369472:12345-0@lo:400:kworker.0 Request processed in 26us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384552.376466:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1787384552.376477:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1787384552.376483:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203368576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384552.376517:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203368576:12345-0@lo:400:kworker.0 Request processed in 33us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384552.376522:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1787384552.376543:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203368448 00000100:00100000:2.0:1787384552.376547:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203368448 00000100:00100000:2.0:1787384552.376567:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203368704 00000100:00100000:2.0:1787384552.376569:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203368704 00000100:00100000:2.0:1787384552.376581:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1787384552.376586:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203368448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384552.376617:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203368448:12345-0@lo:400:kworker.0 Request processed in 30us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384552.376623:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1787384552.376633:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787384552.376639:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203368704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384552.376666:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203368704:12345-0@lo:400:kworker.0 Request processed in 27us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384552.376672:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787384552.376691:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203369088 00000100:00100000:2.0:1787384552.376694:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203369088 00000100:00100000:2.0:1787384552.376709:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203369600 00000100:00100000:2.0:1787384552.376711:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203369600 00000100:00100000:2.0:1787384552.376722:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203369216 00000100:00100000:2.0:1787384552.376724:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203369216 00000100:00100000:2.0:1787384552.376733:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203369728 00000100:00100000:2.0:1787384552.376741:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203369728 00000100:00100000:2.0:1787384552.376757:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787384552.376762:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203369088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384552.376820:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203369088:12345-0@lo:400:kworker.0 Request processed in 57us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384552.376826:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787384552.376838:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787384552.376843:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd627850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203369600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384552.376883:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd627850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203369600:12345-0@lo:400:kworker.0 Request processed in 40us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384552.376888:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787384552.377045:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787384552.377052:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3651:x1874208203369216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384552.377080:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3651:x1874208203369216:12345-0@lo:400:kworker.0 Request processed in 28us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384552.377086:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787384552.377097:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787384552.377102:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203369728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384552.377127:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203369728:12345-0@lo:400:kworker.0 Request processed in 25us (1177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384552.377133:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787384552.377150:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203368192 00000100:00100000:2.0:1787384552.377153:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203368192 00000100:00100000:2.0:1787384552.377176:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1787384552.377183:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3651:x1874208203368192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384552.377210:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3651:x1874208203368192:12345-0@lo:400:kworker.0 Request processed in 28us (1373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384552.377222:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1787384552.377276:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203368448:0@lo:400:kworker.0 00010000:00080000:2.0:1787384552.377290:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f9148000 x1874208203368960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384552.377299:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203368960:0@lo:400:kworker.0 00010000:00080000:2.0:1787384552.377309:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f9148700 x1874208203369472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384552.377317:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874208203369472:0@lo:400:kworker.0 00000100:00100000:2.0:1787384552.377327:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203368320:0@lo:400:kworker.0 00000100:00100000:2.0:1787384552.377337:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9148a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203368832:0@lo:400:kworker.0 00000100:00100000:2.0:1787384552.377346:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203369344:0@lo:400:kworker.0 00000100:00100000:2.0:1787384552.377385:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203368192:0@lo:400:kworker.0 00000100:00100000:2.0:1787384552.377395:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203368704:0@lo:400:kworker.0 00000100:00100000:2.0:1787384552.377405:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203369216:0@lo:400:kworker.0 00000100:00100000:2.0:1787384552.377413:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1787384552.377417:0:3651:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:2.0:1787384552.377438:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98f8d9b55880, transno 4294967308 00000004:00080000:2.0:1787384552.377447:0:3651:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:2.0:1787384552.377456:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98f7c35d9f80, transno 4294967311 00000100:00100000:2.0:1787384552.377461:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203369728:0@lo:400:kworker.0 00000100:00100000:2.0:1787384552.377474:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203368576:0@lo:400:kworker.0 00000100:00100000:2.0:1787384552.377492:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203369088:0@lo:400:kworker.0 00000100:00100000:2.0:1787384552.377502:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203369600:0@lo:400:kworker.0 00000100:00100000:0.0:1787384552.378386:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787384552.378401:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203369856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384552.378444:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787384552.378618:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787384552.378633:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787384552.378636:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787384552.381916:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203369856 00000100:00100000:3.0:1787384552.381930:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203369856 00000100:00100000:3.0:1787384552.381999:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787384552.382009:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203369856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787384552.382039:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787384552.382133:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203369856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (3686us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384552.382141:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787384552.383400:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203369856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384552.889709:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787384552.889729:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203369984:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787384552.889818:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384552.889894:0:13608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203369984 00000100:00100000:0.0:1787384552.889903:0:13608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203369984 00000100:00100000:0.0:1787384552.889947:0:13608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787384552.889969:0:13608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203369984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787384552.890000:0:13608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787384552.890055:0:13608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203369984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384552.890062:0:13608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787384552.890107:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203369984:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787384553.321755:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384553.321817:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384553.321842:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384553.321871:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384553.321892:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384553.321913:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384553.321933:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384553.321961:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182350592 00000100:00100000:1.0:1787384553.321970:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182350592 00000100:00100000:1.0:1787384553.322025:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182351104 00000100:00100000:1.0:1787384553.322028:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182351104 00000100:00100000:1.0:1787384553.322043:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182350464 00000100:00100000:1.0:1787384553.322045:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182350464 00000100:00100000:1.0:1787384553.322057:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182350976 00000100:00100000:1.0:1787384553.322059:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182350976 00000100:00100000:1.0:1787384553.322075:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 360 00000100:00100000:1.0:1787384553.322083:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2413:x1874208182350592:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384553.322158:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2413:x1874208182350592:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 75us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384553.322166:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 360 00000100:00100000:1.0:1787384553.322183:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 361 00000100:00100000:1.0:1787384553.322190:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2413:x1874208182351104:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384553.322215:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2413:x1874208182351104:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 26us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384553.322221:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 361 00000100:00100000:1.0:1787384553.322247:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 362 00000100:00100000:1.0:1787384553.322253:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+32:2413:x1874208182350464:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384553.322283:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+32:2413:x1874208182350464:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 30us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384553.322288:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 362 00000100:00100000:1.0:1787384553.322300:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 363 00000100:00100000:1.0:1787384553.322306:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2413:x1874208182350976:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384553.322326:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2413:x1874208182350976:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 21us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384553.322332:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 363 00000100:00080000:1.0:1787384553.322356:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787384553.322359:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787384553.322515:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182350336 00000100:00100000:2.0:1787384553.322520:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182350336 00000100:00100000:2.0:1787384553.322558:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 393 00000100:00100000:2.0:1787384553.322566:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+13:2413:x1874208182350336:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384553.322599:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09777221-fe6d-4549-9ee6-04300d230fb6+13:2413:x1874208182350336:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 34us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384553.322605:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 393 00000100:00100000:2.0:1787384553.322634:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182350848 00000100:00100000:2.0:1787384553.322638:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182350848 00000100:00100000:2.0:1787384553.322666:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182350720 00000100:00100000:2.0:1787384553.322669:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182350720 00000100:00100000:2.0:1787384553.322691:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 132 00000100:00100000:2.0:1787384553.322698:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2413:x1874208182350848:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384553.322724:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2413:x1874208182350848:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 27us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384553.322730:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 132 00000100:00100000:2.0:1787384553.322741:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 133 00000100:00100000:2.0:1787384553.322747:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+8:2413:x1874208182350720:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384553.322772:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+8:2413:x1874208182350720:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 25us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384553.322799:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 133 00000100:00080000:2.0:1787384553.322851:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787384553.322872:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787384553.408042:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787384553.913535:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:1.0:1787384553.913551:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:2.0:1787384553.913896:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1787384553.913923:0:6501:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98f8f87490c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1787384553.913928:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff98f7c209ee00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98f8d829ae40 00000020:00080000:2.0:1787384553.913932:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff98f7c209ed00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98f7c3406000 00000020:00080000:2.0:1787384553.913956:0:6501:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:0.0:1787384553.914028:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba37f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384553.914053:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba37f2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384553.914061:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba37f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384553.914067:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6141c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384553.914086:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba37f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384553.914096:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba37f2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384553.914125:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff98f8edc2e000) 00010000:00010000:0.0:1787384553.914129:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384553.914134:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba37f2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384553.914141:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141c00/0x7ef423838fba37f2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787384553.914400:0:6553:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1787384553.915307:0:6553:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:2.0:1787384554.423146:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203370112:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787384554.423253:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384554.423705:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203370112 00000100:00100000:1.0:1787384554.423713:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203370112 00000100:00100000:1.0:1787384554.423772:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1787384554.423806:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203370112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787384554.423859:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787384554.423913:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203370112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384554.423921:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787384554.424108:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203370112:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787384554.424577:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384554.946561:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787384554.946584:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203370240:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787384554.946648:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384554.947370:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203370240 00000100:00100000:3.0:1787384554.947378:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203370240 00000100:00100000:3.0:1787384554.947435:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787384554.947445:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203370240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787384554.947479:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787384554.947665:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203370240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 220us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384554.947673:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1787384554.956209:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203370240:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787384555.447141:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384556.471956:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384556.983903:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787384556.983926:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203370368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787384556.983994:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384556.984053:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203370496:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787384556.984076:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384556.990592:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203370496 00000100:00100000:0.0:1787384556.990592:0:13608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203370368 00000100:00100000:3.0:1787384556.990606:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203370496 00000100:00100000:0.0:1787384556.990606:0:13608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203370368 00000100:00080000:2.0:1787384556.990683:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787384556.990817:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787384556.990842:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203370496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787384556.990887:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787384556.990990:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203370496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 163us (6911us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384556.990998:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787384556.991196:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203370496:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787384556.994000:0:13608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787384556.994019:0:13608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203370368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787384556.994044:0:13608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787384556.994122:0:13608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203370368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (10127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384556.994128:0:13608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787384556.994177:0:3654:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:0.0:1787384556.994183:0:3654:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98f8cb124e00, transno 4294967323 00000004:00080000:0.0:1787384556.994194:0:3654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:0.0:1787384556.994221:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203370368:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1787384557.112429:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787384557.495156:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd759f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203370752:0@lo:400:kworker.0 00000100:00100000:1.0:1787384557.495219:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384557.495274:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd75ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203371264:0@lo:400:kworker.0 00000100:00100000:1.0:1787384557.495325:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384557.495350:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd75aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203371776:0@lo:400:kworker.0 00000100:00100000:1.0:1787384557.495372:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384557.495394:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787384557.495399:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd758a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203370880:0@lo:400:kworker.0 00000100:00100000:2.0:1787384557.495615:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd759880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874208203371008:0@lo:400:kworker.0 00000100:00100000:2.0:1787384557.495647:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384557.495677:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd758380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203371520:0@lo:400:kworker.0 00000100:00100000:2.0:1787384557.495699:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384557.495719:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787384557.495725:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203370624:0@lo:400:kworker.0 00000100:00100000:2.0:1787384557.495753:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384557.495774:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203371136:0@lo:400:kworker.0 00000100:00100000:2.0:1787384557.495838:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384557.495856:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd75bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874208203371648:0@lo:400:kworker.0 00000100:00100000:2.0:1787384557.495877:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384557.495904:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203370752 00000100:00100000:2.0:1787384557.495912:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203370752 00000100:00100000:2.0:1787384557.495949:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203371264 00000100:00100000:2.0:1787384557.495952:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203371264 00000100:00100000:2.0:1787384557.495976:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203371008 00000100:00100000:2.0:1787384557.495978:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203371008 00000100:00100000:2.0:1787384557.495996:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203371520 00000100:00100000:2.0:1787384557.495999:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203371520 00000100:00100000:2.0:1787384557.496025:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203371648 00000100:00100000:2.0:1787384557.496028:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203371648 00000100:00100000:2.0:1787384557.496042:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1787384557.496049:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd758000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203370752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384557.496095:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd758000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203370752:12345-0@lo:400:kworker.0 Request processed in 46us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384557.496101:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1787384557.496118:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1787384557.496124:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd759180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203371264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384557.496151:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd759180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203371264:12345-0@lo:400:kworker.0 Request processed in 27us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384557.496166:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1787384557.496180:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1787384557.496185:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874208203371008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384557.496216:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874208203371008:12345-0@lo:400:kworker.0 Request processed in 31us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384557.496221:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1787384557.496233:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1787384557.496239:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874208203371520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384557.496264:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874208203371520:12345-0@lo:400:kworker.0 Request processed in 25us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384557.496276:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1787384557.496298:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1787384557.496305:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874208203371648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384557.496331:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874208203371648:12345-0@lo:400:kworker.0 Request processed in 26us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384557.496336:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1787384557.496354:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203371136 00000100:00100000:2.0:1787384557.496357:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203371136 00000100:00100000:2.0:1787384557.496378:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787384557.496384:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203371136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384557.496423:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203371136:12345-0@lo:400:kworker.0 Request processed in 39us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384557.496429:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00080000:2.0:1787384557.496447:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787384557.496451:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384557.496488:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203371136:0@lo:400:kworker.0 00010000:00080000:2.0:1787384557.496500:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8fd75bb80 x1874208203371648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384557.496510:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd75bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874208203371648:0@lo:400:kworker.0 00000100:00100000:2.0:1787384557.496518:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd759880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874208203371008:0@lo:400:kworker.0 00000100:00100000:2.0:1787384557.496526:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd758380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203371520:0@lo:400:kworker.0 00000100:00100000:2.0:1787384557.496589:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203371776 00000100:00100000:2.0:1787384557.496593:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203371776 00000100:00100000:2.0:1787384557.496620:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787384557.496627:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd758e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203371776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384557.496657:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd758e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203371776:12345-0@lo:400:kworker.0 Request processed in 31us (1284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384557.496663:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:2.0:1787384557.496679:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787384557.497114:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203370624 00000100:00100000:3.0:1787384557.497119:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203370624 00000100:00100000:3.0:1787384557.497161:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1787384557.497170:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3653:x1874208203370624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384557.497205:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3653:x1874208203370624:12345-0@lo:400:kworker.0 Request processed in 38us (1452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384557.497210:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1787384557.497330:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384557.497364:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd75b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874208203371392:0@lo:400:kworker.0 00000100:00100000:1.0:1787384557.497387:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384557.497533:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203370880 00000100:00100000:3.0:1787384557.497538:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203370880 00000100:00100000:3.0:1787384557.497563:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1787384557.497569:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd75b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203370880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384557.497602:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd75b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203370880:12345-0@lo:400:kworker.0 Request processed in 33us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384557.497608:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1787384557.497637:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203371392 00000100:00100000:3.0:1787384557.497640:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203371392 00000100:00100000:3.0:1787384557.497669:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1787384557.497675:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd759500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874208203371392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384557.497703:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd759500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874208203371392:12345-0@lo:400:kworker.0 Request processed in 27us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384557.497709:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00080000:3.0:1787384557.497725:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787384557.497873:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8fd75b480 x1874208203371392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384557.497886:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd75b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874208203371392:0@lo:400:kworker.0 00000100:00100000:1.0:1787384557.497894:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd75a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203371904:0@lo:400:kworker.0 00000100:00100000:1.0:1787384557.497922:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384557.497961:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd759f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203370752:0@lo:400:kworker.0 00000100:00100000:1.0:1787384557.497973:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd75ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203371264:0@lo:400:kworker.0 00000100:00100000:3.0:1787384557.498129:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203371904 00000100:00100000:3.0:1787384557.498134:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203371904 00000100:00100000:3.0:1787384557.498169:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787384557.498186:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd759c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203371904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384557.498218:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd759c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203371904:12345-0@lo:400:kworker.0 Request processed in 32us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384557.498224:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:3.0:1787384557.498242:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787384557.498279:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd75aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203371776:0@lo:400:kworker.0 00000100:00100000:0.0:1787384557.498412:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787384557.498425:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203372032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384557.498462:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787384557.498525:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384557.498659:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203370624:0@lo:400:kworker.0 00000100:00100000:1.0:1787384557.498730:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd758a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203370880:0@lo:400:kworker.0 00000100:00100000:1.0:1787384557.498741:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd75a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203371904:0@lo:400:kworker.0 00000100:00100000:3.0:1787384557.499163:0:13608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203372032 00000100:00100000:3.0:1787384557.499170:0:13608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203372032 00000100:00100000:3.0:1787384557.499211:0:13608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787384557.499220:0:13608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203372032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787384557.499243:0:13608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787384557.499304:0:13608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203372032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384557.499310:0:13608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787384557.499506:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203372032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787384557.734494:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384557.735246:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182351232 00000100:00100000:2.0:1787384557.735259:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182351232 00000100:00100000:2.0:1787384557.735360:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 255 00000100:00100000:2.0:1787384557.735371:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd75a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+18:12165:x1874208182351232:12345-192.168.203.45@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787384557.735504:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd75a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+18:12165:x1874208182351232:12345-192.168.203.45@tcp:60:lhsmtool_posix.0 Request processed in 134us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384557.735512:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 255 00000100:00080000:3.0:1787384557.737205:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384557.750523:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384557.750641:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182351360 00000100:00100000:1.0:1787384557.750652:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182351360 00000100:00080000:3.0:1787384557.750724:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787384557.750728:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 256 00000100:00100000:1.0:1787384557.750739:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:12165:x1874208182351360:12345-192.168.203.45@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787384557.750900:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:12165:x1874208182351360:12345-192.168.203.45@tcp:60:lhsmtool_posix.0 Request processed in 162us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384557.750908:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 256 00000100:00100000:0.0:1787384557.756623:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384557.756744:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182351616 00000100:00100000:3.0:1787384557.756753:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182351616 00000100:00100000:3.0:1787384557.756847:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 65 00000100:00100000:3.0:1787384557.756859:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+18:12165:x1874208182351616:12345-192.168.203.45@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787384557.757131:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+19:12165:x1874208182351616:12345-192.168.203.45@tcp:35:lhsmtool_posix.0 Request processed in 274us (516us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1787384557.757139:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 65 00000100:00100000:2.0:1787384558.007163:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203372160:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787384558.007253:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384558.011223:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203372160 00000100:00100000:3.0:1787384558.011238:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203372160 00000100:00100000:3.0:1787384558.011315:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787384558.011326:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203372160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787384558.011364:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787384558.011462:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203372160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 138us (4209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384558.011470:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787384558.011521:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203372160:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787384558.135237:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384558.135809:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182351744 00000100:00100000:2.0:1787384558.135835:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182351744 00000100:00100000:2.0:1787384558.136132:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 257 00000100:00100000:2.0:1787384558.136143:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:12972:x1874208182351744:12345-192.168.203.45@tcp:101:lsof.0 00010000:00010000:2.0:1787384558.136165:0:8195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384558.136188:0:8195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba387e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3ace expref: -99 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384558.136513:0:8195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3885 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384558.136528:0:8195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3885 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384558.136540:0:8195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3885 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384558.136592:0:8195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787384558.136596:0:8195:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787384558.136617:0:8195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3885 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384558.136642:0:8195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a800/0x7ef423838fba387e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3ace expref: 7 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384558.136662:0:8195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3885 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3ace expref: 6 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384558.136688:0:8195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f8edc2ee00) 00010000:00010000:2.0:1787384558.136692:0:8195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787384558.136696:0:8195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965ae00, rc 0) 00000100:00100000:2.0:1787384558.136868:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+6:12972:x1874208182351744:12345-192.168.203.45@tcp:101:lsof.0 Request processed in 725us (1639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384558.136948:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 257 00000100:00080000:3.0:1787384558.137531:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384558.436319:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384558.436361:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384558.436516:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182351872 00000100:00100000:1.0:1787384558.436526:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182351872 00000100:00100000:1.0:1787384558.436581:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 395 00000100:00100000:1.0:1787384558.436592:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+13:2414:x1874208182351872:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384558.436672:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09777221-fe6d-4549-9ee6-04300d230fb6+13:2414:x1874208182351872:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 81us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384558.436681:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 395 00000100:00100000:2.0:1787384558.437171:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384558.437205:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384558.437219:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182352384 00000100:00100000:3.0:1787384558.437225:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182352384 00000100:00100000:2.0:1787384558.437241:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384558.437275:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182352256 00000100:00100000:2.0:1787384558.437276:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384558.437281:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182352256 00000100:00100000:3.0:1787384558.437312:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 136 00000100:00100000:3.0:1787384558.437321:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2414:x1874208182352384:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384558.437341:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182352128 00000100:00100000:0.0:1787384558.437347:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182352128 00000100:00100000:3.0:1787384558.437363:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2414:x1874208182352384:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 43us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384558.437370:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 136 00000100:00100000:0.0:1787384558.437393:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182352000 00000100:00100000:0.0:1787384558.437398:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182352000 00000100:00100000:3.0:1787384558.437402:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 137 00000100:00100000:3.0:1787384558.437412:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:2414:x1874208182352256:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384558.437425:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182352512 00000100:00100000:0.0:1787384558.437429:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182352512 00000100:00100000:3.0:1787384558.437444:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:2414:x1874208182352256:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 35us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384558.437451:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 137 00000100:00100000:0.0:1787384558.437455:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 370 00000100:00100000:0.0:1787384558.437467:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2414:x1874208182352128:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384558.437515:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 371 00000100:00100000:1.0:1787384558.437524:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+19:2414:x1874208182352000:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384558.437560:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e96ad5-fd9d-44d4-856e-5db0c40b1329+19:2414:x1874208182352000:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 38us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384558.437567:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 371 00000100:00100000:1.0:1787384558.437582:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 372 00000100:00100000:1.0:1787384558.437588:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182352512:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384558.437609:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2414:x1874208182352512:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 22us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384558.437616:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 372 00000100:00100000:0.0:1787384558.437671:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2414:x1874208182352128:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 207us (1308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384558.437678:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 370 00000100:00080000:1.0:1787384558.443301:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787384558.443314:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787384558.443318:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787384558.519054:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787384558.583030:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787384558.583053:0:13801:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787384558.583602:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1787384558.583613:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787384559.543389:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787384559.543412:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd758a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203372288:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787384559.543482:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384559.543652:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203372288 00000100:00100000:1.0:1787384559.543660:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203372288 00000100:00100000:1.0:1787384559.543717:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1787384559.543726:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203372288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787384559.543758:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00010000:00010000:3.0:1787384559.543826:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384559.543845:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203372288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384559.543854:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1787384559.543886:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd758a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203372288:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787384560.055206:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787384560.055228:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203372416:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787384560.055291:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384560.055471:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203372416 00000100:00100000:2.0:1787384560.055481:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203372416 00000100:00100000:2.0:1787384560.055524:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1787384560.055532:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd75aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203372416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787384560.055565:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1787384560.055622:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd75aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203372416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384560.055628:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787384560.055723:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203372416:0@lo:41:osp-pre-0-1.0 00000001:00080000:3.0:1787384560.059626:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00080000:3.0:1787384560.059642:0:6501:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1787384560.059661:0:6553:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1787384560.059671:0:6553:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1787384560.566926:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384561.594883:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787384561.892508:0:14965:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 03:42:39 (1787384559) 00000100:00100000:3.0:1787384562.103501:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203372672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787384562.103568:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384562.103625:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787384562.103641:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203372544:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787384562.103663:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384562.103908:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203372672 00000100:00100000:2.0:1787384562.103915:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203372672 00000100:00100000:2.0:1787384562.104091:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203372544 00000100:00100000:2.0:1787384562.104095:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203372544 00000100:00100000:2.0:1787384562.104114:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787384562.104122:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203372672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787384562.104160:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787384562.104209:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203372672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384562.104217:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787384562.104233:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787384562.104240:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203372544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787384562.104249:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787384562.105374:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203372544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1130us (1705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384562.105384:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:2.0:1787384562.105410:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787384562.105452:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203372544:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787384562.105468:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203372672:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787384562.615905:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384562.616532:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203372800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384562.616601:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384562.616711:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203372800 00000100:00100000:3.0:1787384562.616719:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203372800 00000100:00100000:3.0:1787384562.616814:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00080000:0.0:1787384562.616817:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787384562.616828:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203372800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787384562.616859:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787384562.616925:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203372800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384562.616933:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787384562.618520:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203372800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384562.621001:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203373056:0@lo:400:kworker.0 00000100:00100000:0.0:1787384562.621084:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384562.621121:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203373568:0@lo:400:kworker.0 00000100:00100000:0.0:1787384562.621142:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384562.621162:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4304000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203374080:0@lo:400:kworker.0 00000100:00100000:0.0:1787384562.621184:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384562.621207:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787384562.621212:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203373184:0@lo:400:kworker.0 00000100:00100000:0.0:1787384562.621234:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384562.621249:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203373696:0@lo:400:kworker.0 00000100:00100000:0.0:1787384562.621269:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384562.621313:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203373056 00000100:00100000:0.0:1787384562.621320:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203373056 00000100:00100000:0.0:1787384562.621990:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203373568 00000100:00100000:0.0:1787384562.621995:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203373568 00000100:00100000:0.0:1787384562.622075:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203373696 00000100:00100000:0.0:1787384562.622079:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203373696 00000100:00100000:1.0:1787384562.623021:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203374080 00000100:00100000:1.0:1787384562.623028:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203374080 00000100:00080000:3.0:1787384562.625685:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787384562.625693:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787384562.625697:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787384562.626179:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1787384562.626191:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203373056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384562.627748:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203373056:12345-0@lo:400:kworker.0 Request processed in 98us (5201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384562.627767:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1787384562.627833:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1787384562.627848:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203373568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384562.627912:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203373568:12345-0@lo:400:kworker.0 Request processed in 71us (6767us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384562.627918:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1787384562.627941:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1787384562.627949:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203373696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384562.627978:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203373696:12345-0@lo:400:kworker.0 Request processed in 31us (6708us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384562.627996:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1787384562.628020:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203373184 00000100:00100000:0.0:1787384562.628028:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203373184 00000100:00100000:0.0:1787384562.628498:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1787384562.628506:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203373184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384562.628543:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203373184:12345-0@lo:400:kworker.0 Request processed in 38us (7307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384562.628549:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1787384562.633855:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203373184:0@lo:400:kworker.0 00010000:00080000:3.0:1787384562.633879:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8cb125500 x1874208203373696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384562.633890:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203373696:0@lo:400:kworker.0 00000100:00100000:3.0:1787384562.633903:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203373056:0@lo:400:kworker.0 00000100:00100000:3.0:1787384562.633913:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203373568:0@lo:400:kworker.0 00000100:00100000:1.0:1787384562.639245:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787384562.639271:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203374080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384562.639445:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203374080:12345-0@lo:400:kworker.0 Request processed in 186us (18258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384562.639453:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787384562.639523:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203372928:0@lo:400:kworker.0 00000100:00100000:1.0:1787384562.639564:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384562.639617:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb126300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203373440:0@lo:400:kworker.0 00000100:00100000:1.0:1787384562.639643:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384562.639675:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874208203373952:0@lo:400:kworker.0 00000100:00100000:1.0:1787384562.639697:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384562.639722:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787384562.639729:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874208203373312:0@lo:400:kworker.0 00000100:00100000:1.0:1787384562.639747:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384562.643976:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4304000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203374080:0@lo:400:kworker.0 00000100:00100000:1.0:1787384562.646877:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4307100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874208203373824:0@lo:400:kworker.0 00000100:00100000:1.0:1787384562.646935:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384562.646972:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203372928 00000100:00100000:1.0:1787384562.646978:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203372928 00000100:00100000:1.0:1787384562.647028:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1787384562.647036:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3652:x1874208203372928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384562.647834:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3652:x1874208203372928:12345-0@lo:400:kworker.0 Request processed in 797us (8267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384562.647842:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1787384562.647877:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203373440 00000100:00100000:1.0:1787384562.647882:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203373440 00000100:00100000:1.0:1787384562.647907:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1787384562.647913:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd75ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203373440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384562.647945:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd75ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203373440:12345-0@lo:400:kworker.0 Request processed in 33us (8301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384562.647950:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1787384562.647965:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203373952 00000100:00100000:1.0:1787384562.647969:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203373952 00000100:00100000:1.0:1787384562.648002:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203373312 00000100:00100000:1.0:1787384562.648005:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203373312 00000100:00100000:1.0:1787384562.648021:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203373824 00000100:00100000:1.0:1787384562.648023:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203373824 00000100:00100000:1.0:1787384562.648037:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1787384562.648065:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd759f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874208203373952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384562.648102:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd759f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874208203373952:12345-0@lo:400:kworker.0 Request processed in 38us (8403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384562.648108:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1787384562.648122:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1787384562.648127:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd75b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874208203373312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384562.648154:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd75b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874208203373312:12345-0@lo:400:kworker.0 Request processed in 26us (8404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384562.648159:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1787384562.648170:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1787384562.648176:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd75a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874208203373824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384562.648200:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd75a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874208203373824:12345-0@lo:400:kworker.0 Request processed in 25us (1265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384562.648206:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00080000:1.0:1787384562.648226:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787384562.648229:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787384562.651656:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874208203373312:0@lo:400:kworker.0 00000100:00100000:0.0:1787384562.651674:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4307100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874208203373824:0@lo:400:kworker.0 00000100:00100000:0.0:1787384562.651684:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203372928:0@lo:400:kworker.0 00000100:00100000:0.0:1787384562.651695:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb126300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203373440:0@lo:400:kworker.0 00010000:00080000:0.0:1787384562.651709:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4307b80 x1874208203373952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384562.651720:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874208203373952:0@lo:400:kworker.0 00000100:00100000:2.0:1787384563.127497:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787384563.127520:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203374208:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787384563.127587:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384563.127652:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203374208 00000100:00100000:2.0:1787384563.127659:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203374208 00000100:00100000:2.0:1787384563.127705:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787384563.127714:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203374208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787384563.127738:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384563.127810:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203374208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384563.127819:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787384563.127875:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203374208:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787384563.555238:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384563.555271:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384563.555307:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384563.555324:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384563.555501:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182353024 00000100:00100000:0.0:1787384563.555511:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182353024 00000100:00100000:1.0:1787384563.555552:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384563.555563:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182353152 00000100:00100000:0.0:1787384563.555566:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182353152 00000100:00100000:1.0:1787384563.555578:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384563.555589:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 139 00000100:00100000:1.0:1787384563.555595:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182352768 00000100:00100000:1.0:1787384563.555598:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182352768 00000100:00100000:0.0:1787384563.555598:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd758380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:2415:x1874208182353024:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384563.555623:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182352896 00000100:00100000:1.0:1787384563.555625:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182352896 00000100:00100000:1.0:1787384563.555638:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182353408 00000100:00100000:1.0:1787384563.555646:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182353408 00000100:00100000:1.0:1787384563.555663:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 379 00000100:00100000:1.0:1787384563.555669:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+18:2415:x1874208182352768:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384563.555679:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd758380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:2415:x1874208182353024:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 83us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384563.555686:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 139 00000100:00100000:1.0:1787384563.555697:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+18:2415:x1874208182352768:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 28us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384563.555701:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 140 00000100:00100000:1.0:1787384563.555705:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 379 00000100:00100000:0.0:1787384563.555707:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd75bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2416:x1874208182353152:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384563.555715:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 380 00000100:00100000:1.0:1787384563.555721:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2416:x1874208182352896:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384563.555726:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd75bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2416:x1874208182353152:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 20us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384563.555732:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 140 00000100:00100000:1.0:1787384563.555739:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2416:x1874208182352896:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 18us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384563.555745:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 380 00000100:00100000:1.0:1787384563.555755:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 381 00000100:00100000:1.0:1787384563.555760:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd758700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2416:x1874208182353408:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384563.555815:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd758700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2416:x1874208182353408:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 54us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384563.555822:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 381 00000100:00080000:1.0:1787384563.555838:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787384563.555842:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787384563.555844:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787384563.555846:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787384563.556622:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182352640 00000100:00100000:3.0:1787384563.556637:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182352640 00000100:00100000:3.0:1787384563.556679:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 397 00000100:00100000:3.0:1787384563.556687:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+13:2416:x1874208182352640:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384563.556737:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+13:2416:x1874208182352640:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 50us (1428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384563.556744:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 397 00000100:00100000:0.0:1787384563.556855:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384563.558091:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182353280 00000100:00100000:3.0:1787384563.558097:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182353280 00000100:00100000:3.0:1787384563.558153:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 382 00000100:00100000:3.0:1787384563.558162:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+6:2415:x1874208182353280:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384563.558210:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+6:2415:x1874208182353280:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 49us (1355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384563.558217:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 382 00000100:00080000:3.0:1787384563.558238:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787384563.645544:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384564.665137:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384564.666890:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787384564.666924:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203374336:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787384564.667000:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384564.667057:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203374336 00000100:00100000:1.0:1787384564.667068:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203374336 00000100:00100000:1.0:1787384564.667121:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1787384564.667130:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203374336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787384564.667165:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787384564.667218:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203374336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384564.667238:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1787384564.667492:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203374336:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787384565.175529:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203374464:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787384565.175594:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384565.175705:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203374464 00000100:00100000:3.0:1787384565.175712:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203374464 00000100:00100000:3.0:1787384565.175758:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1787384565.175765:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203374464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787384565.175819:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787384565.175878:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203374464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384565.175884:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1787384565.175960:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203374464:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787384565.687019:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384566.324316:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384566.325095:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182353664 00000100:00100000:2.0:1787384566.325104:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182353664 00000100:00100000:2.0:1787384566.325173:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 66 00000100:00100000:2.0:1787384566.325183:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+18:13195:x1874208182353664:12345-192.168.203.45@tcp:35:umount.0 00000100:00080000:3.0:1787384566.327197:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384566.328873:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+19:13195:x1874208182353664:12345-192.168.203.45@tcp:35:umount.0 Request processed in 3679us (4553us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1787384566.328886:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 66 00000100:00100000:0.0:1787384566.341844:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384566.342097:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182353920 00000100:00100000:2.0:1787384566.342107:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182353920 00000100:00100000:2.0:1787384566.342165:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 67 00000100:00100000:2.0:1787384566.342175:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+19:13195:x1874208182353920:12345-192.168.203.45@tcp:35:umount.0 00000100:00100000:2.0:1787384566.342470:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+20:13195:x1874208182353920:12345-192.168.203.45@tcp:35:umount.0 Request processed in 296us (634us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1787384566.342478:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 67 00000100:00100000:1.0:1787384566.348424:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384566.348530:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182354176 00000100:00100000:0.0:1787384566.348541:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182354176 00000100:00100000:0.0:1787384566.348731:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 68 00000100:00100000:0.0:1787384566.348742:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9505050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+20:13195:x1874208182354176:12345-192.168.203.45@tcp:35:umount.0 00000100:00100000:0.0:1787384566.349078:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9505050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+21:13195:x1874208182354176:12345-192.168.203.45@tcp:35:umount.0 Request processed in 336us (660us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1787384566.349086:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 68 00000100:00100000:1.0:1787384566.359273:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384566.359398:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182354432 00000100:00100000:0.0:1787384566.359409:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182354432 00000100:00100000:0.0:1787384566.359473:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 69 00000100:00100000:0.0:1787384566.359483:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+21:13195:x1874208182354432:12345-192.168.203.45@tcp:35:umount.0 00000100:00100000:0.0:1787384566.360059:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+22:13195:x1874208182354432:12345-192.168.203.45@tcp:35:umount.0 Request processed in 576us (793us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1787384566.360069:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 69 00000100:00100000:1.0:1787384566.368164:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384566.368204:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384566.368232:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384566.368267:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384566.368298:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182354944 00000100:00100000:1.0:1787384566.368307:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182354944 00000100:00100000:1.0:1787384566.368364:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 80 00000100:00100000:1.0:1787384566.368373:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee114380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2412:x1874208182354944:12345-192.168.203.45@tcp:9:umount.0 00000020:00000080:1.0:1787384566.368403:0:8435:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba2b7a 00000100:00080000:1.0:1787384566.368411:0:8435:0:(import.c:65:import_set_state_nolock()) ffff98f7c2a46000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787384566.368455:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1787384566.368622:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee114380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e96ad5-fd9d-44d4-856e-5db0c40b1329+2:2412:x1874208182354944:12345-192.168.203.45@tcp:9:umount.0 Request processed in 250us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384566.368630:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 80 00010000:00010000:1.0:1787384566.368654:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384566.369237:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182354560 00000100:00100000:2.0:1787384566.369243:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182354560 00000100:00100000:2.0:1787384566.369289:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182354816 00000100:00100000:2.0:1787384566.369305:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182354816 00000100:00100000:2.0:1787384566.369328:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182354688 00000100:00100000:2.0:1787384566.369331:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182354688 00000100:00100000:2.0:1787384566.369347:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 20 00000100:00100000:2.0:1787384566.369355:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee115500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09777221-fe6d-4549-9ee6-04300d230fb6+15:2415:x1874208182354560:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384566.369366:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384566.369384:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c3b05600/0x7ef423838fba27de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3621 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384566.369400:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384566.369433:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee115500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09777221-fe6d-4549-9ee6-04300d230fb6+14:2415:x1874208182354560:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 79us (1278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384566.369440:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 20 00000100:00100000:2.0:1787384566.369454:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 21 00000100:00100000:2.0:1787384566.369460:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee114000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09777221-fe6d-4549-9ee6-04300d230fb6+13:2415:x1874208182354816:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384566.369467:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384566.369475:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c3b04c00/0x7ef423838fba2aaf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36fa expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384566.369483:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384566.369513:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee114000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09777221-fe6d-4549-9ee6-04300d230fb6+12:2415:x1874208182354816:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 51us (1307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384566.369519:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 21 00000100:00100000:2.0:1787384566.369533:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 22 00000100:00100000:2.0:1787384566.369539:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee116680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09777221-fe6d-4549-9ee6-04300d230fb6+11:2415:x1874208182354688:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384566.369547:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384566.369556:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f58ccc00/0x7ef423838fba279f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce35e2 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384566.369571:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384566.369590:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee116680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09777221-fe6d-4549-9ee6-04300d230fb6+10:2415:x1874208182354688:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 51us (1358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384566.369595:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 22 00000100:00080000:3.0:1787384566.369900:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787384566.377179:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384566.377277:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182355328 00000100:00100000:0.0:1787384566.377287:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182355328 00000100:00100000:0.0:1787384566.377358:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 81 00000100:00100000:0.0:1787384566.377368:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee114700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+7:2412:x1874208182355328:12345-192.168.203.45@tcp:9:umount.0 00000020:00000080:0.0:1787384566.377398:0:8436:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba2df0 00000020:00010000:0.0:1787384566.377405:0:8436:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98f8d8047800: total 0 00000100:00080000:0.0:1787384566.377410:0:8436:0:(import.c:65:import_set_state_nolock()) ffff98f8d8046000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787384566.377464:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1787384566.377613:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee114700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2412:x1874208182355328:12345-192.168.203.45@tcp:9:umount.0 Request processed in 246us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384566.377621:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 81 00000020:00010000:2.0:1787384566.377919:0:6510:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98f8d8047800: total 0 00010000:00010000:2.0:1787384566.377957:0:6510:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98f8d8047800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1787384566.378007:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009eaaa97/0x7ef423838fba3877 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3ac7 expref: 4 pid: 8890 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384566.378043:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037b223cf/0x7ef423838fba31a8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38e4 expref: 3 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384566.378058:0:6510:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98f8d8047800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1787384566.378071:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384566.378073:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384566.378075:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787384566.385029:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787384566.389749:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384566.390001:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182356352 00000100:00100000:3.0:1787384566.390012:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182356352 00000100:00100000:3.0:1787384566.390087:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 258 00000100:00100000:3.0:1787384566.390097:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+22:2412:x1874208182356352:12345-192.168.203.45@tcp:39:umount.0 00000020:00000080:3.0:1787384566.390130:0:6522:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba27ad 00000020:00010000:3.0:1787384566.390146:0:6522:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98f7c385c000: total 0 00000100:00080000:3.0:1787384566.390150:0:6522:0:(import.c:65:import_set_state_nolock()) ffff98f7c385e800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787384566.390180:0:6522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:3.0:1787384566.390334:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e96ad5-fd9d-44d4-856e-5db0c40b1329+21:2412:x1874208182356352:12345-192.168.203.45@tcp:39:umount.0 Request processed in 238us (592us total) trans 4294967528 rc 0/0 00000100:00100000:3.0:1787384566.390342:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 258 00000020:00010000:1.0:1787384566.390430:0:8453:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98f7c385c000: total 0 00010000:00010000:1.0:1787384566.390483:0:8453:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98f7c385c000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1787384566.390530:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98f7c294f000) 00010000:00010000:1.0:1787384566.390534:0:8453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787384566.390542:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090800/0x7ef423838fba2ad9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3708 expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384566.390582:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f8e8aa4100) 00010000:00010000:1.0:1787384566.390585:0:8453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787384566.390590:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd800/0x7ef423838fba322d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3907 expref: 19 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384566.390604:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f8edc2e700) 00010000:00010000:1.0:1787384566.390607:0:8453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787384566.390610:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f902159400/0x7ef423838fba3838 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3ab2 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384566.390624:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f7c3a9c600) 00010000:00010000:1.0:1787384566.390627:0:8453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787384566.390631:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc800/0x7ef423838fba3089 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3897 expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384566.390643:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff98f8e8aa4100) 00010000:00010000:1.0:1787384566.390646:0:8453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787384566.390649:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8c6141a00/0x7ef423838fba351a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce39e0 expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384566.390676:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f8edc2ee00) 00010000:00010000:1.0:1787384566.390679:0:8453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787384566.390683:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953a00/0x7ef423838fba3211 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3900 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384566.390695:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f8edc2e700) 00010000:00010000:1.0:1787384566.390698:0:8453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787384566.390708:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba3862 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3ac0 expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384566.390724:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f8fd1ea700) 00010000:00010000:1.0:1787384566.390726:0:8453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787384566.390730:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090200/0x7ef423838fba2b50 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3724 expref: 13 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384566.390742:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff98f8edc2e700) 00010000:00010000:1.0:1787384566.390744:0:8453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787384566.390748:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba3758 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3a7a expref: 12 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384566.390762:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f7c3a9c600) 00010000:00010000:1.0:1787384566.390807:0:8453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787384566.390812:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3953600/0x7ef423838fba3193 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38dd expref: 11 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384566.390826:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff98f8fd1ea700) 00010000:00010000:1.0:1787384566.390829:0:8453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787384566.390833:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3952200/0x7ef423838fba2e4b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce37fd expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384566.390849:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98f7c3a9cf00) 00010000:00010000:1.0:1787384566.390851:0:8453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384566.390855:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba2af5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce370f expref: 9 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384566.390869:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff98f7c3a9c600) 00010000:00010000:1.0:1787384566.390877:0:8453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787384566.390881:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a000/0x7ef423838fba3169 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce38cf expref: 8 pid: 14031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384566.391066:0:8453:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98f7c385c000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1787384566.391086:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384566.391088:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384566.391090:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384566.401560:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384566.401812:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182356480 00000100:00100000:3.0:1787384566.401823:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182356480 00000100:00080000:0.0:1787384566.402090:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787384566.402195:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 259 00000100:00100000:2.0:1787384566.402208:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+5:2412:x1874208182356480:12345-192.168.203.45@tcp:39:umount.0 00000020:00000080:2.0:1787384566.402240:0:8195:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba27b4 00000100:00080000:2.0:1787384566.402257:0:8195:0:(import.c:65:import_set_state_nolock()) ffff98f7c385a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787384566.402286:0:8195:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787384566.402443:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e96ad5-fd9d-44d4-856e-5db0c40b1329+3:2412:x1874208182356480:12345-192.168.203.45@tcp:39:umount.0 Request processed in 237us (890us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787384566.402451:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 259 00010000:00010000:0.0:1787384566.402798:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384566.711266:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384567.223306:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4304000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203374720:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787384567.223381:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384567.223456:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787384567.223463:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203374592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787384567.223487:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384567.224090:0:13608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203374720 00000100:00100000:2.0:1787384567.224097:0:13608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203374720 00000100:00100000:2.0:1787384567.224160:0:13608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203374592 00000100:00100000:2.0:1787384567.224164:0:13608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203374592 00000100:00100000:2.0:1787384567.224185:0:13608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787384567.224194:0:13608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203374720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787384567.224222:0:13608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787384567.224275:0:13608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203374720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384567.224282:0:13608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787384567.224296:0:13608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787384567.224302:0:13608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203374592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787384567.224311:0:13608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787384567.224333:0:13608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203374592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 31us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384567.224338:0:13608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:0.0:1787384567.224443:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787384567.224481:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203374592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787384567.224497:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4304000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203374720:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1787384567.351578:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787384567.735408:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787384567.735432:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203374848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787384567.735500:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787384567.735580:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384567.735806:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203375360:0@lo:400:kworker.0 00000100:00100000:0.0:1787384567.735837:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384567.735859:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee116d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874208203375872:0@lo:400:kworker.0 00000100:00100000:0.0:1787384567.735876:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384567.735898:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787384567.735903:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee116a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203374976:0@lo:400:kworker.0 00000100:00100000:0.0:1787384567.735927:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384567.735948:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee114a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203375488:0@lo:400:kworker.0 00000100:00100000:0.0:1787384567.735969:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384567.735985:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203376000:0@lo:400:kworker.0 00000100:00100000:0.0:1787384567.736003:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384567.736027:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203375360 00000100:00100000:0.0:1787384567.736035:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203375360 00000100:00100000:0.0:1787384567.736083:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203375872 00000100:00100000:0.0:1787384567.736086:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203375872 00000100:00100000:0.0:1787384567.736220:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203376000 00000100:00100000:0.0:1787384567.736224:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203376000 00000100:00100000:0.0:1787384567.736244:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1787384567.736252:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203375360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384567.736301:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203375360:12345-0@lo:400:kworker.0 Request processed in 49us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384567.736308:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1787384567.736324:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1787384567.736330:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874208203375872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384567.736357:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874208203375872:12345-0@lo:400:kworker.0 Request processed in 26us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384567.736377:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1787384567.736389:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1787384567.736396:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874208203376000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384567.736423:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874208203376000:12345-0@lo:400:kworker.0 Request processed in 28us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384567.736428:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1787384567.736445:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203374976 00000100:00100000:0.0:1787384567.736448:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203374976 00000100:00100000:0.0:1787384567.736473:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1787384567.736479:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3651:x1874208203374976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384567.736505:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3651:x1874208203374976:12345-0@lo:400:kworker.0 Request processed in 27us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384567.736511:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1787384567.736539:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203375488 00000100:00100000:0.0:1787384567.736543:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203375488 00000100:00100000:0.0:1787384567.736564:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1787384567.736569:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203375488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384567.736601:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203375488:12345-0@lo:400:kworker.0 Request processed in 32us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384567.736606:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00080000:0.0:1787384567.736625:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787384567.736628:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787384567.736651:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee116a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203374976:0@lo:400:kworker.0 00000100:00100000:0.0:1787384567.736662:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee114a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203375488:0@lo:400:kworker.0 00010000:00080000:0.0:1787384567.736672:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee289f80 x1874208203376000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384567.736688:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203376000:0@lo:400:kworker.0 00000100:00100000:0.0:1787384567.736699:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203375360:0@lo:400:kworker.0 00000100:00100000:0.0:1787384567.736707:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee116d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874208203375872:0@lo:400:kworker.0 00000100:00100000:0.0:1787384567.736738:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee117100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203375232:0@lo:400:kworker.0 00000100:00100000:0.0:1787384567.736798:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384567.736817:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee117b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874208203375744:0@lo:400:kworker.0 00000100:00100000:0.0:1787384567.736839:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384567.736855:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787384567.736861:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee117800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874208203375104:0@lo:400:kworker.0 00000100:00100000:0.0:1787384567.736879:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384567.736893:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874208203375616:0@lo:400:kworker.0 00000100:00100000:0.0:1787384567.736911:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384567.736927:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203376128:0@lo:400:kworker.0 00000100:00100000:0.0:1787384567.736947:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384567.736968:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203375744 00000100:00100000:0.0:1787384567.736972:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203375744 00000100:00100000:0.0:1787384567.736995:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203375104 00000100:00100000:0.0:1787384567.736998:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203375104 00000100:00100000:0.0:1787384567.737007:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203375616 00000100:00100000:0.0:1787384567.737009:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203375616 00000100:00100000:0.0:1787384567.737019:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1787384567.737024:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874208203375744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384567.737057:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874208203375744:12345-0@lo:400:kworker.0 Request processed in 32us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384567.737072:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1787384567.737085:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1787384567.737090:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874208203375104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384567.737247:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1787384567.737256:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874208203375616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384567.737314:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203375232 00000100:00100000:3.0:1787384567.737317:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203375232 00000100:00100000:3.0:1787384567.737340:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1787384567.737346:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203375232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384567.737443:0:13608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203374848 00000100:00100000:2.0:1787384567.737446:0:13608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203374848 00000100:00100000:2.0:1787384567.737470:0:13608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787384567.737477:0:13608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203374848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787384567.737498:0:13608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787384567.743019:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874208203375616:12345-0@lo:400:kworker.0 Request processed in 5754us (6095us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384567.743034:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1787384567.743098:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203376128 00000100:00100000:1.0:1787384567.743119:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203376128 00000100:00100000:1.0:1787384567.743175:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787384567.743184:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203376128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384567.743237:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203376128:12345-0@lo:400:kworker.0 Request processed in 54us (6289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384567.743244:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:1.0:1787384567.743297:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787384567.743302:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787384567.743305:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787384567.743348:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874208203375616:0@lo:400:kworker.0 00000100:00100000:1.0:1787384567.743359:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203376128:0@lo:400:kworker.0 00010000:00080000:1.0:1787384567.743374:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee117b80 x1874208203375744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384567.743403:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee117b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874208203375744:0@lo:400:kworker.0 00000100:00100000:3.0:1787384567.744349:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203375232:12345-0@lo:400:kworker.0 Request processed in 6996us (7565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384567.744359:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1787384567.744464:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee117100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203375232:0@lo:400:kworker.0 00000100:00100000:0.0:1787384567.744616:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874208203375104:12345-0@lo:400:kworker.0 Request processed in 7524us (7734us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384567.744625:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1787384567.745041:0:13608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203374848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7562us (9538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384567.745065:0:13608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787384567.745379:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee117800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874208203375104:0@lo:400:kworker.0 00000100:00100000:3.0:1787384567.745445:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203374848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787384568.247125:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384568.247533:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203376256:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787384568.247597:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384568.247803:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203376256 00000100:00100000:2.0:1787384568.247812:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203376256 00000100:00100000:2.0:1787384568.247904:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787384568.247914:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203376256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787384568.247947:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384568.248002:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203376256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384568.248009:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787384568.248082:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203376256:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787384568.583400:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384568.583462:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384568.583603:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182356736 00000100:00100000:3.0:1787384568.583613:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182356736 00000100:00100000:3.0:1787384568.583671:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182356608 00000100:00100000:3.0:1787384568.583687:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182356608 00000100:00100000:3.0:1787384568.583720:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 23 00000100:00100000:3.0:1787384568.583730:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9148700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09777221-fe6d-4549-9ee6-04300d230fb6+11:2413:x1874208182356736:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384568.583744:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384568.583773:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c2090600/0x7ef423838fba28b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3667 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384568.583823:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 24 00010000:00010000:3.0:1787384568.583825:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384568.583837:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b46850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09777221-fe6d-4549-9ee6-04300d230fb6+10:2413:x1874208182356608:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787384568.583848:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384568.583860:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c2090000/0x7ef423838fba28b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3636 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384568.583871:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384568.583894:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9148700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09777221-fe6d-4549-9ee6-04300d230fb6+9:2413:x1874208182356736:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 164us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384568.583897:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b46850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09777221-fe6d-4549-9ee6-04300d230fb6+9:2413:x1874208182356608:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 62us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384568.584165:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 23 00000100:00100000:3.0:1787384568.590409:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384568.590566:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182356864 00000100:00100000:1.0:1787384568.590577:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182356864 00000100:00100000:0.0:1787384568.595306:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 24 00000100:00100000:1.0:1787384568.597436:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 25 00000100:00100000:1.0:1787384568.597460:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09777221-fe6d-4549-9ee6-04300d230fb6+8:2414:x1874208182356864:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384568.597480:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384568.597503:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c3b05400/0x7ef423838fba2aa8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce36f3 expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384568.597528:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384568.597583:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09777221-fe6d-4549-9ee6-04300d230fb6+7:2414:x1874208182356864:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 133us (7184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384568.597590:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 25 00000100:00100000:0.0:1787384568.599824:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384568.599959:0:8195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182357120 00000100:00100000:2.0:1787384568.599969:0:8195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182357120 00000100:00100000:2.0:1787384568.600046:0:8195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 260 00000100:00100000:2.0:1787384568.600056:0:8195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+6:2412:x1874208182357120:12345-192.168.203.45@tcp:39:umount.0 00000020:00000080:2.0:1787384568.600096:0:8195:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba28c5 00000020:00010000:2.0:1787384568.600103:0:8195:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98f8ee310800: total 0 00000100:00080000:2.0:1787384568.600108:0:8195:0:(import.c:65:import_set_state_nolock()) ffff98f8ee315000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787384568.600157:0:8195:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00100000:2.0:1787384568.600320:0:8195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2412:x1874208182357120:12345-192.168.203.45@tcp:39:umount.0 Request processed in 266us (504us total) trans 4294967529 rc 0/0 00000100:00100000:2.0:1787384568.600328:0:8195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 260 00000020:00010000:0.0:1787384568.600810:0:6511:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98f8ee310800: total 0 00010000:00010000:0.0:1787384568.600815:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384568.600861:0:6511:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98f8ee310800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787384568.600904:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f8edc2ee00) 00010000:00010000:0.0:1787384568.600908:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787384568.600916:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3885 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3ace expref: 4 pid: 8195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384568.600939:0:6511:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98f8ee310800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1787384568.600964:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384568.600966:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384568.600968:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787384568.600976:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384568.616886:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384568.617061:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182357248 00000100:00100000:1.0:1787384568.617072:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182357248 00000100:00100000:1.0:1787384568.617154:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 261 00000100:00100000:1.0:1787384568.617164:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+5:2412:x1874208182357248:12345-192.168.203.45@tcp:39:umount.0 00000020:00000080:1.0:1787384568.617208:0:6521:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba28cc 00000100:00080000:1.0:1787384568.617217:0:6521:0:(import.c:65:import_set_state_nolock()) ffff98f8ee358000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787384568.617247:0:6521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1787384568.617397:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25b82c0d-eb27-4f09-8c2a-c4cdc695d620+3:2412:x1874208182357248:12345-192.168.203.45@tcp:39:umount.0 Request processed in 233us (522us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787384568.617420:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 261 00000100:00080000:0.0:1787384568.617821:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787384568.617844:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384568.667978:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384568.677714:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182357504 00000100:00100000:3.0:1787384568.677739:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182357504 00000100:00100000:3.0:1787384568.677830:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 399 00000100:00100000:3.0:1787384568.677839:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+7:2412:x1874208182357504:12345-192.168.203.45@tcp:251:umount.0 00000020:00000080:3.0:1787384568.677887:0:6515:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba278a 00000020:00010000:3.0:1787384568.677894:0:6515:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98f7c385e000: total 0 00000100:00080000:3.0:1787384568.677899:0:6515:0:(import.c:65:import_set_state_nolock()) ffff98f7c3858800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787384568.677986:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09777221-fe6d-4549-9ee6-04300d230fb6+3:2412:x1874208182357504:12345-192.168.203.45@tcp:251:umount.0 Request processed in 146us (10019us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384568.677994:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 399 00000020:00010000:2.0:1787384568.678361:0:8453:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98f7c385e000: total 0 00010000:00010000:2.0:1787384568.678424:0:8453:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98f7c385e000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787384568.678471:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f58cde00/0x7ef423838fba27e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3628 expref: 2 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384568.678486:0:8453:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98f7c385e000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1787384568.678497:0:8453:0:(genops.c:906:class_export_put()) final put ffff98f7c385e000/09777221-fe6d-4549-9ee6-04300d230fb6 00010000:00010000:2.0:1787384568.678517:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384568.678519:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384568.678521:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787384568.679968:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c385e000/09777221-fe6d-4549-9ee6-04300d230fb6 for MGS 00000020:00000080:3.0:1787384568.680019:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f7c3858800 for MGS 00010000:00010000:0.0:1787384568.758991:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787384568.823876:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787384568.823888:0:13801:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787384568.823996:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1787384568.824018:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787384569.785407:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384569.797244:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203376384:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787384569.797310:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384569.797517:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203376384 00000100:00100000:3.0:1787384569.797525:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203376384 00000100:00100000:3.0:1787384569.797575:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787384569.797585:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee289180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203376384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787384569.797619:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787384569.797911:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee289180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203376384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 326us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384569.797919:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787384569.798177:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203376384:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787384570.295678:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787384570.295700:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203376512:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787384570.295809:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384570.295997:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203376512 00000100:00100000:0.0:1787384570.296005:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203376512 00000100:00100000:0.0:1787384570.296055:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1787384570.296065:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203376512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787384570.296098:0:7933:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1787384570.296139:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203376512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384570.296147:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1787384570.296313:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203376512:0@lo:41:osp-pre-0-1.0 00000020:01000004:2.0:1787384570.572960:0:15162:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787384570.589966:0:15162:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1787384570.590028:0:15162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc200/0x7ef423838fba2840 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2847 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384570.590042:0:15162:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc200/0x7ef423838fba2840 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2847 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384570.590049:0:15162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc200/0x7ef423838fba2840 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba2847 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384570.590056:0:15162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc200/0x7ef423838fba2840 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba2847 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384570.590079:0:15162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787384570.590084:0:15162:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787384570.590115:0:15162:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787384570.590120:0:15162:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787384570.590125:0:15162:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787384570.590149:0:15162:0:(import.c:65:import_set_state_nolock()) ffff98f8d969b000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787384570.590213:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874208203376640:0@lo:39:umount.0 00000100:00100000:3.0:1787384570.590289:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384570.590494:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203376640 00000100:00100000:2.0:1787384570.590501:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203376640 00000100:00100000:2.0:1787384570.590571:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787384570.590583:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874208203376640:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787384570.590608:0:14031:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba23a1 00000100:00080000:2.0:1787384570.590615:0:14031:0:(import.c:65:import_set_state_nolock()) ffff98f8f569e000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787384570.590677:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3650:x1874208203376640:12345-0@lo:39:umount.0 Request processed in 97us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384570.590685:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:2.0:1787384570.590694:0:14031:0:(genops.c:906:class_export_put()) final put ffff98f8f569a800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787384570.590762:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f569a800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787384570.590838:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8f569e000 for lustre-MDT0000 00010000:00010000:0.0:1787384570.590857:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384570.590875:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc200/0x7ef423838fba2840 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba2847 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787384570.590876:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8d969b000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787384570.590888:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874208203376640:0@lo:39:umount.0 00010000:00010000:0.0:1787384570.590888:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cc200 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:0.0:1787384570.590895:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc200/0x7ef423838fba2840 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba2847 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384570.590905:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc200/0x7ef423838fba2840 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ef423838fba2847 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787384570.590912:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc200/0x7ef423838fba2840 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ef423838fba2847 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384570.590917:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787384570.590920:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787384570.590929:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787384570.590955:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc200/0x7ef423838fba2840 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba2847 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787384570.590961:0:15162:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:0.0:1787384570.590962:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787384570.590965:0:15162:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787384570.590971:0:15162:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787384570.590996:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc200/0x7ef423838fba2840 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba2847 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384570.591004:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc200/0x7ef423838fba2840 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba2847 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384570.591014:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384570.591016:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384570.591018:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384570.591833:0:15162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c2091200/0x7ef423838fba284e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2855 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384570.591847:0:15162:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c2091200/0x7ef423838fba284e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2855 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384570.591855:0:15162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c2091200/0x7ef423838fba284e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba2855 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384570.591863:0:15162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.145@tcp lock: ffff98f7c2091200/0x7ef423838fba284e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba2855 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384570.591878:0:15162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787384570.591884:0:15162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f5824000/0x7ef423838fba2744 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba274b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384570.591891:0:15162:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f5824000/0x7ef423838fba2744 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba274b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384570.591911:0:15162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f5824000/0x7ef423838fba2744 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba274b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384570.591918:0:15162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.145@tcp lock: ffff98f8f5824000/0x7ef423838fba2744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba274b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384570.591938:0:15162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787384570.591946:0:15162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04800/0x7ef423838fba2a9a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2aa1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384570.591953:0:15162:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04800/0x7ef423838fba2a9a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2aa1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384570.591958:0:15162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04800/0x7ef423838fba2a9a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba2aa1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384570.591964:0:15162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04800/0x7ef423838fba2a9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba2aa1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384570.591972:0:15162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787384570.591977:0:15162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8c0030c00/0x7ef423838fba2300 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2307 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384570.591983:0:15162:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8c0030c00/0x7ef423838fba2300 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2307 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384570.591989:0:15162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8c0030c00/0x7ef423838fba2300 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba2307 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384570.592006:0:15162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.145@tcp lock: ffff98f8c0030c00/0x7ef423838fba2300 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba2307 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384570.592013:0:15162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1787384570.592016:0:15162:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1787384570.592041:0:15162:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1787384570.592045:0:15162:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1787384570.592049:0:15162:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787384570.592055:0:15162:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1787384570.592060:0:15162:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98f7c3549000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787384570.592066:0:15162:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98f7c2054000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787384570.592071:0:15162:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98f8fc23a800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787384570.592075:0:15162:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98f8f9132000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1787384570.592082:0:15162:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff98f8ee310800 25b82c0d-eb27-4f09-8c2a-c4cdc695d620 192.168.203.45@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787384570.592088:0:15162:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff98f7c385c000 55e96ad5-fd9d-44d4-856e-5db0c40b1329 192.168.203.45@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967523 stale:0 00000020:00080000:2.0:1787384570.592093:0:15162:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff98f8fc2b3380) has exports, disconnecting them 00000020:00080000:2.0:1787384570.592098:0:15162:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98f7c3549000), last request at 1787384567 00000020:00000080:2.0:1787384570.592103:0:15162:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba26b1 00000100:00080000:2.0:1787384570.592120:0:15162:0:(import.c:65:import_set_state_nolock()) ffff98f7c354c800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787384570.592158:0:15162:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98f7c3549000): rc 0 00000020:00000080:2.0:1787384570.592160:0:15162:0:(genops.c:906:class_export_put()) final put ffff98f7c3549000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1787384570.592171:0:15162:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98f7c2054000), last request at 1787384567 00000020:00000080:2.0:1787384570.592174:0:15162:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba258b 00000100:00080000:2.0:1787384570.592180:0:15162:0:(import.c:65:import_set_state_nolock()) ffff98f7c2051800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1787384570.592189:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c3549000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1787384570.592232:0:469:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f7c354c800 for lustre-MDT0000 00000020:00080000:2.0:1787384570.592247:0:15162:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98f7c2054000): rc 0 00000020:00000080:2.0:1787384570.592249:0:15162:0:(genops.c:906:class_export_put()) final put ffff98f7c2054000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1787384570.592259:0:15162:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98f8fc23a800), last request at 1787384324 00000020:00000080:2.0:1787384570.592262:0:15162:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba2488 00000100:00080000:2.0:1787384570.592268:0:15162:0:(import.c:65:import_set_state_nolock()) ffff98f8fc239000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1787384570.592277:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c2054000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787384570.592308:0:469:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f7c2051800 for lustre-MDT0000 00000020:00080000:2.0:1787384570.592320:0:15162:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98f8fc23a800): rc 0 00000020:00000080:2.0:1787384570.592322:0:15162:0:(genops.c:906:class_export_put()) final put ffff98f8fc23a800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1787384570.592330:0:15162:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98f8f9132000), last request at 1787384324 00000020:00000080:2.0:1787384570.592334:0:15162:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba2450 00000100:00080000:2.0:1787384570.592337:0:15162:0:(import.c:65:import_set_state_nolock()) ffff98f8f9135000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1787384570.592344:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8fc23a800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1787384570.592365:0:469:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8fc239000 for lustre-MDT0000 00000001:00000004:2.0:1787384570.592374:0:15162:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000020:00080000:2.0:1787384570.592434:0:15162:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98f8f9132000): rc 0 00000004:00000080:2.0:1787384570.592440:0:15162:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffac6941de7ae0 00000100:00080000:2.0:1787384570.592454:0:15162:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787384570.592457:0:15162:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:0.0:1787384570.592585:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787384570.592593:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f7c2091200/0x7ef423838fba284e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba2855 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384570.592601:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2091200 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:0.0:1787384570.592605:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f7c2091200/0x7ef423838fba284e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba2855 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384570.592614:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f7c2091200/0x7ef423838fba284e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ef423838fba2855 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787384570.592697:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f7c2091200/0x7ef423838fba284e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ef423838fba2855 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384570.592703:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787384570.592706:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1787384570.592708:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1787384570.592748:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f7c2091200/0x7ef423838fba284e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba2855 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384570.592761:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787384570.592774:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f7c2091200/0x7ef423838fba284e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba2855 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384570.592802:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f7c2091200/0x7ef423838fba284e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba2855 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384570.592811:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787384570.592815:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8f5824000/0x7ef423838fba2744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba274b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384570.592820:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f5824000 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:0.0:1787384570.592823:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8f5824000/0x7ef423838fba2744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba274b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384570.592829:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8f5824000/0x7ef423838fba2744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ef423838fba274b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787384570.592835:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8f5824000/0x7ef423838fba2744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ef423838fba274b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384570.592839:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787384570.592841:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1787384570.592843:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787384570.592856:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8f5824000/0x7ef423838fba2744 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba274b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384570.592896:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787384570.592903:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04800/0x7ef423838fba2a9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba2aa1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384570.592910:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b04800 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:1.0:1787384570.592913:0:8453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04800/0x7ef423838fba2a9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba2aa1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384570.592920:0:8453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04800/0x7ef423838fba2a9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ef423838fba2aa1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384570.592933:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:1.0:1787384570.592934:0:8453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04800/0x7ef423838fba2a9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ef423838fba2aa1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384570.592943:0:8453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787384570.592946:0:8453:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787384570.592949:0:8453:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787384570.592955:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8f5824000/0x7ef423838fba2744 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba274b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384570.592968:0:8453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04800/0x7ef423838fba2a9a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba2aa1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384570.592986:0:8453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787384570.592994:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04800/0x7ef423838fba2a9a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba2aa1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384570.592999:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04800/0x7ef423838fba2a9a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba2aa1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384570.593007:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384570.593010:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8c0030c00/0x7ef423838fba2300 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba2307 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384570.593015:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c0030c00 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:1.0:1787384570.593018:0:8453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8c0030c00/0x7ef423838fba2300 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba2307 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384570.593024:0:8453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8c0030c00/0x7ef423838fba2300 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ef423838fba2307 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787384570.593035:0:8453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8c0030c00/0x7ef423838fba2300 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ef423838fba2307 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384570.593037:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8f5824000/0x7ef423838fba2744 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba274b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384570.593046:0:8453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787384570.593052:0:8453:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787384570.593054:0:8453:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1787384570.593060:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384570.593063:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384570.593065:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384570.593068:0:8453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8c0030c00/0x7ef423838fba2300 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba2307 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384570.593075:0:8453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787384570.593079:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8c0030c00/0x7ef423838fba2300 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba2307 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384570.593093:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8c0030c00/0x7ef423838fba2300 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba2307 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384570.593103:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384570.593105:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384570.593107:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384570.593122:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203376896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384570.593178:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384570.593224:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787384570.593230:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203376768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384570.593248:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384570.593262:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203377280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384570.593277:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384570.593297:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203377024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384570.593315:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384570.593328:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787384570.593333:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203377152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384570.593349:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384570.593371:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203376896 00000100:00100000:1.0:1787384570.593377:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203376896 00000100:00100000:1.0:1787384570.593408:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203376768 00000100:00100000:1.0:1787384570.593411:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203376768 00000100:00100000:1.0:1787384570.593421:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203377280 00000100:00100000:1.0:1787384570.593423:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203377280 00000100:00100000:1.0:1787384570.593434:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203377024 00000100:00100000:1.0:1787384570.593436:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203377024 00000100:00100000:1.0:1787384570.593444:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203377152 00000100:00100000:1.0:1787384570.593451:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203377152 00000100:00100000:1.0:1787384570.593466:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787384570.593473:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee28b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca80b7f5-0e34-441a-981f-ebff717028c4+28:3654:x1874208203376896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787384570.593483:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384570.593495:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f58cd200/0x7ef423838fba2855 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ef423838fba284e expref: 28 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384570.593507:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384570.593535:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee28b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca80b7f5-0e34-441a-981f-ebff717028c4+27:3654:x1874208203376896:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384570.593541:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787384570.593558:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787384570.593563:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee28b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca80b7f5-0e34-441a-981f-ebff717028c4+26:3654:x1874208203376768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787384570.593569:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384570.593576:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c2090a00/0x7ef423838fba2847 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ef423838fba2840 expref: 26 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384570.593583:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384570.593600:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee28b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca80b7f5-0e34-441a-981f-ebff717028c4+25:3654:x1874208203376768:12345-0@lo:103:ldlm_bl.0 Request processed in 37us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384570.593605:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787384570.593614:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787384570.593619:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca80b7f5-0e34-441a-981f-ebff717028c4+24:3654:x1874208203377280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787384570.593624:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384570.593632:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8c148da00/0x7ef423838fba2307 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ef423838fba2300 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384570.593640:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384570.593668:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca80b7f5-0e34-441a-981f-ebff717028c4+23:3654:x1874208203377280:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384570.593674:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787384570.593685:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787384570.593691:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee288000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca80b7f5-0e34-441a-981f-ebff717028c4+22:3651:x1874208203377024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787384570.593697:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384570.593705:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f5825800/0x7ef423838fba274b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ef423838fba2744 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384570.593713:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384570.593734:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee288000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca80b7f5-0e34-441a-981f-ebff717028c4+21:3651:x1874208203377024:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384570.593754:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787384570.593765:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787384570.593771:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee28ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca80b7f5-0e34-441a-981f-ebff717028c4+20:3651:x1874208203377152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787384570.593796:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384570.593805:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8d965b000/0x7ef423838fba2aa1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ef423838fba2a9a expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384570.593811:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384570.593830:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee28ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca80b7f5-0e34-441a-981f-ebff717028c4+19:3651:x1874208203377152:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384570.593835:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787384570.593892:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203377152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384570.593899:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:3651:1874208203377024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384570.593920:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203376768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384570.593935:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203377280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384570.593940:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ca80b7f5-0e34-441a-981f-ebff717028c4:3654:1874208203376896:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787384570.594053:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787384570.596705:0:15162:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787384570.596747:0:15162:0:(import.c:65:import_set_state_nolock()) ffff98f8ee091800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787384570.596924:0:15162:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787384570.596929:0:15162:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1787384570.596942:0:15162:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787384570.597014:0:15162:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787384570.597024:0:15162:0:(import.c:65:import_set_state_nolock()) ffff98f8f7d42000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787384570.597030:0:15162:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787384570.597043:0:15162:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1787384570.597052:0:15162:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787384570.597109:0:15162:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787384570.597118:0:15162:0:(import.c:65:import_set_state_nolock()) ffff98f7c3bfd800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1787384570.597144:0:15162:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff98f8fc2b3380) has no exports 00000100:00100000:1.0:1787384570.600050:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203377408:0@lo:39:umount.0 00000100:00100000:1.0:1787384570.600117:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384570.600151:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203377536:0@lo:9:umount.0 00000100:00100000:1.0:1787384570.600174:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384570.600194:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203377664:0@lo:9:umount.0 00000100:00100000:1.0:1787384570.600212:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384570.601057:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203377408 00000100:00100000:3.0:1787384570.601067:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203377408 00000100:00100000:3.0:1787384570.601252:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1787384570.601261:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee28a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874208203377408:12345-0@lo:39:umount.0 00000100:00100000:1.0:1787384570.601371:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203377536 00000100:00100000:1.0:1787384570.601375:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203377536 00000100:00100000:1.0:1787384570.601409:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203377664 00000100:00100000:1.0:1787384570.601413:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203377664 00000100:00100000:1.0:1787384570.601432:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787384570.601438:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee288a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874208203377536:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787384570.601452:0:8436:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba2633 00000100:00080000:1.0:1787384570.601461:0:8436:0:(import.c:65:import_set_state_nolock()) ffff98f8ee258800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787384570.601502:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1787384570.601648:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee288a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3650:x1874208203377536:12345-0@lo:9:umount.0 Request processed in 210us (1472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384570.601656:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787384570.601671:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787384570.601678:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874208203377664:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787384570.601688:0:8436:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba2775 00000100:00080000:1.0:1787384570.601694:0:8436:0:(import.c:65:import_set_state_nolock()) ffff98f7c2054800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787384570.601716:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1787384570.601824:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3650:x1874208203377664:12345-0@lo:9:umount.0 Request processed in 147us (1610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384570.601831:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1787384570.601853:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787384570.601857:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787384570.601870:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384570.601875:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787384570.601901:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f7d42000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787384570.601914:0:3650:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787384570.601916:0:3650:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787384570.601920:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203377536:0@lo:9:umount.0 00000100:00080000:1.0:1787384570.601929:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f7c3bfd800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787384570.601937:0:3650:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787384570.601938:0:3650:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787384570.601940:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203377664:0@lo:9:umount.0 00000020:00000080:3.0:1787384570.602161:0:6527:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba24f8 00000100:00080000:3.0:1787384570.602170:0:6527:0:(import.c:65:import_set_state_nolock()) ffff98f8ee0ca800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787384570.602194:0:6527:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1787384570.602299:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee28a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3650:x1874208203377408:12345-0@lo:39:umount.0 Request processed in 1040us (2181us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787384570.602306:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00010000:00010000:1.0:1787384570.603999:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787384570.604044:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8ee091800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787384570.604054:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203377408:0@lo:39:umount.0 00000020:00080000:2.0:1787384570.616280:0:15162:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff98f8fc2b3380) has no exports 00000020:00000080:2.0:1787384570.684702:0:15162:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba235b 00000020:00000080:2.0:1787384570.684719:0:15162:0:(genops.c:906:class_export_put()) final put ffff98f8c8922000/lustre-QMT0000_UUID 00000020:01000000:2.0:1787384570.685176:0:15162:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1787384570.685890:0:15162:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787384570.685901:0:15162:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787384570.685905:0:15162:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff98f8f54b19c0) has no exports 00000020:00000080:2.0:1787384570.686452:0:15162:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba2354 00000020:00000080:2.0:1787384570.686460:0:15162:0:(genops.c:906:class_export_put()) final put ffff98f8fc23c000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787384570.686532:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8c8922000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787384570.696131:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8fc23c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787384570.696606:0:15162:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787384570.696617:0:15162:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787384570.696622:0:15162:0:(genops.c:906:class_export_put()) final put ffff98f8f919b800/lustre-QMT0000_UUID 00000020:00000080:0.0:1787384570.696626:0:15162:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f919b800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1787384570.696635:0:15162:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:1.0:1787384570.807006:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384571.832223:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787384571.838925:0:6501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787384571.838934:0:6501:0:(genops.c:906:class_export_put()) final put ffff98f8f9132000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1787384571.838959:0:6501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 25b82c0d-eb27-4f09-8c2a-c4cdc695d620 00000001:00080000:0.0:1787384571.838967:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000020:00000080:0.0:1787384571.838970:0:6501:0:(genops.c:906:class_export_put()) final put ffff98f8ee310800/25b82c0d-eb27-4f09-8c2a-c4cdc695d620 00000001:00100000:0.0:1787384571.838975:0:6501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 55e96ad5-fd9d-44d4-856e-5db0c40b1329 00000001:00080000:0.0:1787384571.838980:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:0.0:1787384571.838987:0:6501:0:(genops.c:906:class_export_put()) final put ffff98f7c385c000/55e96ad5-fd9d-44d4-856e-5db0c40b1329 00000020:00000080:2.0:1787384571.839375:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f9132000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1787384571.839439:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8ee310800/25b82c0d-eb27-4f09-8c2a-c4cdc695d620 for lustre-MDT0000 00000020:00000080:2.0:1787384571.839468:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c385c000/55e96ad5-fd9d-44d4-856e-5db0c40b1329 for lustre-MDT0000 00000020:00000080:2.0:1787384571.839502:0:469:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8f9135000 for lustre-MDT0000 00000020:00000080:2.0:1787384571.839508:0:469:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8ee315000 for lustre-MDT0000 00000020:00000080:2.0:1787384571.839511:0:469:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f7c385e800 for lustre-MDT0000 00000001:00100000:2.0:1787384571.841974:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787384571.841988:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:2.0:1787384571.841993:0:7452:0:(genops.c:906:class_export_put()) final put ffff98f8f566f000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787384571.842021:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 25b82c0d-eb27-4f09-8c2a-c4cdc695d620 00000001:00080000:2.0:1787384571.842029:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:2.0:1787384571.842031:0:7452:0:(genops.c:906:class_export_put()) final put ffff98f8ee35e000/25b82c0d-eb27-4f09-8c2a-c4cdc695d620 00000001:00100000:2.0:1787384571.842038:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 55e96ad5-fd9d-44d4-856e-5db0c40b1329 00000001:00080000:2.0:1787384571.842042:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:2.0:1787384571.842044:0:7452:0:(genops.c:906:class_export_put()) final put ffff98f7c3858000/55e96ad5-fd9d-44d4-856e-5db0c40b1329 00000001:00100000:1.0:1787384571.842533:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787384571.842537:0:9517:0:(genops.c:906:class_export_put()) final put ffff98f7c2051000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787384571.842835:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787384571.842840:0:8432:0:(genops.c:906:class_export_put()) final put ffff98f8ee258000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787384571.842852:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 55e96ad5-fd9d-44d4-856e-5db0c40b1329 00000020:00000080:0.0:1787384571.842863:0:8432:0:(genops.c:906:class_export_put()) final put ffff98f8d8047800/55e96ad5-fd9d-44d4-856e-5db0c40b1329 00000001:00100000:1.0:1787384571.843001:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 55e96ad5-fd9d-44d4-856e-5db0c40b1329 00000020:00000080:1.0:1787384571.843004:0:9517:0:(genops.c:906:class_export_put()) final put ffff98f7c2a45000/55e96ad5-fd9d-44d4-856e-5db0c40b1329 00000020:00000080:3.0:1787384571.843107:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f566f000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1787384571.843184:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8ee35e000/25b82c0d-eb27-4f09-8c2a-c4cdc695d620 for lustre-MDT0001 00000020:00000080:3.0:1787384571.843206:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c3858000/55e96ad5-fd9d-44d4-856e-5db0c40b1329 for lustre-MDT0001 00000020:00000080:3.0:1787384571.843226:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8ee258000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787384571.843255:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8d8047800/55e96ad5-fd9d-44d4-856e-5db0c40b1329 for lustre-OST0000 00000020:00000080:3.0:1787384571.843270:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c2051000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1787384571.843283:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c2a45000/55e96ad5-fd9d-44d4-856e-5db0c40b1329 for lustre-OST0001 00000020:00000080:3.0:1787384571.843296:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8ee0ca800 for lustre-MDT0001 00000020:00000080:3.0:1787384571.843301:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8ee358000 for lustre-MDT0001 00000020:00000080:3.0:1787384571.843304:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f7c385a000 for lustre-MDT0001 00000020:00000080:3.0:1787384571.843307:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8ee258800 for lustre-OST0000 00000020:00000080:3.0:1787384571.843310:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8d8046000 for lustre-OST0000 00000020:00000080:3.0:1787384571.843313:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f7c2054800 for lustre-OST0001 00000020:00000080:3.0:1787384571.843315:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f7c2a46000 for lustre-OST0001 00000100:00100000:2.0:1787384572.343164:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203377792:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787384572.343246:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384572.343659:0:13608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203377792 00000100:00100000:0.0:1787384572.343667:0:13608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203377792 00000100:00100000:0.0:1787384572.343748:0:13608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787384572.343771:0:13608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9149180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203377792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787384572.343822:0:13608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787384572.343871:0:13608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9149180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203377792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384572.343878:0:13608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:1.0:1787384572.343938:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787384572.344117:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203377792:0@lo:13:osp-pre-0-1.0 00000020:01000000:0.0:1787384572.726918:0:15162:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98f7c386d9c0 - data ffff98f8c9748288/ffff98f8ee2e7400 00000020:01000000:0.0:1787384572.727081:0:15162:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98f8e8a75f00 - data ffff98f8d14c7af8/ffff98f8f9172000 00000001:00000004:0.0:1787384572.735311:0:15162:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00080000:3.0:1787384572.794194:0:15162:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787384572.794203:0:15162:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1787384572.794217:0:15162:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff98f8f9148700 x1874208203377408/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787384580 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384572.794240:0:15162:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1787384572.798538:0:15162:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787384572.798546:0:15162:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1787384572.798563:0:15162:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787384572.798566:0:15162:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787384572.799232:0:8887:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787384572.799237:0:8887:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1787384572.799248:0:8887:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1787384572.800919:0:15162:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787384572.800925:0:15162:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1787384572.800939:0:15162:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787384572.800941:0:15162:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787384572.801847:0:9829:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787384572.801852:0:9829:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1787384572.801862:0:9829:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1787384572.804865:0:15162:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba2323 00000020:00000080:3.0:1787384572.804878:0:15162:0:(genops.c:906:class_export_put()) final put ffff98f8d969e800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787384572.805661:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8d969e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787384572.818568:0:15162:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba2338 00000020:00000080:3.0:1787384572.818591:0:15162:0:(genops.c:906:class_export_put()) final put ffff98f8f91fc800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787384572.818608:0:15162:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1787384572.818613:0:15162:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787384572.818622:0:15162:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787384572.818625:0:15162:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff98f8fc2b19c0) has no exports 00000020:00000080:0.0:1787384572.818640:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f91fc800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:3.0:1787384572.818830:0:15162:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787384572.818839:0:15162:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba276e 00000020:00000080:3.0:1787384572.821123:0:15162:0:(genops.c:906:class_export_put()) final put ffff98f8f7d8d000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787384572.821148:0:15162:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787384572.821156:0:15162:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787384572.821168:0:15162:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787384572.821172:0:15162:0:(genops.c:1579:class_disconnect_exports()) OBD device 28 (ffff98f7c28999c0) has no exports 00000020:00000080:3.0:1787384572.821180:0:15162:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba2767 00000020:00000080:3.0:1787384572.821186:0:15162:0:(genops.c:906:class_export_put()) final put ffff98f7c3bfa800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787384572.821346:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f7d8d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787384572.821358:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c3bfa800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1787384572.821534:0:15162:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787384572.821538:0:15162:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787384572.821542:0:15162:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1787384572.821548:0:15162:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787384572.821550:0:15162:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787384572.822567:0:15162:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787384572.822590:0:15162:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787384572.822598:0:15162:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba262c 00000020:00000080:3.0:1787384572.822605:0:15162:0:(genops.c:906:class_export_put()) final put ffff98f8ee312000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787384572.822747:0:15162:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787384572.822754:0:15162:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787384572.822760:0:15162:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787384572.822764:0:15162:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff98f8f7d319c0) has no exports 00000020:00000080:3.0:1787384572.822770:0:15162:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba2625 00000020:00000080:3.0:1787384572.822775:0:15162:0:(genops.c:906:class_export_put()) final put ffff98f8f7d44800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787384572.823520:0:469:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f7c3bfd800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787384572.823540:0:469:0:(genops.c:906:class_export_put()) final put ffff98f7c3bfb800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787384572.823543:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c3bfb800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1787384572.823548:0:469:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00010000:01000000:3.0:1787384572.824137:0:15162:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787384572.824152:0:15162:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787384572.824157:0:15162:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1787384572.824162:0:15162:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787384572.824165:0:15162:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787384572.832850:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8ee312000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787384572.832868:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f7d44800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787384572.833420:0:15162:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787384572.833438:0:15162:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1787384572.833457:0:15162:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1787384572.833466:0:15162:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba24f1 00000020:00000080:3.0:1787384572.833474:0:15162:0:(genops.c:906:class_export_put()) final put ffff98f8d9b5d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787384572.835032:0:469:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8f7d42000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787384572.835049:0:469:0:(genops.c:906:class_export_put()) final put ffff98f8f7d22000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787384572.835053:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f7d22000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1787384572.835079:0:469:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787384572.835487:0:15162:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1787384572.835495:0:15162:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787384572.835506:0:15162:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787384572.835510:0:15162:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff98f8f968cd40) has no exports 00000020:00000080:3.0:1787384572.835517:0:15162:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba24ea 00000020:00000080:3.0:1787384572.835523:0:15162:0:(genops.c:906:class_export_put()) final put ffff98f8f9137800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787384572.835658:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8d9b5d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1787384572.835665:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f9137800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1787384572.837902:0:15162:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1787384572.837910:0:15162:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787384572.837914:0:15162:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1787384572.837921:0:15162:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787384572.837972:0:15162:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787384572.837983:0:15162:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787384572.838024:0:15162:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787384572.838028:0:15162:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787384572.838034:0:15162:0:(genops.c:906:class_export_put()) final put ffff98f8d969f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787384572.838038:0:15162:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8d969f000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787384572.838045:0:15162:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787384572.838143:0:15162:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba233f 00000020:00000080:0.0:1787384572.838149:0:15162:0:(genops.c:906:class_export_put()) final put ffff98f8f91ff000/lustre-MDD0000_UUID 00000020:01000000:0.0:1787384572.838154:0:15162:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1787384572.838158:0:15162:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787384572.838162:0:15162:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787384572.838165:0:15162:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff98f8f91f19c0) has no exports 00000020:00000080:0.0:1787384572.838182:0:15162:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787384572.838186:0:15162:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1787384572.838189:0:15162:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba2346 00000020:00000080:0.0:1787384572.838192:0:15162:0:(genops.c:906:class_export_put()) final put ffff98f8f91fb000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787384572.838200:0:15162:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f8c896e000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1787384572.838204:0:15162:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f8c896e000 3 00000020:01000004:0.0:1787384572.838207:0:15162:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98f8c896e000 from lustre-MDT0000 00000020:00000080:0.0:1787384572.838223:0:15162:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787384572.838227:0:15162:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1787384572.838229:0:15162:0:(genops.c:906:class_export_put()) final put ffff98f8d9698000/lustre-MDT0000_UUID 00000020:00000080:0.0:1787384572.838240:0:15162:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8d9698000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1787384572.838246:0:15162:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1787384572.838274:0:15162:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1787384572.838278:0:15162:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1787384572.838280:0:15162:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1787384572.838282:0:15162:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787384572.838284:0:15162:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787384572.838290:0:15162:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff98f8f87a2800 ca80b7f5-0e34-441a-981f-ebff717028c4 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787384572.838295:0:15162:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff98f8fc2b0000) has exports, disconnecting them 00000020:00080000:0.0:1787384572.838299:0:15162:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff98f8f87a2800), last request at 1787384303 00000020:00000080:0.0:1787384572.838310:0:15162:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba22e4 00000020:00010000:0.0:1787384572.838313:0:15162:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98f8f87a2800: total 2 00000100:00080000:0.0:1787384572.838317:0:15162:0:(import.c:65:import_set_state_nolock()) ffff98f8f1947800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787384572.838326:0:15162:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98f8f87a2800): rc 0 00000020:00080000:0.0:1787384572.838329:0:15162:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff98f8fc2b0000) has no exports 00000100:00100000:0.0:1787384572.838380:0:6516:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff98f8f974d400:6516] 2 exiting: rc = 0 00000100:00100000:0.0:1787384572.843260:0:6514:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff98f8fc1cde00:6514] 0 exiting: rc = 1 00000020:00010000:1.0:1787384572.843855:0:6510:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98f8f87a2800: total 2 00010000:00010000:1.0:1787384572.843918:0:6510:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98f8f87a2800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1787384572.843953:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c3952a00/0x7ef423838fba280f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ef423838fba2808 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384572.843988:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c3953200/0x7ef423838fba281d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ef423838fba2816 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384572.844000:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8d965b800/0x7ef423838fba2a85 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ef423838fba2a7e expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384572.844010:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f58cca00/0x7ef423838fba282b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ef423838fba2824 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384572.844020:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8c0031400/0x7ef423838fba23e0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ef423838fba23d9 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384572.844033:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c2091600/0x7ef423838fba2839 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ef423838fba2832 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384572.844042:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8cad39000/0x7ef423838fba23ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ef423838fba23e7 expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384572.844054:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c2091a00/0x7ef423838fba2a77 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ef423838fba2a70 expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384572.844064:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c2091000/0x7ef423838fba2a93 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ef423838fba2a8c expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384572.844076:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f5824e00/0x7ef423838fba2705 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ef423838fba26fe expref: 5 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384572.844087:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f58cd400/0x7ef423838fba2801 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ef423838fba27fa expref: 4 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384572.844110:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f58cc400/0x7ef423838fba2863 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ef423838fba285c expref: 3 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384572.844120:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c3b04e00/0x7ef423838fba27f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ef423838fba27ec expref: 2 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384572.844130:0:6510:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98f8f87a2800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1787384572.844147:0:6510:0:(genops.c:906:class_export_put()) final put ffff98f8f87a2800/ca80b7f5-0e34-441a-981f-ebff717028c4 00010000:00010000:1.0:1787384572.844155:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384572.844156:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384572.844158:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787384572.844169:0:469:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8ee091800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1787384572.844175:0:469:0:(genops.c:906:class_export_put()) final put ffff98f8ee0ce000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787384572.844178:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8ee0ce000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1787384572.844189:0:469:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787384572.844251:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f91ff000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1787384572.844256:0:469:0:(genops.c:906:class_export_put()) final put ffff98f8d9699800/lustre-MDD0000_UUID 00000020:00000080:1.0:1787384572.844258:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8d9699800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1787384572.844262:0:469:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1787384572.844293:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f91fb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787384572.844297:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f87a2800/ca80b7f5-0e34-441a-981f-ebff717028c4 for MGS 00000020:00000080:1.0:1787384572.844322:0:469:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8f1947800 for MGS 00000100:00100000:0.0:1787384572.864368:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203378048:0@lo:400:kworker.0 00000100:00100000:0.0:1787384572.864435:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384572.864494:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787384572.864502:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203377920:0@lo:400:kworker.0 00000100:00100000:0.0:1787384572.864541:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384572.864574:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203378048 00000100:00100000:0.0:1787384572.864581:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203378048 00000100:00100000:0.0:1787384572.864618:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787384572.864626:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1874208203378048:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787384572.864634:0:6526:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787384572.864684:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1874208203378048:12345-0@lo:400:kworker.0 Request processed in 57us (248us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787384572.864706:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00080000:0.0:1787384572.864752:0:3652:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787384572.864758:0:3652:0:(import.c:65:import_set_state_nolock()) ffff98f8fd201000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787384572.864761:0:3652:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1787384572.868929:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874208203378176:0@lo:400:kworker.0 00000100:00100000:1.0:1787384572.868999:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384572.869035:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874208203378688:0@lo:400:kworker.0 00000100:00100000:1.0:1787384572.869058:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384572.869099:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787384572.869105:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee28b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203378304:0@lo:400:kworker.0 00000100:00100000:1.0:1787384572.869126:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384572.869147:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203378816:0@lo:400:kworker.0 00000100:00100000:1.0:1787384572.869170:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384572.869202:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203378176 00000100:00100000:1.0:1787384572.869209:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203378176 00000100:00100000:1.0:1787384572.869815:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203378688 00000100:00100000:1.0:1787384572.869820:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203378688 00000100:00100000:1.0:1787384572.869858:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203378304 00000100:00100000:1.0:1787384572.869861:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203378304 00000100:00100000:1.0:1787384572.869874:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1787384572.869884:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874208203378688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384572.870709:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874208203378688:12345-0@lo:400:kworker.0 Request processed in 823us (1645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384572.870719:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1787384572.870755:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787384572.870761:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3653:x1874208203378176:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787384572.870766:0:6523:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787384572.870819:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3653:x1874208203378176:12345-0@lo:400:kworker.0 Request processed in 57us (1820us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787384572.870825:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787384572.870836:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787384572.870841:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3653:x1874208203378304:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787384572.870845:0:6523:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787384572.870868:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3653:x1874208203378304:12345-0@lo:400:kworker.0 Request processed in 25us (1740us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787384572.870873:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:1.0:1787384572.870921:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787384572.870939:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874208203378432:0@lo:400:kworker.0 00000100:00100000:1.0:1787384572.870973:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384572.871000:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787384572.871007:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874208203378560:0@lo:400:kworker.0 00000100:00100000:1.0:1787384572.871028:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384572.871051:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203378432 00000100:00100000:1.0:1787384572.871055:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203378432 00000100:00100000:1.0:1787384572.871087:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203378560 00000100:00100000:1.0:1787384572.871090:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203378560 00000100:00100000:1.0:1787384572.871104:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1787384572.871110:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874208203378432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384572.871146:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874208203378432:12345-0@lo:400:kworker.0 Request processed in 36us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384572.871151:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1787384572.871163:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787384572.871166:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3651:x1874208203378560:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787384572.871171:0:6521:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787384572.871193:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3651:x1874208203378560:12345-0@lo:400:kworker.0 Request processed in 25us (165us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787384572.871198:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787384572.872905:0:6515:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff98f8c3c7f400:6515] 1 exiting: rc = 0 00000100:00080000:1.0:1787384572.873092:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787384572.873138:0:3653:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787384572.873144:0:3653:0:(import.c:65:import_set_state_nolock()) ffff98f8c8923800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787384572.873147:0:3653:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787384572.873152:0:3653:0:(import.c:65:import_set_state_nolock()) ffff98f8c8923800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787384572.873156:0:3653:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 239 00000100:00080000:1.0:1787384572.873175:0:3653:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98f8c8923800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:1.0:1787384572.873207:0:3653:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f7c422ca80 x1874208203378944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787384572.873231:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee28b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203378304:0@lo:400:kworker.0 00000100:00080000:1.0:1787384572.873246:0:3653:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787384572.873249:0:3653:0:(import.c:65:import_set_state_nolock()) ffff98f8f91fe800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787384572.873252:0:3653:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787384572.873255:0:3653:0:(import.c:65:import_set_state_nolock()) ffff98f8f91fe800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787384572.873258:0:3653:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 219 00000100:00080000:1.0:1787384572.873262:0:3653:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98f8f91fe800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:1.0:1787384572.873273:0:3653:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f7c422ed80 x1874208203379072/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787384572.873282:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874208203378176:0@lo:400:kworker.0 00010000:00080000:1.0:1787384572.873294:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f7c422c380 x1874208203378688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384572.873305:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874208203378688:0@lo:400:kworker.0 00000100:00080000:1.0:1787384572.873338:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787384572.873341:0:3651:0:(import.c:65:import_set_state_nolock()) ffff98f7c385f800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787384572.873343:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787384572.873346:0:3651:0:(import.c:65:import_set_state_nolock()) ffff98f7c385f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787384572.873349:0:3651:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 262 00000100:00080000:1.0:1787384572.873353:0:3651:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98f7c385f800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:1.0:1787384572.873372:0:3651:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f7c422c380 x1874208203379200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787384572.873381:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874208203378560:0@lo:400:kworker.0 00010000:00080000:1.0:1787384572.873395:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8ee289f80 x1874208203378432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384572.873403:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874208203378432:0@lo:400:kworker.0 00010000:00010000:1.0:1787384572.873425:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384572.873440:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203378816 00000100:00100000:1.0:1787384572.873446:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203378816 00000100:00100000:1.0:1787384572.873489:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787384572.873499:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203378816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384572.873567:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203378816:12345-0@lo:400:kworker.0 Request processed in 70us (4395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384572.873589:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:1.0:1787384572.873609:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787384572.873627:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203378816:0@lo:400:kworker.0 00000100:00100000:1.0:1787384572.873645:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1874208203378944:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1787384572.873674:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384572.873695:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874208203379072:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1787384572.873712:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384572.873741:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874208203379200:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1787384572.873760:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384572.873810:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203378944 00000100:00100000:1.0:1787384572.873814:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203378944 00000100:00100000:1.0:1787384572.873841:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203379072 00000100:00100000:1.0:1787384572.873845:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203379072 00000100:00100000:1.0:1787384572.873856:0:14031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203379200 00000100:00100000:1.0:1787384572.873859:0:14031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203379200 00000100:00100000:1.0:1787384572.873869:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787384572.873874:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3650:x1874208203378944:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1787384572.873892:0:14031:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787384572.873924:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3650:x1874208203378944:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 49us (249us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787384572.873930:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787384572.873940:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787384572.873944:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3650:x1874208203379072:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1787384572.873954:0:14031:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787384572.873976:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3650:x1874208203379072:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 29us (262us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787384572.873981:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787384572.873991:0:14031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1787384572.873994:0:14031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3650:x1874208203379200:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1787384572.874002:0:14031:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787384572.874025:0:14031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3650:x1874208203379200:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 29us (264us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787384572.874030:0:14031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:1.0:1787384572.874061:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8c8923800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787384572.874065:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787384572.874069:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1874208203378944:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1787384572.874076:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f91fe800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787384572.874084:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787384572.874087:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874208203379072:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1787384572.874096:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f7c385f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787384572.874099:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787384572.874101:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874208203379200:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1787384572.878342:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.878354:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.878360:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.878366:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.878371:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.878377:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.878382:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.878387:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.878393:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.878398:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.878404:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.878409:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.878414:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.878419:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.878424:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.878429:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.878434:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.878439:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.878444:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.878450:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.878456:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.878463:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.878468:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.878474:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.878479:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.878485:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.878491:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.878511:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.878517:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.878523:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.878540:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.878546:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.878551:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.880167:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.880187:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.880194:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.880199:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.880205:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.880223:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.880229:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.880235:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.880241:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.880247:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.880253:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.880258:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.880267:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.880272:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.880277:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.880281:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.880286:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.880291:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.880296:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.880302:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.880308:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.880313:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.880319:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.880325:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.880330:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.880336:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.880342:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.880348:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.880354:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384572.880376:0:15162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:0.0:1787384572.898151:0:3652:0:(import.c:65:import_set_state_nolock()) ffff98f8fd201000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787384572.898165:0:3652:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 219 00000100:00080000:0.0:1787384572.898175:0:3652:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98f8fd201000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:0.0:1787384572.898217:0:3652:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f7c3a80a80 x1874208203379328/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787384572.898247:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203378048:0@lo:400:kworker.0 00000100:00100000:1.0:1787384572.898323:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203379328:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1787384572.898389:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384572.898492:0:7933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203379328 00000100:00100000:0.0:1787384572.898500:0:7933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203379328 00000100:00100000:0.0:1787384572.898551:0:7933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1787384572.898558:0:7933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3650:x1874208203379328:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1787384572.898587:0:7933:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787384572.898633:0:7933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3650:x1874208203379328:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 74us (243us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787384572.898639:0:7933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00080000:0.0:1787384572.898676:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8fd201000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787384572.898681:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787384572.898684:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203379328:0@lo:38:ptlrpcd_00_01.0 00000020:01000000:1.0:1787384572.899512:0:15162:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98f7c386d900 - data ffff98f8c9748510/ffff98f8ee2e4800 00000020:01000000:1.0:1787384572.899641:0:15162:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98f8d138f360 - data ffff98f8c94141b0/ffff98f8e8a5ac00 00000020:00000080:1.0:1787384572.900515:0:15162:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba22c8 00000020:00000080:1.0:1787384572.900524:0:15162:0:(genops.c:906:class_export_put()) final put ffff98f8f1b63000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787384572.900547:0:15162:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f8c896e000 from MGS, refs=2 00000020:01000004:1.0:1787384572.900551:0:15162:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f8c896e000 2 00000020:01000004:1.0:1787384572.900554:0:15162:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98f8c896e000 from MGS 00000020:00000080:1.0:1787384572.900575:0:15162:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787384572.900581:0:15162:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1787384572.900584:0:15162:0:(genops.c:906:class_export_put()) final put ffff98f8d8505000/MGS 00000020:00000080:1.0:1787384572.900586:0:15162:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8d8505000/MGS for MGS 00000020:01000000:1.0:1787384572.900593:0:15162:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1787384572.900654:0:15162:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1787384572.900657:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f1b63000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787384572.900659:0:15162:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787384572.900666:0:15162:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787384572.900673:0:15162:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff98f8d969c800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787384572.900679:0:15162:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff98f8f91f3380) has exports, disconnecting them 00000020:00080000:1.0:1787384572.900684:0:15162:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff98f8d969c800), last request at 1787384303 00000020:00000080:1.0:1787384572.900688:0:15162:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba2393 00000020:00080000:1.0:1787384572.901277:0:15162:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98f8d969c800): rc 0 00000020:00000080:1.0:1787384572.901286:0:15162:0:(genops.c:906:class_export_put()) final put ffff98f8d969c800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787384572.901362:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8d969c800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787384572.905817:0:15162:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787384572.905826:0:15162:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787384572.905831:0:15162:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787384572.905838:0:15162:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787384572.905868:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8d969b000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787384572.906066:0:15162:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787384572.906075:0:15162:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1787384572.906080:0:15162:0:(genops.c:906:class_export_put()) final put ffff98f8f91f9800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1787384572.906083:0:15162:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f91f9800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1787384572.906089:0:15162:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787384572.906163:0:15162:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f8c896e000 1 00000020:00000080:0.0:1787384572.906169:0:15162:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba22ba 00000020:00000080:0.0:1787384572.906174:0:15162:0:(genops.c:906:class_export_put()) final put ffff98f8c896b800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1787384572.906181:0:15162:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787384572.906190:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8c896b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787384572.906198:0:15162:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787384572.906202:0:15162:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787384572.906205:0:15162:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff98f8fc2b4d40) has no exports 00000020:00000080:2.0:1787384573.074250:0:15162:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787384573.074262:0:15162:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1787384573.074268:0:15162:0:(genops.c:906:class_export_put()) final put ffff98f8c896e800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787384573.074272:0:15162:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8c896e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787384573.074278:0:15162:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1787384573.074394:0:15162:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98f8c896c000 00000020:02000400:2.0:1787384573.074455:0:15162:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:2.0:1787384573.372159:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787384573.372181:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203379456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787384573.372247:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384573.372321:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203379456 00000100:00100000:2.0:1787384573.372328:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203379456 00000100:00100000:2.0:1787384573.372373:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787384573.372382:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203379456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787384573.372557:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787384573.372604:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203379456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 222us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384573.372612:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787384573.372673:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203379456:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787384573.880461:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384574.905992:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384575.932197:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787384576.514254:0:15362:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787384576.528500:0:15362:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1787384576.528552:0:15362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05c00/0x7ef423838fba2824 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba282b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384576.528568:0:15362:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05c00/0x7ef423838fba2824 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba282b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384576.528576:0:15362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05c00/0x7ef423838fba2824 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba282b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384576.528582:0:15362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05c00/0x7ef423838fba2824 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba282b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384576.528620:0:15362:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787384576.528625:0:15362:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787384576.528655:0:15362:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787384576.528659:0:15362:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787384576.528665:0:15362:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787384576.528670:0:15362:0:(import.c:65:import_set_state_nolock()) ffff98f8f91fe800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1787384576.528674:0:15362:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787384576.528676:0:15362:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787384576.528679:0:15362:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787384576.529642:0:15362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04600/0x7ef423838fba2832 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2839 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384576.529654:0:15362:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04600/0x7ef423838fba2832 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2839 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384576.529661:0:15362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04600/0x7ef423838fba2832 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba2839 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384576.529667:0:15362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04600/0x7ef423838fba2832 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba2839 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384576.529690:0:15362:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787384576.529709:0:15362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba26fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2705 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384576.529716:0:15362:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba26fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2705 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384576.529736:0:15362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba26fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba2705 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384576.529742:0:15362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba26fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba2705 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384576.529766:0:15362:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787384576.529773:0:15362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c2091e00/0x7ef423838fba2a8c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2a93 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384576.529805:0:15362:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c2091e00/0x7ef423838fba2a8c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2a93 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384576.529811:0:15362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c2091e00/0x7ef423838fba2a8c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba2a93 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384576.529817:0:15362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.145@tcp lock: ffff98f7c2091e00/0x7ef423838fba2a8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba2a93 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384576.529929:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787384576.529937:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05c00/0x7ef423838fba2824 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba282b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384576.529955:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b05c00 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:1.0:1787384576.529959:0:8453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05c00/0x7ef423838fba2824 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba282b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384576.529967:0:8453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05c00/0x7ef423838fba2824 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ef423838fba282b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787384576.529975:0:8453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05c00/0x7ef423838fba2824 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ef423838fba282b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384576.529980:0:8453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787384576.529983:0:8453:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787384576.529986:0:8453:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787384576.530020:0:8453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05c00/0x7ef423838fba2824 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba282b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384576.530026:0:8453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787384576.530048:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05c00/0x7ef423838fba2824 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba282b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384576.530055:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05c00/0x7ef423838fba2824 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba282b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384576.530069:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787384576.530072:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04600/0x7ef423838fba2832 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba2839 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384576.530078:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b04600 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:1.0:1787384576.530081:0:8453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04600/0x7ef423838fba2832 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba2839 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384576.530095:0:8453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04600/0x7ef423838fba2832 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ef423838fba2839 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787384576.530102:0:8453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04600/0x7ef423838fba2832 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ef423838fba2839 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384576.530106:0:8453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787384576.530108:0:8453:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:1.0:1787384576.530122:0:8453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04600/0x7ef423838fba2832 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba2839 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384576.530128:0:8453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787384576.530142:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04600/0x7ef423838fba2832 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba2839 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384576.530148:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04600/0x7ef423838fba2832 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba2839 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384576.530163:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384576.530167:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba26fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba2705 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384576.530172:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f902158c00 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:1.0:1787384576.530174:0:8453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba26fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba2705 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384576.530181:0:8453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba26fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ef423838fba2705 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787384576.530187:0:8453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba26fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ef423838fba2705 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384576.530198:0:8453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1787384576.530200:0:8453:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1787384576.530202:0:8453:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1787384576.530216:0:8453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba26fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba2705 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384576.530222:0:8453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787384576.530229:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba26fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba2705 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384576.530236:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f902158c00/0x7ef423838fba26fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba2705 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384576.530250:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384576.530252:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384576.530254:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384576.530276:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203379584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384576.530340:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384576.530406:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203379712:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384576.530429:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384576.530446:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787384576.530453:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203379840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384576.530472:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384576.530506:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203379584 00000100:00100000:1.0:1787384576.530513:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203379584 00000100:00100000:1.0:1787384576.530545:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203379712 00000100:00100000:1.0:1787384576.530549:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203379712 00000100:00100000:1.0:1787384576.530562:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203379840 00000100:00100000:1.0:1787384576.530572:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203379840 00000100:00100000:1.0:1787384576.530589:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787384576.530597:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f1b46c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3652:x1874208203379584:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787384576.530603:0:6509:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787384576 with bad export cookie 9147975791055348452 00010000:00010000:3.0:1787384576.530890:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384576.530980:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384576.531196:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787384576.531203:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3653:x1874208203379712:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787384576.531208:0:10399:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787384576 with bad export cookie 9147975791055348452 00000100:00100000:2.0:1787384576.531272:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3653:x1874208203379712:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (841us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787384576.531287:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787384576.531305:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787384576.531310:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3653:x1874208203379840:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787384576.531314:0:10399:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787384576 with bad export cookie 9147975791055348452 00000100:00100000:2.0:1787384576.531342:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3653:x1874208203379840:12345-0@lo:103:ldlm_bl.0 Request processed in 31us (869us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787384576.531349:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1787384576.531424:0:3653:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.145@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787384576.531429:0:3653:0:(import.c:65:import_set_state_nolock()) ffff98f8f943d800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1787384576.531433:0:3653:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.145@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:0.0:1787384576.531486:0:15362:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787384576.531496:0:15362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc600/0x7ef423838fba23e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba23ee expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384576.531504:0:15362:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc600/0x7ef423838fba23e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba23ee expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384576.531510:0:15362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc600/0x7ef423838fba23e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba23ee expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384576.531528:0:15362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc600/0x7ef423838fba23e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba23ee expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384576.531541:0:15362:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787384576.531545:0:15362:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:0.0:1787384576.531549:0:15362:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1787384576.531576:0:15362:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1787384576.531581:0:15362:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1787384576.531585:0:15362:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787384576.531590:0:15362:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1787384576.531595:0:15362:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff98f8f7d8a000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787384576.531601:0:15362:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff98f7c2892000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787384576.531606:0:15362:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff98f8f91f0000) has exports, disconnecting them 00000020:00080000:0.0:1787384576.531610:0:15362:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff98f8f7d8a000), last request at 1787384572 00000020:00000080:0.0:1787384576.531616:0:15362:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba26c6 00000100:00080000:0.0:1787384576.531630:0:15362:0:(import.c:65:import_set_state_nolock()) ffff98f8f7d8f000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787384576.531672:0:15362:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98f8f7d8a000): rc 0 00000020:00000080:0.0:1787384576.531675:0:15362:0:(genops.c:906:class_export_put()) final put ffff98f8f7d8a000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1787384576.531684:0:15362:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff98f7c2892000), last request at 1787384572 00000020:00000080:0.0:1787384576.531688:0:15362:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba25a0 00000100:00080000:0.0:1787384576.531692:0:15362:0:(import.c:65:import_set_state_nolock()) ffff98f7c2897800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787384576.531710:0:15362:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98f7c2892000): rc 0 00000020:00000080:0.0:1787384576.531712:0:15362:0:(genops.c:906:class_export_put()) final put ffff98f7c2892000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1787384576.531718:0:15362:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffac694184bae0 00000100:00080000:0.0:1787384576.531736:0:15362:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787384576.531738:0:15362:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:0.0:1787384576.532513:0:15362:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787384576.532528:0:15362:0:(import.c:65:import_set_state_nolock()) ffff98f8fd201000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:2.0:1787384576.534906:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787384576.534919:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f7c2091e00/0x7ef423838fba2a8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba2a93 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384576.534932:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2091e00 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384576.534935:0:8453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f7c2091e00/0x7ef423838fba2a8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba2a93 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384576.534945:0:8453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f7c2091e00/0x7ef423838fba2a8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ef423838fba2a93 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384576.534953:0:8453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f7c2091e00/0x7ef423838fba2a8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ef423838fba2a93 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384576.534959:0:8453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787384576.534962:0:8453:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787384576.534965:0:8453:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:1.0:1787384576.540558:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f1b46c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3652:x1874208203379584:12345-0@lo:103:ldlm_bl.0 Request processed in 9952us (10209us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787384576.540573:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1787384576.540642:0:3652:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.145@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000020:00000080:0.0:1787384576.547968:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f7d8a000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1787384576.548022:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c2892000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1787384576.548044:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8f7d8f000 for lustre-MDT0001 00000020:00000080:0.0:1787384576.548049:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f7c2897800 for lustre-MDT0001 00010000:00010000:0.0:1787384576.548060:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384576.548068:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc600/0x7ef423838fba23e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba23ee expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384576.548078:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cc600 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:0.0:1787384576.548082:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc600/0x7ef423838fba23e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba23ee expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384576.548092:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc600/0x7ef423838fba23e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ef423838fba23ee expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787384576.548100:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc600/0x7ef423838fba23e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ef423838fba23ee expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384576.548107:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787384576.548110:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787384576.548112:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00080000:3.0:1787384576.563422:0:3653:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.145@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1787384576.563427:0:3653:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787384576.563437:0:3653:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f8ee28bb80 x1874208203377920/t0(0) o400->MGC192.168.203.145@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787384588 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384576.563453:0:3653:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f7c422ed80 x1874208203379584/t0(0) o103->MGC192.168.203.145@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787384592 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384576.563461:0:3653:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f7c422ca80 x1874208203379712/t0(0) o103->MGC192.168.203.145@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787384592 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384576.563494:0:3653:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f7c422f800 x1874208203379840/t0(0) o103->MGC192.168.203.145@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787384592 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787384576.563509:0:3653:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787384576.563512:0:3653:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787384576.563513:0:3653:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787384576.563518:0:3653:0:(import.c:65:import_set_state_nolock()) ffff98f8f943d800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787384576.563523:0:3653:0:(import.c:510:import_select_connection()) MGC192.168.203.145@tcp: connect to NID 0@lo last attempt 198 00000100:00080000:3.0:1787384576.563533:0:3653:0:(import.c:624:import_select_connection()) MGC192.168.203.145@tcp: import ffff98f8f943d800 using connection 192.168.203.145@tcp/0@lo 00010000:00010000:0.0:1787384576.563607:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc600/0x7ef423838fba23e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba23ee expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384576.563617:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787384576.563648:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc600/0x7ef423838fba23e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba23ee expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384576.563656:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc600/0x7ef423838fba23e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba23ee expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384576.563686:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384576.563689:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384576.563691:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787384576.563794:0:15362:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787384576.563799:0:15362:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1787384576.563811:0:15362:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787384576.563880:0:15362:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787384576.563896:0:15362:0:(import.c:65:import_set_state_nolock()) ffff98f8d969a800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787384576.563908:0:15362:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787384576.563910:0:15362:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1787384576.563923:0:15362:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787384576.563996:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203380096:0@lo:9:umount.0 00000100:00100000:3.0:1787384576.564007:0:3653:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f91d9880 x1874208203380224/t0(0) o250->MGC192.168.203.145@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787384576.564034:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203379712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787384576.564056:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ca80b7f5-0e34-441a-981f-ebff717028c4:3653:1874208203379840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384576.564614:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384576.564657:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ca80b7f5-0e34-441a-981f-ebff717028c4:3650:1874208203380224:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:0.0:1787384576.564678:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874208203380224 offset 0 length 520: 4 00000100:00080000:0.0:1787384576.564721:0:15362:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787384576.564734:0:15362:0:(import.c:65:import_set_state_nolock()) ffff98f8f7d24800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787384576.564754:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203380352:0@lo:9:umount.0 00000100:00100000:0.0:1787384576.564798:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1787384576.564845:0:15362:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff98f8f91f0000) has no exports 00000100:00080000:1.0:1787384576.565054:0:3652:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff98f8f943d800 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:1.0:1787384576.565071:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:0:1874208203379968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384576.565504:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203380096 00000100:00100000:1.0:1787384576.565512:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203380096 00000100:00100000:1.0:1787384576.565570:0:8890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203380352 00000100:00100000:1.0:1787384576.565574:0:8890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203380352 00000100:00100000:1.0:1787384576.565597:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787384576.565605:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1874208203380096:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787384576.565629:0:8890:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba25fb 00000100:00080000:1.0:1787384576.565636:0:8890:0:(import.c:65:import_set_state_nolock()) ffff98f8ee311000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787384576.565675:0:8890:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1787384576.565860:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3650:x1874208203380096:12345-0@lo:9:umount.0 Request processed in 255us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384576.565868:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787384576.565884:0:8890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787384576.565891:0:8890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1874208203380352:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787384576.565903:0:8890:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba272f 00000100:00080000:1.0:1787384576.565909:0:8890:0:(import.c:65:import_set_state_nolock()) ffff98f8f7d27800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787384576.565925:0:8890:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1787384576.566015:0:8890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3650:x1874208203380352:12345-0@lo:9:umount.0 Request processed in 124us (1236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384576.566021:0:8890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1787384576.566195:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787384576.566200:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787384576.567270:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f7d24800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787384576.567279:0:3650:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787384576.567281:0:3650:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787384576.567286:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203380352:0@lo:9:umount.0 00000100:00080000:1.0:1787384576.567301:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8d969a800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787384576.567316:0:3650:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787384576.567317:0:3650:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787384576.567320:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203380096:0@lo:9:umount.0 00010000:00010000:1.0:1787384576.567346:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384576.567358:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203377920:0@lo:400:kworker.0 00000100:00100000:1.0:1787384576.567373:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ca80b7f5-0e34-441a-981f-ebff717028c4:3652:1874208203379584:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787384576.567417:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384576.570026:0:8453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f7c2091e00/0x7ef423838fba2a8c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba2a93 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384576.570045:0:8453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787384576.570075:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f7c2091e00/0x7ef423838fba2a8c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba2a93 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384576.570096:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f7c2091e00/0x7ef423838fba2a8c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ef423838fba2a93 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384576.570120:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787384576.570146:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ca80b7f5-0e34-441a-981f-ebff717028c4:0:1874208203380480:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787384576.570173:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384576.570176:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384576.570180:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787384576.581645:0:15362:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff98f8f91f0000) has no exports 00000020:01000000:2.0:1787384576.624990:0:15362:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98f7c386d1e0 - data ffff98f8c973b510/ffff98f8ee2e4000 00000020:01000000:2.0:1787384576.625130:0:15362:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98f8d944a4e0 - data ffff98f8c9549510/ffff98f8ee03e400 00000001:00000004:2.0:1787384576.645947:0:15362:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1787384576.687935:0:15362:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787384576.687944:0:15362:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1787384576.687952:0:15362:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787384576.693221:0:15362:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787384576.693229:0:15362:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1787384576.693289:0:15362:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787384576.693293:0:15362:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787384576.695484:0:8881:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787384576.695491:0:8881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1787384576.695502:0:8881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1787384576.696535:0:15362:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787384576.696541:0:15362:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:3.0:1787384576.696562:0:15362:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787384576.696564:0:15362:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787384576.697078:0:9825:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787384576.697082:0:9825:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:2.0:1787384576.697090:0:9825:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1787384576.700977:0:15362:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba240a 00000020:00000080:3.0:1787384576.700989:0:15362:0:(genops.c:906:class_export_put()) final put ffff98f8f91ff800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787384576.701418:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f91ff800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787384576.708373:0:15362:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba241f 00000020:00000080:3.0:1787384576.708388:0:15362:0:(genops.c:906:class_export_put()) final put ffff98f8f594d800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787384576.708443:0:15362:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1787384576.708449:0:15362:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787384576.708457:0:15362:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787384576.708461:0:15362:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff98f8f91f4d40) has no exports 00000004:01000000:3.0:1787384576.708629:0:15362:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787384576.708638:0:15362:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba2728 00000020:00000080:3.0:1787384576.708642:0:15362:0:(genops.c:906:class_export_put()) final put ffff98f7c3859000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787384576.709250:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f594d800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1787384576.709502:0:15362:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1787384576.709511:0:15362:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787384576.709519:0:15362:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787384576.709523:0:15362:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff98f8f1814d40) has no exports 00000020:00000080:3.0:1787384576.709531:0:15362:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba2721 00000020:00000080:3.0:1787384576.709537:0:15362:0:(genops.c:906:class_export_put()) final put ffff98f8f7d25800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787384576.709560:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c3859000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:3.0:1787384576.711981:0:15362:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1787384576.711990:0:15362:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787384576.711993:0:15362:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1787384576.712001:0:15362:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787384576.712003:0:15362:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787384576.712081:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f7d25800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787384576.712205:0:15362:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787384576.712219:0:15362:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787384576.712228:0:15362:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba25e6 00000020:00000080:3.0:1787384576.712245:0:15362:0:(genops.c:906:class_export_put()) final put ffff98f8ee25c800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787384576.712996:0:469:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8f7d24800 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1787384576.713010:0:469:0:(genops.c:906:class_export_put()) final put ffff98f8ee313000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787384576.713026:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8ee313000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1787384576.713038:0:469:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1787384576.714009:0:15362:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1787384576.714019:0:15362:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787384576.714029:0:15362:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787384576.714033:0:15362:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff98f8f9688000) has no exports 00000020:00000080:3.0:1787384576.714040:0:15362:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba25df 00000020:00000080:3.0:1787384576.714046:0:15362:0:(genops.c:906:class_export_put()) final put ffff98f8d9b5c800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787384576.714066:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8ee25c800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00010000:01000000:3.0:1787384576.714566:0:15362:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1787384576.714571:0:15362:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787384576.714575:0:15362:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1787384576.714581:0:15362:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787384576.714584:0:15362:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787384576.714940:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8d9b5c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787384576.722534:0:15362:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787384576.722553:0:15362:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1787384576.722569:0:15362:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1787384576.722577:0:15362:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba2442 00000020:00000080:3.0:1787384576.722586:0:15362:0:(genops.c:906:class_export_put()) final put ffff98f8f5948800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787384576.724445:0:469:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8d969a800 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1787384576.724464:0:469:0:(genops.c:906:class_export_put()) final put ffff98f8ee25b800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787384576.724467:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8ee25b800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1787384576.724476:0:469:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1787384576.725422:0:15362:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1787384576.725440:0:15362:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787384576.725450:0:15362:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787384576.725454:0:15362:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff98f8f5938000) has no exports 00000020:00000080:3.0:1787384576.725462:0:15362:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba243b 00000020:00000080:3.0:1787384576.725470:0:15362:0:(genops.c:906:class_export_put()) final put ffff98f8fd204000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787384576.725580:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f5948800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1787384576.725587:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8fd204000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1787384576.752200:0:15362:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1787384576.752208:0:15362:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787384576.752213:0:15362:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1787384576.752221:0:15362:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787384576.752283:0:15362:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787384576.752294:0:15362:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787384576.752318:0:15362:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787384576.752320:0:15362:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787384576.752325:0:15362:0:(genops.c:906:class_export_put()) final put ffff98f8f91f8800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787384576.752329:0:469:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8fd201000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1787384576.752330:0:15362:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f91f8800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:2.0:1787384576.752341:0:469:0:(genops.c:906:class_export_put()) final put ffff98f8f91fe000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787384576.752344:0:15362:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787384576.752345:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f91fe000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1787384576.752357:0:469:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787384576.752538:0:15362:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba2426 00000020:00000080:3.0:1787384576.752545:0:15362:0:(genops.c:906:class_export_put()) final put ffff98f8f594a800/lustre-MDD0001_UUID 00000020:01000000:3.0:1787384576.752567:0:15362:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1787384576.752572:0:15362:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787384576.752577:0:15362:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787384576.752581:0:15362:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff98f8f593cd40) has no exports 00000020:00000080:2.0:1787384576.752595:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f594a800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1787384576.752614:0:15362:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787384576.752619:0:15362:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1787384576.752622:0:15362:0:(genops.c:906:class_export_put()) final put ffff98f8f91fd800/lustre-MDD0001_UUID 00000020:00000080:3.0:1787384576.752624:0:15362:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f91fd800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1787384576.752629:0:15362:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1787384576.752949:0:15362:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba242d 00000020:00000080:3.0:1787384576.752955:0:15362:0:(genops.c:906:class_export_put()) final put ffff98f8f5949000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787384576.752995:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f5949000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000004:1.0:1787384576.753016:0:15362:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f8f5698000 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1787384576.753020:0:15362:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f8f5698000 2 00000020:01000004:1.0:1787384576.753023:0:15362:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98f8f5698000 from lustre-MDT0001 00000020:00000080:1.0:1787384576.753051:0:15362:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787384576.753057:0:15362:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1787384576.753060:0:15362:0:(genops.c:906:class_export_put()) final put ffff98f8f91fb800/lustre-MDT0001_UUID 00000020:00000080:1.0:1787384576.753062:0:15362:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f91fb800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1787384576.753068:0:15362:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1787384576.753114:0:15362:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1787384576.753128:0:15362:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1787384576.753131:0:15362:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787384576.753135:0:15362:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787384576.753141:0:15362:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff98f8fc239800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787384576.753146:0:15362:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff98f8f54b3380) has exports, disconnecting them 00000020:00080000:1.0:1787384576.753151:0:15362:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff98f8fc239800), last request at 1787384324 00000020:00000080:1.0:1787384576.753154:0:15362:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba2481 00000020:00080000:1.0:1787384576.753165:0:15362:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98f8fc239800): rc 0 00000020:00000080:1.0:1787384576.753169:0:15362:0:(genops.c:906:class_export_put()) final put ffff98f8fc239800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1787384576.754933:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8fc239800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1787384576.788991:0:15362:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1787384576.789001:0:15362:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787384576.789005:0:15362:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787384576.789012:0:15362:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787384576.789167:0:15362:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787384576.789176:0:15362:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1787384576.789259:0:15362:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f8f5698000 1 00000020:00000080:1.0:1787384576.789268:0:15362:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba23bd 00000020:00000080:1.0:1787384576.789277:0:15362:0:(genops.c:906:class_export_put()) final put ffff98f8c8924000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1787384576.789284:0:15362:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1787384576.789292:0:15362:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787384576.789298:0:15362:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787384576.789301:0:15362:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff98f8f968b380) has no exports 00000020:00000080:3.0:1787384576.789364:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8f91fe800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1787384576.789385:0:36:0:(genops.c:906:class_export_put()) final put ffff98f8c8923000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1787384576.789388:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8c8923000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1787384576.789400:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1787384576.789481:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8c8924000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1787384576.954588:0:15362:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787384576.954602:0:15362:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1787384576.954608:0:15362:0:(genops.c:906:class_export_put()) final put ffff98f8f569e800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787384576.954613:0:15362:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f569e800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1787384576.954702:0:15362:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1787384576.955433:0:15362:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98f8f569f000 00000020:01000000:0.0:1787384576.955591:0:15362:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1787384576.955598:0:15362:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787384576.955601:0:15362:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787384576.955606:0:15362:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff98f8f1810000) has no exports 00000100:00100000:3.0:1787384576.960098:0:6522:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff98f8f1b1b200:6522] 1 exiting: rc = 0 00000100:00100000:3.0:1787384576.960201:0:8195:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff98f8ee0ab600:8195] 3 exiting: rc = 0 00000100:00100000:2.0:1787384576.960422:0:14031:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff98f8d913ca00:14031] 4 exiting: rc = 0 00000100:00100000:1.0:1787384576.961140:0:6521:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff98f8f974c000:6521] 0 exiting: rc = 1 00000100:00100000:1.0:1787384576.961211:0:6523:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff98f8d8e87800:6523] 2 exiting: rc = 0 00010000:00010000:1.0:1787384576.961262:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384576.961417:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.961426:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.961433:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.961438:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.961444:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.961450:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.961523:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.961530:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.961536:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.961541:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.961546:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.961552:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.961566:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.961572:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.961577:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.961583:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.961589:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.961595:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.961601:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.961606:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.961612:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.961617:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.961635:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.961642:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.961647:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.961652:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.961657:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.961981:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.961987:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.961992:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.961997:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.962003:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.962008:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.962013:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.962018:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.962024:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.962029:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.962035:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.962040:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.962045:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.962051:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.962056:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.962061:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.962066:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.962071:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.962076:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.962082:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.962087:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.962092:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.962097:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.962102:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.962107:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.962112:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.962118:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.962123:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.962128:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.962132:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.962137:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.962142:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.962148:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.962153:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.962159:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.962172:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384576.962178:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384576.972959:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff98f8f1b94c00:6525] 1 exiting: rc = 0 00000100:00100000:3.0:1787384576.976254:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff98f8d8e87200:6524] 0 exiting: rc = 1 00000100:00100000:1.0:1787384576.976430:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976439:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976445:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976450:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976456:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976472:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976493:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976501:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976507:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976513:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976519:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976526:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976533:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976539:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976544:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976549:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976554:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976559:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976565:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976570:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976574:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976591:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976598:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976604:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976609:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976614:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976620:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976625:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976740:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976745:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976750:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976755:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976760:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976766:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976773:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976864:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976875:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976884:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976895:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976905:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976913:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976927:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976931:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976936:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976941:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976953:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976958:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976963:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976968:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976973:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976978:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976983:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976989:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976994:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.976999:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.977004:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.977010:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.977014:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.977018:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.977022:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.977027:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.977032:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.977037:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.977042:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384576.978750:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff98f8c7230400:6527] 1 exiting: rc = 0 00000100:00100000:1.0:1787384576.979343:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff98f8f1b1be00:6526] 0 exiting: rc = 1 00000100:00100000:2.0:1787384576.980160:0:7933:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff98f8f1b94a00:7933] 2 exiting: rc = 0 00000100:00100000:1.0:1787384576.988769:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989113:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989123:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989130:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989146:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989153:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989159:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989165:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989171:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989177:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989183:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989200:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989207:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989213:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989220:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989226:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989248:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989257:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989264:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989270:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989276:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989282:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989289:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989294:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989301:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989306:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989312:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989319:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989340:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989348:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989354:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989360:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989367:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989374:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989379:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989386:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989393:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989399:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989405:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989411:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989430:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989437:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989443:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989449:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989455:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989461:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989484:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989490:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989495:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989502:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989508:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989514:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989534:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989541:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989546:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989552:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989558:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989564:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989569:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989574:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989580:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989586:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989591:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384576.989597:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.014529:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff98f8d8e42e00:6528] 0 exiting: rc = 1 00000100:00100000:3.0:1787384577.016883:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff98f8d8e43a00:6529] 1 exiting: rc = 0 00000100:00100000:0.0:1787384577.017023:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017032:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017037:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017043:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017048:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017053:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017057:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017062:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017066:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017070:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017075:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017079:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017084:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017089:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017093:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017098:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017103:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017108:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017113:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017119:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017124:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017129:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017134:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017138:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017143:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017148:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017171:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017175:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017179:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017184:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017188:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017193:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017198:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017203:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017208:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017212:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017217:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017222:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017227:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017232:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017238:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017243:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017249:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017253:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017258:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017262:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017266:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017271:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017276:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017280:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017284:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017289:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017295:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017299:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017304:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017309:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017313:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017318:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017323:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017327:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017331:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017344:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017348:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.017352:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384577.018198:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff98f8d8e43e00:6530] 0 exiting: rc = 1 00000100:00100000:1.0:1787384577.018356:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff98f8d8e43000:6531] 1 exiting: rc = 0 00000100:00100000:0.0:1787384577.018605:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.018613:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.018618:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.018624:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.018629:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.018635:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.018640:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.018645:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.018649:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.018654:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.018659:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.018665:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.018670:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.018676:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.018681:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.018686:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.018702:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.018708:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.018713:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.018719:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.018723:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.018729:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.018734:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.018739:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.018744:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.018750:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.018755:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.018760:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.018765:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.018770:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.018775:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.019124:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.019140:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.019146:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.019151:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.019157:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.019162:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.019168:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.019173:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.019179:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.019184:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.019189:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.019194:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.019198:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.019203:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.019208:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.019213:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.019217:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.019222:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.019227:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.019231:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.019236:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.019241:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.019245:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.019250:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.019256:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.019261:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.019265:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.019271:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.019276:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.019281:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.019286:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.019291:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.019295:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384577.020108:0:6533:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff98f8d8e42200:6533] 1 exiting: rc = 0 00000100:00100000:3.0:1787384577.020298:0:6532:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff98f8d8e43800:6532] 0 exiting: rc = 1 00000100:00100000:1.0:1787384577.020368:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020375:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020380:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020386:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020391:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020396:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020401:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020406:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020411:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020417:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020422:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020427:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020431:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020435:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020440:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020455:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020459:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020464:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020538:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020544:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020549:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020553:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020558:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020562:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020566:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020571:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020575:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020580:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020585:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020589:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020594:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020598:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020602:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020606:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020611:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020615:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020620:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020624:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020630:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020635:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020640:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020645:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020649:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020654:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020658:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020662:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020666:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020671:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020676:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020681:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020705:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020710:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020715:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020719:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020723:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020728:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020732:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020736:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020740:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020744:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020748:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020752:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020756:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.020761:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384577.021946:0:6534:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff98f8d8e42800:6534] 0 exiting: rc = 1 00000100:00100000:2.0:1787384577.022329:0:6535:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff98f8c5d97800:6535] 1 exiting: rc = 0 00000100:00100000:2.0:1787384577.022492:0:6536:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff98f8d8e43600:6536] 2 exiting: rc = 0 00000100:00100000:1.0:1787384577.022634:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022641:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022655:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022661:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022668:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022673:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022679:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022684:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022689:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022703:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022709:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022715:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022720:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022727:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022733:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022738:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022744:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022749:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022771:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022802:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022808:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022824:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022830:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022835:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022840:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022845:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022851:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022856:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022861:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022866:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022871:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022876:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022882:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022887:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022892:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022897:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022902:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022907:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022912:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022917:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022922:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022928:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022946:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022953:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022958:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022964:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022969:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022974:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022979:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.022985:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.023001:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.023008:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.023013:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.023019:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.023025:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.023030:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.023042:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.023047:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.023052:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.023057:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.023063:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.023068:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.023074:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384577.023087:0:15362:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787384577.029146:0:15362:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787384577.029161:0:15362:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1787384577.029167:0:15362:0:(genops.c:906:class_export_put()) final put ffff98f8c8921000/MDS_uuid 00000020:00000080:1.0:1787384577.029172:0:15362:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8c8921000/MDS_uuid for MDS 00000020:01000000:1.0:1787384577.029178:0:15362:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1787384577.029332:0:15362:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1787384577.975006:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787384577.975107:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) ca80b7f5-0e34-441a-981f-ebff717028c4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787384577.975112:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) ca80b7f5-0e34-441a-981f-ebff717028c4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787384577.975115:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787384577.975118:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787384577.975121:0:36:0:(import.c:65:import_set_state_nolock()) ffff98f8c8923800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787384577.975137:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 467 00000100:00080000:2.0:1787384577.975142:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787384577.975149:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98f8c8923800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:2.0:1787384577.975180:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f9148700 x1874208203380608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787384577.975227:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787384577.975231:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787384577.975233:0:36:0:(import.c:65:import_set_state_nolock()) ffff98f7c385f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787384577.975237:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 467 00000100:00080000:2.0:1787384577.975240:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787384577.975243:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98f7c385f800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:2.0:1787384577.975255:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f914a680 x1874208203380864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787384577.975335:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203380736:0@lo:400:kworker.0 00000400:00000100:3.0:1787384577.975386:0:3653:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874208203380736 offset 0 length 224: 4 00000100:00100000:3.0:1787384577.975440:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384577.975446:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874208203380992:0@lo:400:kworker.0 00000400:00000100:3.0:1787384577.975464:0:3653:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874208203380992 offset 0 length 224: 4 00000100:00100000:0.0:1787384577.977604:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1874208203380608:0@lo:38:kworker.0 00000400:00000100:0.0:1787384577.977668:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874208203380608 offset 0 length 520: 4 00000100:00100000:0.0:1787384577.977711:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874208203380864:0@lo:38:kworker.0 00000400:00000100:0.0:1787384577.977728:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874208203380864 offset 0 length 520: 4 00010000:00010000:3.0:1787384579.000086:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384580.022938:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787384580.461482:0:15563:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787384580.479979:0:15563:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1787384580.480039:0:15563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04a00/0x7ef423838fba2808 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba280f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384580.480054:0:15563:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04a00/0x7ef423838fba2808 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba280f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384580.480061:0:15563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04a00/0x7ef423838fba2808 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba280f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384580.480069:0:15563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04a00/0x7ef423838fba2808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba280f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384580.480089:0:15563:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787384580.480095:0:15563:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1787384580.480122:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384580.480128:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04a00/0x7ef423838fba2808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba280f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384580.480150:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b04a00 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:1.0:1787384580.480153:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04a00/0x7ef423838fba2808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba280f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384580.480161:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04a00/0x7ef423838fba2808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ef423838fba280f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787384580.480167:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04a00/0x7ef423838fba2808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ef423838fba280f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384580.480173:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787384580.480175:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787384580.480177:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787384580.480191:0:6510:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98f8f943d800 00010000:00010000:1.0:1787384580.480194:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04a00/0x7ef423838fba2808 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x7ef423838fba280f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384580.480200:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04a00/0x7ef423838fba2808 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x7ef423838fba280f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384580.480211:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384580.480213:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384580.480214:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787384580.480228:0:15563:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787384580.480239:0:15563:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f8f9148700 x1874208203380608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787384592 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384580.480255:0:15563:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787384580.480260:0:15563:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787384580.480265:0:15563:0:(import.c:65:import_set_state_nolock()) ffff98f8c8923800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1787384580.480277:0:15563:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787384580.480281:0:15563:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f8f9148700 x1874208203380608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787384592 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384580.480287:0:15563:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787384580.480290:0:15563:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:0.0:1787384580.486986:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1874208203380608:0@lo:38:kworker.0 00000100:00080000:1.0:1787384580.497086:0:15563:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787384580.497105:0:15563:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f8f914b100 x1874208203380736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384593 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384580.497299:0:15563:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787384580.497306:0:15563:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787384580.497329:0:15563:0:(import.c:65:import_set_state_nolock()) ffff98f7c2894800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787384580.497533:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3650:1874208203381120:0@lo:39:umount.0 00000400:00000100:0.0:1787384580.497583:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874208203381120 offset 0 length 224: 4 00000100:00100000:3.0:1787384580.500199:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203380736:0@lo:400:kworker.0 00000100:00080000:1.0:1787384580.983055:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) ca80b7f5-0e34-441a-981f-ebff717028c4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787384580.983065:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) ca80b7f5-0e34-441a-981f-ebff717028c4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787384580.983068:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787384580.983071:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787384580.983304:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787384580.983329:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874208203381248:0@lo:400:kworker.0 00000400:00000100:3.0:1787384580.983387:0:3652:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874208203381248 offset 0 length 224: 4 00010000:00010000:3.0:1787384581.047615:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787384582.072752:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787384582.072761:0:8432:0:(genops.c:906:class_export_put()) final put ffff98f8ee314000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787384582.072851:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8ee314000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787384582.072896:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8ee311000 for lustre-OST0000 00000001:00100000:1.0:1787384582.072985:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787384582.072989:0:9517:0:(genops.c:906:class_export_put()) final put ffff98f8f7d23800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787384582.073037:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f7d23800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787384582.073084:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8f7d27800 for lustre-OST0001 00010000:00010000:2.0:1787384582.073087:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787384583.031336:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) ca80b7f5-0e34-441a-981f-ebff717028c4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787384583.031346:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) ca80b7f5-0e34-441a-981f-ebff717028c4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787384583.031349:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787384583.031352:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787384583.031483:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787384583.031564:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203381376:0@lo:400:kworker.0 00000400:00000100:1.0:1787384583.031640:0:3651:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874208203381376 offset 0 length 224: 4 00010000:00010000:1.0:1787384583.098048:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384584.119608:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384585.144815:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384586.167015:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384586.678887:0:3650:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787384576/real 1787384576] req@ffff98f8f91d9880 x1874208203380224/t0(0) o250->MGC192.168.203.145@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787384586 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384586.678919:0:3650:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98f8f91d9880 x1874208203380224/t0(0) o250->MGC192.168.203.145@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787384586 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787384586.678937:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f943d800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787384586.678963:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1787384586.678967:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ca80b7f5-0e34-441a-981f-ebff717028c4:3650:1874208203380224:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:1.0:1787384586.679094:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) ca80b7f5-0e34-441a-981f-ebff717028c4->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787384586.679099:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1787384586.679102:0:469:0:(import.c:65:import_set_state_nolock()) ffff98f8f943d800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787384586.679107:0:469:0:(import.c:510:import_select_connection()) MGC192.168.203.145@tcp: connect to NID 0@lo last attempt 471 00000100:00080000:1.0:1787384586.679136:0:469:0:(import.c:589:import_select_connection()) MGC192.168.203.145@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787384586.679143:0:469:0:(import.c:624:import_select_connection()) MGC192.168.203.145@tcp: import ffff98f8f943d800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:1.0:1787384586.679171:0:469:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f7c422d180 x1874208203381504/t0(0) o250->MGC192.168.203.145@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787384586.679195:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787384586.679199:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787384586.679328:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ca80b7f5-0e34-441a-981f-ebff717028c4:3650:1874208203381504:0@lo:250:kworker.0 00000400:00000100:2.0:1787384586.679374:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874208203381504 offset 0 length 520: 4 00000100:00100000:3.0:1787384586.679605:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787384586.679616:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874208203381632:0@lo:400:kworker.0 00000400:00000100:3.0:1787384586.679653:0:3654:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874208203381632 offset 0 length 224: 4 00010000:00010000:2.0:1787384587.192069:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384588.215165:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384589.240065:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384590.266249:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384590.776896:0:3650:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787384580/real 1787384580] req@ffff98f7c422c380 x1874208203381120/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787384590 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384590.776940:0:3650:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98f7c422c380 x1874208203381120/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787384590 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787384590.776959:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f7c2894800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787384590.776978:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3650:1874208203381120:0@lo:39:umount.0 00000100:00080000:1.0:1787384590.778230:0:15563:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787384590.778237:0:15563:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787384590.778244:0:15563:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787384590.779671:0:15563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05200/0x7ef423838fba2816 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba281d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384590.779689:0:15563:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05200/0x7ef423838fba2816 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba281d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384590.779696:0:15563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05200/0x7ef423838fba2816 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba281d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384590.779703:0:15563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05200/0x7ef423838fba2816 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba281d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384590.779731:0:15563:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384590.779739:0:15563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04200/0x7ef423838fba2a7e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2a85 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384590.779746:0:15563:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04200/0x7ef423838fba2a7e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2a85 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384590.779770:0:15563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04200/0x7ef423838fba2a7e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba2a85 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384590.779794:0:15563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04200/0x7ef423838fba2a7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba2a85 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384590.779819:0:15563:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787384590.779824:0:15563:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1787384590.779854:0:15563:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1787384590.779858:0:15563:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1787384590.779863:0:15563:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787384590.779867:0:15563:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787384590.779871:0:15563:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff98f8f59399c0) has no exports 00010000:00010000:2.0:1787384590.779993:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787384590.780000:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05200/0x7ef423838fba2816 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba281d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384590.780007:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b05200 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384590.780010:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05200/0x7ef423838fba2816 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba281d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384590.780018:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05200/0x7ef423838fba2816 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ef423838fba281d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384590.780025:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05200/0x7ef423838fba2816 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ef423838fba281d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384590.780031:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787384590.780033:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1787384590.780036:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1787384590.780056:0:6511:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98f8f943d800 00010000:00010000:2.0:1787384590.780060:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05200/0x7ef423838fba2816 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x7ef423838fba281d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384590.780066:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05200/0x7ef423838fba2816 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x7ef423838fba281d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384590.780079:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384590.780082:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04200/0x7ef423838fba2a7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba2a85 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384590.780087:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b04200 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384590.780090:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04200/0x7ef423838fba2a7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba2a85 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384590.780095:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04200/0x7ef423838fba2a7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ef423838fba2a85 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384590.780101:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04200/0x7ef423838fba2a7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ef423838fba2a85 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384590.780106:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787384590.780108:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787384590.780110:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787384590.780114:0:6511:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98f8f943d800 00010000:00010000:2.0:1787384590.780117:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04200/0x7ef423838fba2a7e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7ef423838fba2a85 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384590.780123:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04200/0x7ef423838fba2a7e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7ef423838fba2a85 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384590.780142:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384590.780144:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384590.780146:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787384590.780245:0:15563:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff98f8f59399c0) has no exports 00010000:00010000:3.0:1787384590.781315:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787384590.785503:0:15563:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98f8d944ade0 - data ffff98f8c966d6c0/ffff98f7c3ba6400 00000020:01000000:1.0:1787384590.788640:0:15563:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98f8d944a540 - data ffff98f8c95c2a20/ffff98f8efb76800 00100000:10000000:1.0:1787384590.798660:0:15563:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787384590.812579:0:15563:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba255a 00000020:00000080:1.0:1787384590.812590:0:15563:0:(genops.c:906:class_export_put()) final put ffff98f8ee35d800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1787384590.812614:0:15563:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f8f5669000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1787384590.812618:0:15563:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f8f5669000 2 00000020:01000004:1.0:1787384590.812621:0:15563:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98f8f5669000 from lustre-OST0000 00000020:00000080:1.0:1787384590.812649:0:15563:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787384590.812660:0:15563:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1787384590.812664:0:15563:0:(genops.c:906:class_export_put()) final put ffff98f8ee35c000/lustre-OST0000_UUID 00000020:00000080:1.0:1787384590.812667:0:15563:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8ee35c000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1787384590.812674:0:15563:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1787384590.812739:0:15563:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1787384590.812744:0:15563:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1787384590.812756:0:15563:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787384590.812761:0:15563:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787384590.812767:0:15563:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff98f7c2891000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787384590.812773:0:15563:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff98f8f593b380) has exports, disconnecting them 00000020:00080000:1.0:1787384590.812797:0:15563:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff98f7c2891000), last request at 1787384344 00000020:00000080:1.0:1787384590.812802:0:15563:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba2584 00000020:00080000:1.0:1787384590.812811:0:15563:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98f7c2891000): rc 0 00000020:00000080:1.0:1787384590.812816:0:15563:0:(genops.c:906:class_export_put()) final put ffff98f7c2891000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787384590.814866:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8ee35d800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787384590.815012:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c2891000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1787384590.815039:0:15563:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1787384590.815044:0:15563:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787384590.815048:0:15563:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787384590.815054:0:15563:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787384590.815202:0:15563:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787384590.815210:0:15563:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1787384590.815217:0:15563:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787384590.815224:0:15563:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787384590.815227:0:15563:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787384590.815233:0:15563:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff98f8ee25f000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787384590.815239:0:15563:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff98f7c289b380) has exports, disconnecting them 00000020:00080000:3.0:1787384590.815243:0:15563:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff98f8ee25f000), last request at 1787384344 00000020:00000080:3.0:1787384590.815246:0:15563:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba2599 00000020:00080000:3.0:1787384590.815261:0:15563:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98f8ee25f000): rc 0 00000020:00000080:3.0:1787384590.815266:0:15563:0:(genops.c:906:class_export_put()) final put ffff98f8ee25f000/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1787384590.816563:0:469:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8c8923800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787384590.816573:0:469:0:(genops.c:906:class_export_put()) final put ffff98f8ee359800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1787384590.816575:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8ee359800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1787384590.816586:0:469:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1787384590.816657:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8ee25f000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1787384590.820878:0:15563:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1787384590.820894:0:15563:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787384590.820898:0:15563:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787384590.820906:0:15563:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787384590.821051:0:15563:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787384590.821060:0:15563:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1787384590.821067:0:15563:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f8f5669000 1 00000020:00000080:3.0:1787384590.821073:0:15563:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba2522 00000020:00000080:3.0:1787384590.821081:0:15563:0:(genops.c:906:class_export_put()) final put ffff98f8d9b5f800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1787384590.821087:0:15563:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1787384590.821091:0:15563:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787384590.821104:0:15563:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787384590.821108:0:15563:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff98f8f18119c0) has no exports 00000020:00000080:3.0:1787384590.824648:0:469:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f7c2894800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1787384590.824662:0:469:0:(genops.c:906:class_export_put()) final put ffff98f7c2892800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1787384590.824665:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c2892800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1787384590.824671:0:469:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1787384590.825087:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8d9b5f800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787384590.871327:0:15563:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787384590.871340:0:15563:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1787384590.871346:0:15563:0:(genops.c:906:class_export_put()) final put ffff98f8f566e000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787384590.871351:0:15563:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f566e000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1787384590.871363:0:15563:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1787384590.871469:0:15563:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98f8f566c800 00000020:02000400:2.0:1787384590.871519:0:15563:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1787384591.317061:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787384591.804209:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) ca80b7f5-0e34-441a-981f-ebff717028c4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787384591.804219:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) ca80b7f5-0e34-441a-981f-ebff717028c4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787384591.804222:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787384591.804226:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787384591.804306:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874208203381760:0@lo:400:kworker.0 00000400:00000100:0.0:1787384591.804357:0:3654:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874208203381760 offset 0 length 224: 4 00010000:00010000:1.0:1787384592.378553:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384592.822956:0:3650:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787384577/real 1787384577] req@ffff98f8f914a680 x1874208203380864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787384592 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384592.822987:0:3650:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98f8f914a680 x1874208203380864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787384592 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787384592.823012:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f7c385f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787384592.823031:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787384592.823036:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874208203380864:0@lo:38:kworker.0 00000100:00080000:1.0:1787384592.823201:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) ca80b7f5-0e34-441a-981f-ebff717028c4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787384592.823207:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) ca80b7f5-0e34-441a-981f-ebff717028c4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787384592.823209:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787384592.823212:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787384592.823215:0:37:0:(import.c:65:import_set_state_nolock()) ffff98f7c385f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787384592.823220:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 473 00000100:00080000:1.0:1787384592.823225:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787384592.823247:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98f7c385f800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:1.0:1787384592.823281:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f7c422f480 x1874208203381888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787384592.823344:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203382016:0@lo:400:kworker.0 00000400:00000100:1.0:1787384592.823394:0:3651:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874208203382016 offset 0 length 224: 4 00000100:00100000:3.0:1787384592.823563:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874208203381888:0@lo:38:kworker.0 00000400:00000100:3.0:1787384592.823598:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874208203381888 offset 0 length 520: 4 00000100:00000400:2.0:1787384593.144365:0:3653:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787384577/real 1787384577] req@ffff98f8f9149f80 x1874208203380992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787384593 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384593.204576:0:3653:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff98f8f9149f80 x1874208203380992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787384593 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787384593.204601:0:3653:0:(import.c:65:import_set_state_nolock()) ffff98f7c3549800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787384593.204605:0:3653:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787384593.233129:0:3653:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:0.0:1787384593.233263:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) ca80b7f5-0e34-441a-981f-ebff717028c4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787384593.233270:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) ca80b7f5-0e34-441a-981f-ebff717028c4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787384593.233273:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787384593.233276:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787384593.233278:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787384593.233281:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787384593.233285:0:37:0:(import.c:65:import_set_state_nolock()) ffff98f7c3549800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787384593.233293:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 262 00000100:00080000:0.0:1787384593.233303:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff98f7c3549800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:0.0:1787384593.233768:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f7c3a81c00 x1874208203382144/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787384593.233916:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3650:1874208203382144:0@lo:38:kworker.0 00000400:00000100:3.0:1787384593.233968:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874208203382144 offset 0 length 520: 4 00000100:00100000:0.0:1787384593.235103:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874208203380992:0@lo:400:kworker.0 00010000:00010000:3.0:1787384593.412427:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384594.429855:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787384594.857621:0:15765:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787384594.873682:0:15765:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1787384594.873791:0:15765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c2091c00/0x7ef423838fba27ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba27f3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384594.873808:0:15765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c2091c00/0x7ef423838fba27ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba27f3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384594.873815:0:15765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c2091c00/0x7ef423838fba27ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba27f3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384594.873823:0:15765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.145@tcp lock: ffff98f7c2091c00/0x7ef423838fba27ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba27f3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384594.873841:0:15765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787384594.873845:0:15765:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787384594.873870:0:15765:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787384594.873881:0:15765:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f7c422f480 x1874208203381888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787384612 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384594.873902:0:15765:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787384594.873907:0:15765:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787384594.873913:0:15765:0:(import.c:65:import_set_state_nolock()) ffff98f7c385f800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1787384594.873917:0:15765:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787384594.873921:0:15765:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f7c422f480 x1874208203381888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787384612 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384594.873927:0:15765:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787384594.873932:0:15765:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1787384594.873934:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874208203381888:0@lo:38:kworker.0 00000100:00080000:0.0:1787384594.874741:0:15765:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787384594.874751:0:15765:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f7c422ed80 x1874208203381248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384596 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384594.874767:0:15765:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f8f91da300 x1874208203381376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384599 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384594.874798:0:15765:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f7c422d500 x1874208203381632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384602 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384594.874810:0:15765:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f8f91db480 x1874208203381760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384607 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384594.874817:0:15765:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f7c422f100 x1874208203382016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384608 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384594.874819:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874208203381248:0@lo:400:kworker.0 00000100:00100000:0.0:1787384594.874826:0:15765:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f7c3a81c00 x1874208203382144/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787384603 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384594.874945:0:15765:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:0.0:1787384594.874965:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874208203381760:0@lo:400:kworker.0 00000100:00080000:3.0:1787384594.874972:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f7c3549800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1787384594.874972:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874208203381632:0@lo:400:kworker.0 00000100:00080000:3.0:1787384594.874976:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-5) 00000100:00100000:3.0:1787384594.874979:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3650:1874208203382144:0@lo:38:kworker.0 00000100:00080000:0.0:1787384594.874989:0:15765:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787384594.874993:0:15765:0:(import.c:65:import_set_state_nolock()) ffff98f7c3549800 lustre-MDT0001_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1787384594.874997:0:15765:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787384594.875000:0:15765:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f8f91da300 x1874208203381376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384599 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384594.875008:0:15765:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f7c422f100 x1874208203382016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384608 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384594.875015:0:15765:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787384594.875017:0:15765:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00010000:00010000:2.0:1787384594.876871:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384594.876884:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f7c2091c00/0x7ef423838fba27ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba27f3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384594.876896:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2091c00 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384594.876900:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f7c2091c00/0x7ef423838fba27ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba27f3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384594.876911:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f7c2091c00/0x7ef423838fba27ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ef423838fba27f3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384594.876919:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f7c2091c00/0x7ef423838fba27ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ef423838fba27f3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384594.876926:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787384594.876929:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787384594.876932:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787384594.876948:0:6511:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98f8f943d800 00010000:00010000:2.0:1787384594.876952:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f7c2091c00/0x7ef423838fba27ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7ef423838fba27f3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384594.876960:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f7c2091c00/0x7ef423838fba27ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7ef423838fba27f3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384594.876987:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384594.876988:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384594.876990:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384594.877505:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203382016:0@lo:400:kworker.0 00000100:00100000:1.0:1787384594.877528:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203381376:0@lo:400:kworker.0 00010000:00010000:0.0:1787384594.879071:0:15765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c2090e00/0x7ef423838fba27fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2801 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384594.879101:0:15765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c2090e00/0x7ef423838fba27fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2801 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384594.879108:0:15765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c2090e00/0x7ef423838fba27fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba2801 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384594.879115:0:15765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.145@tcp lock: ffff98f7c2090e00/0x7ef423838fba27fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba2801 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384594.879240:0:15765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787384594.879250:0:15765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05800/0x7ef423838fba2a70 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba2a77 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384594.879258:0:15765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05800/0x7ef423838fba2a70 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba2a77 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384594.879264:0:15765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05800/0x7ef423838fba2a70 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba2a77 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384594.879270:0:15765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05800/0x7ef423838fba2a70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ef423838fba2a77 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384594.879300:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787384594.879312:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f7c2090e00/0x7ef423838fba27fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba2801 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384594.879319:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2090e00 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:1.0:1787384594.879323:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f7c2090e00/0x7ef423838fba27fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba2801 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384594.879331:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f7c2090e00/0x7ef423838fba27fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ef423838fba2801 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787384594.879338:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f7c2090e00/0x7ef423838fba27fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ef423838fba2801 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384594.879344:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787384594.879347:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1787384594.879358:0:6510:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98f8f943d800 00010000:00010000:1.0:1787384594.879361:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f7c2090e00/0x7ef423838fba27fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7ef423838fba2801 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384594.879368:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f7c2090e00/0x7ef423838fba27fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7ef423838fba2801 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384594.879391:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384594.879395:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05800/0x7ef423838fba2a70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba2a77 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384594.879400:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b05800 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:1.0:1787384594.879403:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05800/0x7ef423838fba2a70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ef423838fba2a77 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384594.879409:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05800/0x7ef423838fba2a70 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ef423838fba2a77 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787384594.879421:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05800/0x7ef423838fba2a70 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ef423838fba2a77 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384594.879426:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787384594.879428:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1787384594.879432:0:6510:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98f8f943d800 00010000:00010000:1.0:1787384594.879435:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05800/0x7ef423838fba2a70 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x7ef423838fba2a77 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384594.879442:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384594.879444:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384594.879446:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384594.879561:0:15765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787384594.879566:0:15765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05800/0x7ef423838fba2a70 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x7ef423838fba2a77 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384594.879589:0:15765:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1787384594.879594:0:15765:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1787384594.879596:0:15765:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1787384594.879623:0:15765:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1787384594.879627:0:15765:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1787384594.879632:0:15765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787384594.879637:0:15765:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787384594.879641:0:15765:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff98f7c289cd40) has no exports 00000020:00080000:0.0:1787384594.879665:0:15765:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff98f7c289cd40) has no exports 00000020:01000000:0.0:1787384594.881680:0:15765:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98f8fd3ad480 - data ffff98f8c9741af8/ffff98f8ee3d6000 00000020:01000000:0.0:1787384594.881931:0:15765:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98f8d944a000 - data ffff98f7c24aa288/ffff98f7c35e5000 00010000:00010000:1.0:1787384594.882248:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1787384594.913234:0:15765:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787384594.922591:0:15765:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba2680 00000020:00000080:2.0:1787384594.922603:0:15765:0:(genops.c:906:class_export_put()) final put ffff98f7c354d800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1787384594.922710:0:15765:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f8f7d47800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1787384594.922714:0:15765:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f8f7d47800 2 00000020:01000004:2.0:1787384594.922717:0:15765:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98f8f7d47800 from lustre-OST0001 00000020:00000080:2.0:1787384594.922749:0:15765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787384594.922762:0:15765:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1787384594.922764:0:15765:0:(genops.c:906:class_export_put()) final put ffff98f7c354c000/lustre-OST0001_UUID 00000020:00000080:2.0:1787384594.922767:0:15765:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c354c000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1787384594.922774:0:15765:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1787384594.922904:0:15765:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import ca80b7f5-0e34-441a-981f-ebff717028c4->MGS 00010000:00010000:2.0:1787384594.922918:0:15765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8c148d800/0x7ef423838fba23d9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ef423838fba23e0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384594.922929:0:15765:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8c148d800/0x7ef423838fba23d9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ef423838fba23e0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384594.922935:0:15765:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1787384594.922938:0:15765:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1787384594.922941:0:15765:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1787384594.922953:0:15765:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98f8f943d800 00010000:00010000:2.0:1787384594.922957:0:15765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8c148d800/0x7ef423838fba23d9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7ef423838fba23e0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384594.922971:0:15765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04400/0x7ef423838fba285c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ef423838fba2863 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384594.922991:0:15765:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04400/0x7ef423838fba285c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ef423838fba2863 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384594.922996:0:15765:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787384594.922999:0:15765:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1787384594.923000:0:15765:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1787384594.923011:0:15765:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98f8f943d800 00010000:00010000:2.0:1787384594.923013:0:15765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f7c3b04400/0x7ef423838fba285c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7ef423838fba2863 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787384594.923028:0:15765:0:(import.c:65:import_set_state_nolock()) ffff98f8f943d800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1787384594.923032:0:15765:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787384594.923034:0:15765:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787384594.923036:0:15765:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787384594.923039:0:15765:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787384594.923048:0:15765:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff98f7c422d180 x1874208203381504/t0(0) o250->MGC192.168.203.145@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787384601 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787384594.923069:0:15765:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787384594.923071:0:15765:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:3.0:1787384594.924497:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ca80b7f5-0e34-441a-981f-ebff717028c4:3650:1874208203381504:0@lo:250:kworker.0 10000000:01000000:2.0:1787384594.925403:0:15765:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787384594.925417:0:15765:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba22d6 00000020:00000080:2.0:1787384594.925425:0:15765:0:(genops.c:906:class_export_put()) final put ffff98f8c8925000/ca80b7f5-0e34-441a-981f-ebff717028c4 00000020:00000080:0.0:1787384594.934465:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c354d800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1787384594.936149:0:15765:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.203.145@tcp (flags='') 00000020:00000080:3.0:1787384594.936424:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8c8925000/ca80b7f5-0e34-441a-981f-ebff717028c4 for MGC192.168.203.145@tcp 00000020:00000080:2.0:1787384594.936869:0:15765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787384594.936879:0:15765:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.145@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787384594.936883:0:15765:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff98f8f96899c0) has no exports 10000000:01000000:0.0:1787384594.936958:0:6519:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1787384594.937235:0:15765:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.145@tcp: client import never connected 00000100:00080000:2.0:1787384594.937241:0:15765:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1787384594.937244:0:15765:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787384594.937299:0:15765:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1787384594.937312:0:15765:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787384594.937475:0:15765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787384594.937482:0:15765:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.145@tcp (uuid ca80b7f5-0e34-441a-981f-ebff717028c4) 00000020:01000000:2.0:1787384594.937490:0:15765:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787384594.937494:0:15765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787384594.937497:0:15765:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787384594.937504:0:15765:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff98f7c3859800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787384594.937509:0:15765:0:(genops.c:1574:class_disconnect_exports()) OBD device 25 (ffff98f8f7d34d40) has exports, disconnecting them 00000020:00080000:2.0:1787384594.937513:0:15765:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff98f7c3859800), last request at 1787384366 00000020:00000080:2.0:1787384594.937518:0:15765:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba26aa 00000020:00080000:2.0:1787384594.937531:0:15765:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98f7c3859800): rc 0 00000020:00000080:2.0:1787384594.937535:0:15765:0:(genops.c:906:class_export_put()) final put ffff98f7c3859800/lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1787384594.938995:0:15765:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787384594.939001:0:15765:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787384594.939004:0:15765:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787384594.939010:0:15765:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787384594.939157:0:15765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787384594.939164:0:15765:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1787384594.939170:0:15765:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1787384594.939175:0:15765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787384594.939179:0:15765:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787384594.939184:0:15765:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff98f8f7d41000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787384594.939190:0:15765:0:(genops.c:1574:class_disconnect_exports()) OBD device 26 (ffff98f7c2898000) has exports, disconnecting them 00000020:00080000:0.0:1787384594.939195:0:15765:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff98f8f7d41000), last request at 1787384366 00000020:00000080:0.0:1787384594.939199:0:15765:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba26bf 00000020:00080000:0.0:1787384594.939210:0:15765:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98f8f7d41000): rc 0 00000020:00000080:0.0:1787384594.939214:0:15765:0:(genops.c:906:class_export_put()) final put ffff98f8f7d41000/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1787384594.940464:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f8f943d800 for MGC192.168.203.145@tcp 00000020:00000080:3.0:1787384594.940472:0:37:0:(genops.c:906:class_export_put()) final put ffff98f8f9439000/ca80b7f5-0e34-441a-981f-ebff717028c4 00000020:00000080:3.0:1787384594.940475:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f9439000/ca80b7f5-0e34-441a-981f-ebff717028c4 for MGC192.168.203.145@tcp 00000020:01000000:3.0:1787384594.940480:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.145@tcp (ca80b7f5-0e34-441a-981f-ebff717028c4) 00000020:00000080:3.0:1787384594.941441:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c3859800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787384594.941451:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f7c385f800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787384594.941456:0:37:0:(genops.c:906:class_export_put()) final put ffff98f7c2a43000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1787384594.941458:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c2a43000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1787384594.941461:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1787384594.941499:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f7d41000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1787384594.967822:0:15765:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787384594.967831:0:15765:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787384594.967836:0:15765:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787384594.967844:0:15765:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787384594.967899:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:3.0:1787384594.967958:0:469:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98f7c3549800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1787384594.968301:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1787384594.968747:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1787384594.969024:0:6506:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff98f8d980b200:6506] 1 exiting: rc = 0 00000100:00100000:3.0:1787384594.969025:0:9526:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff98f7c233da00:9526] 2 exiting: rc = 0 00000100:00100000:0.0:1787384594.969157:0:6505:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff98f8d1049200:6505] 0 exiting: rc = 1 00000100:00100000:2.0:1787384594.969206:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384594.969625:0:8463:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff98f7c206ac00:8463] 3 exiting: rc = 0 00000100:00100000:0.0:1787384594.969643:0:6507:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff98f8d980ae00:6507] 0 exiting: rc = 1 00000100:00100000:2.0:1787384594.969944:0:10399:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff98f7c2af2a00:10399] 4 exiting: rc = 0 00000100:00100000:0.0:1787384594.970116:0:6508:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff98f8d980b800:6508] 1 exiting: rc = 0 00000100:00100000:0.0:1787384594.970182:0:6509:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff98f8d980a600:6509] 2 exiting: rc = 0 00000100:00100000:2.0:1787384594.970379:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.970386:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.970391:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.970396:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.970403:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.970409:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.970415:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.970421:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.970427:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.970431:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.970437:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.970442:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.970456:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.970462:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.970467:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.970473:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.970478:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.970483:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.970488:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.970594:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.970602:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.970607:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.970612:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.970618:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.970623:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.970628:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.970635:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.970642:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.971433:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.971440:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.971446:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.971452:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.971458:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.971466:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.971472:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.971477:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.971482:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.971487:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.971491:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.971496:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.971501:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.971505:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.971514:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.971519:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.971524:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.971530:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.971535:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.971548:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.971553:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.971558:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.971563:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.972563:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.972590:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.973004:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.973014:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.973020:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.973025:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.973030:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.973035:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.973041:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.973046:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.973051:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.973057:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384594.973063:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787384594.985233:0:15765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787384594.985246:0:15765:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1787384594.985252:0:15765:0:(genops.c:906:class_export_put()) final put ffff98f7c354a000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1787384594.985256:0:15765:0:(genops.c:865:class_export_destroy()) destroying export ffff98f7c354a000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1787384594.985264:0:15765:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1787384594.985316:0:15765:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f8f7d47800 1 00000020:00000080:3.0:1787384594.985323:0:15765:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba264f 00000020:00000080:3.0:1787384594.985329:0:15765:0:(genops.c:906:class_export_put()) final put ffff98f8ee35b000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1787384594.985338:0:15765:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1787384594.985343:0:15765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787384594.985348:0:15765:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787384594.985351:0:15765:0:(genops.c:1579:class_disconnect_exports()) OBD device 23 (ffff98f8f7d33380) has no exports 00000020:00000080:2.0:1787384594.985461:0:469:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8ee35b000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1787384595.028476:0:15765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787384595.028500:0:15765:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1787384595.028507:0:15765:0:(genops.c:906:class_export_put()) final put ffff98f8f7d43000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1787384595.028511:0:15765:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8f7d43000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1787384595.028517:0:15765:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1787384595.029083:0:15765:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98f8f7d40800 00000020:01000000:3.0:1787384595.029113:0:15765:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1787384595.029268:0:15765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787384595.029274:0:15765:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787384595.029279:0:15765:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff98f8f1813380) has no exports 00000020:00000080:3.0:1787384595.029301:0:15765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787384595.029307:0:15765:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1787384595.029311:0:15765:0:(genops.c:906:class_export_put()) final put ffff98f8d9b5e800/OSS_uuid 00000020:00000080:3.0:1787384595.029314:0:15765:0:(genops.c:865:class_export_destroy()) destroying export ffff98f8d9b5e800/OSS_uuid for OSS 00000020:01000000:3.0:1787384595.029317:0:15765:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1787384595.029625:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff98f8f5687c00:8435] 0 exiting: rc = 1 00000100:00100000:1.0:1787384595.029835:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff98f8ee0d8e00:8436] 1 exiting: rc = 0 00000100:00100000:1.0:1787384595.029891:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff98f8f9127a00:8438] 2 exiting: rc = 0 00000100:00100000:1.0:1787384595.029951:0:8890:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff98f7c2338600:8890] 3 exiting: rc = 0 00000100:00100000:3.0:1787384595.031179:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031196:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031204:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031212:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031218:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031223:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031227:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031232:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031236:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031242:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031247:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031252:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031258:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031263:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031268:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031273:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031278:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031283:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031288:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031308:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031313:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031318:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031324:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031330:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031335:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031341:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031347:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031352:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031357:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031362:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031367:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031373:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031380:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031385:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031391:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031397:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031402:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031407:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031413:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031418:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031424:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031430:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031436:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031441:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031446:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031452:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031457:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031462:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031467:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031472:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031478:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031483:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031488:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031493:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031507:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031513:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031519:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031526:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031532:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031537:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031542:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031547:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031553:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384595.031558:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384595.032686:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff98f8d96a6c00:8440] 0 exiting: rc = 1 00000100:00080000:0.0:1787384595.032875:0:6518:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1787384595.033204:0:13608:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff98f7c3b8dc00:13608] 2 exiting: rc = 0 00000100:00100000:2.0:1787384595.033441:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff98f8f56b7400:8441] 1 exiting: rc = 0 00000100:00100000:0.0:1787384595.033644:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.033655:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.033663:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.033668:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.033672:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.033677:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.033682:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.033687:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.033749:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.033757:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.033762:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.033767:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.033772:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.034477:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.034488:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.034494:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.034498:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.034503:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.034507:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.034513:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.034517:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.034522:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.034528:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.034533:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.034539:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.034544:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.034549:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.034554:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.034559:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.034582:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.034587:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.034592:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.034597:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.034602:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.034623:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.034628:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.034633:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.034638:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.034643:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.034648:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.034654:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.034659:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.034664:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.034669:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.034673:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.034678:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.034683:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.034689:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.035145:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.035152:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.035158:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.035162:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.035167:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.035172:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.035178:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.035183:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.035188:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.035193:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.035198:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.035204:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.035208:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.035213:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.035218:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.035230:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384595.037322:0:8443:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff98f8f9190800:8443] 1 exiting: rc = 0 00000100:00100000:2.0:1787384595.037556:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff98f8f9190c00:8442] 0 exiting: rc = 1 00000100:00100000:3.0:1787384595.038757:0:8444:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff98f8f9191400:8444] 2 exiting: rc = 0 00000100:00100000:0.0:1787384595.039248:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039256:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039261:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039266:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039271:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039288:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039294:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039300:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039305:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039310:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039316:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039322:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039328:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039334:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039355:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039366:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039373:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039378:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039384:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039389:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039395:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039401:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039407:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039413:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039418:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039424:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039429:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039435:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039440:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039445:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039451:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039457:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039463:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039468:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039475:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039480:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039486:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039491:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039513:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039519:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039532:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039537:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039543:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039548:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039554:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039577:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039585:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039591:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039596:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039601:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039607:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039614:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039619:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039625:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039641:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039654:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039661:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039667:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039672:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039677:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039682:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039687:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039702:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.039709:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.046959:0:8445:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff98f8f9191200:8445] 0 exiting: rc = 1 00000100:00100000:0.0:1787384595.050846:0:8446:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff98f8f9191600:8446] 1 exiting: rc = 0 00000100:00100000:2.0:1787384595.051226:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051234:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051239:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051244:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051249:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051254:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051260:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051265:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051270:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051277:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051287:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051293:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051299:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051319:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051324:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051329:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051333:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051339:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051344:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051349:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051353:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051358:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051363:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051367:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051372:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051377:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051382:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051387:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051392:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051396:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051401:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051405:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051410:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051415:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051421:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051427:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051432:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051437:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051442:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051446:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051451:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051456:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051462:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051468:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051473:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051479:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051484:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051489:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051502:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051506:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051512:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051518:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051523:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051528:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051534:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051540:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051544:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051549:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051555:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051560:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051583:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051589:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051594:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.051600:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384595.052854:0:8447:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff98f8f54ec400:8447] 0 exiting: rc = 1 00000100:00100000:1.0:1787384595.054115:0:8448:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff98f8fd60d000:8448] 1 exiting: rc = 0 00000100:00100000:2.0:1787384595.054344:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.054358:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.054366:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.054371:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.054377:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.054382:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.054389:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.054394:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.054400:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.054406:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.054429:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.054437:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.054442:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.054448:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.054454:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.054461:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.054466:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.054472:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.054478:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.054499:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.054504:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.054510:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.054530:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.054537:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.054542:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.054548:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.054554:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.055135:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.055145:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.055152:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.055158:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.055163:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.055170:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.055175:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.055200:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.055207:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.055213:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.055219:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.055226:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.055232:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.055238:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.055243:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.055249:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.055255:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.055261:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.055268:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.055288:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.055295:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.055302:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.055308:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.055314:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.055319:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.055327:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.055333:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.055347:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.055354:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.055360:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.055366:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.055386:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.055393:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.055399:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.055405:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.055410:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384595.055423:0:15765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1787384595.077768:0:15765:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1787384616.035192:0:16530:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg345-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1787384625.359201:0:17129:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787384625.359208:0:17129:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1787384625.359210:0:17129:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1787384625.359675:0:17129:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff98f8f7d47800 00000020:01000004:1.0:1787384625.359691:0:17129:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1787384625.359698:0:17129:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787384625.359711:0:17129:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff98f8f1810000) 00000020:00000080:1.0:1787384625.359724:0:17129:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787384625.436603:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787384625.442335:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1787384625.442872:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1787384625.443076:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1787384625.443435:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1787384625.443651:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1787384625.446315:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1787384625.446802:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1787384625.447123:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1787384625.447383:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1787384625.447641:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1787384625.447884:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1787384625.448136:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1787384625.448385:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1787384625.448813:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1787384625.449089:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1787384625.449329:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1787384625.449593:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1787384625.449830:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1787384625.450063:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1787384625.450299:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1787384625.450556:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1787384625.450802:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1787384625.451021:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1787384625.451232:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1787384625.451440:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1787384625.451641:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1787384625.451834:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1787384625.452031:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1787384625.452234:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1787384625.452742:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1787384625.453084:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1787384625.453316:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1787384625.453568:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1787384625.454530:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1787384625.454774:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1787384625.455219:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1787384625.455428:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1787384625.455811:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1787384625.456010:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1787384625.456212:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1787384625.456613:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1787384625.456900:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1787384625.457099:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1787384625.457413:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1787384625.457726:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1787384625.459801:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1787384625.461332:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1787384625.461705:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1787384625.462180:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1787384625.463415:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1787384625.464088:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1787384625.464557:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:0.0:1787384625.466157:0:17129:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787384625.466377:0:17129:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787384625.466385:0:17129:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787384625.466396:0:17129:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7ef423838fba3893 00000020:01000004:0.0:1787384625.466402:0:17129:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1787384625.466407:0:17129:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787384625.466412:0:17129:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98f8f7d47800 from MGS 00000020:01000004:0.0:1787384625.466416:0:17129:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787384625.466426:0:17129:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff98f8f54b19c0) 00000020:00000080:0.0:1787384625.466437:0:17129:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787384625.468986:0:17129:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f8f7d47800 from MGS, refs=2 00080000:01000000:0.0:1787384625.469002:0:17129:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787384625.469014:0:17129:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7ef423838fba38a1 00000100:00100000:0.0:1787384625.469162:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1787384625.469284:0:17129:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1787384625.469297:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1787384625.473980:0:17129:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787384625.473993:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787384625.474675:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787384625.474869:0:17129:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787384625.474876:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787384625.476481:0:17129:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787384625.476503:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787384625.479411:0:17129:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787384625.479426:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787384625.484722:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384625.484727:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384625.484729:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384625.485055:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384625.485057:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384625.485059:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384625.485565:0:17129:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787384625.488433:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787384625.498349:0:17129:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1787384625.501272:0:17141:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787384625.501335:0:17129:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787384625.501391:0:17129:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787384625.503431:0:17129:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787384625.503827:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787384625.503980:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787384625.503986:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787384625.506168:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787384625.506180:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787384625.507056:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787384625.507065:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787384625.507969:0:17129:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787384625.507991:0:17129:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.145@tcp' 00000020:01000004:1.0:1787384625.507993:0:17129:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787384625.508021:0:17129:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.145@tcp (typ=mgc) 00000020:00000080:1.0:1787384625.508033:0:17129:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.145@tcp (ffff98f8f1813380) 00000020:00000080:1.0:1787384625.508049:0:17129:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787384625.508127:0:17129:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f8d914d800@MGC192.168.203.145@tcp: add connection 192.168.203.145@tcp at head 00010000:00010000:1.0:1787384625.508289:0:17129:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.145@tcp-0 is initialized 00000040:01000000:1.0:1787384625.508296:0:17129:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.145@tcp ctxt 1 is initialized 00000100:00080000:3.0:1787384625.514934:0:17145:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1787384625.515588:0:17146:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787384625.515827:0:17129:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.145@tcp (uuid 57899b24-a33b-4177-9883-79b5fe35053f) 00000020:00000080:1.0:1787384625.515851:0:17129:0:(genops.c:1406:class_connect()) connect: client 57899b24-a33b-4177-9883-79b5fe35053f, cookie 0x7ef423838fba38af 00000100:00080000:1.0:1787384625.515863:0:17129:0:(import.c:510:import_select_connection()) MGC192.168.203.145@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787384625.515869:0:17129:0:(import.c:624:import_select_connection()) MGC192.168.203.145@tcp: import ffff98f8d914d800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:1.0:1787384625.515901:0:17129:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f7c422f100 x1874208203382272/t0(0) o250->MGC192.168.203.145@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787384625.515936:0:17129:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 57899b24-a33b-4177-9883-79b5fe35053f->MGS 00000020:01000004:1.0:1787384625.515962:0:17129:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787384625.515967:0:17129:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787384625.515980:0:17129:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff98f8f18119c0) 00000020:00000080:1.0:1787384625.515992:0:17129:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787384625.517133:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:57899b24-a33b-4177-9883-79b5fe35053f:3650:1874208203382272:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787384625.517233:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384625.517416:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203382272 00000100:00100000:3.0:1787384625.517423:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203382272 00000100:00100000:3.0:1787384625.517451:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787384625.517458:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c434c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3650:x1874208203382272:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1787384625.517483:0:17142:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 57899b24-a33b-4177-9883-79b5fe35053f@0@lo t0 exp 0000000000000000 cur 520 last 0 00000020:00000080:3.0:1787384625.517510:0:17142:0:(genops.c:1406:class_connect()) connect: client 57899b24-a33b-4177-9883-79b5fe35053f, cookie 0x7ef423838fba38bd 00000100:00080000:3.0:1787384625.518851:0:17142:0:(import.c:65:import_set_state_nolock()) ffff98f7c40ac800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787384625.518943:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c434c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+5:3650:x1874208203382272:12345-0@lo:250:mount.lustre.0 Request processed in 1483us (1708us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384625.518962:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787384625.519014:0:3650:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.145@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787384625.519024:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.145@tcp: connect to target with instance 0 00000100:00080000:3.0:1787384625.519033:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.145@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787384625.519037:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787384625.519041:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8d914d800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787384625.519044:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787384625.519054:0:3650:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787384625.519060:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:57899b24-a33b-4177-9883-79b5fe35053f:3650:1874208203382272:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787384625.529891:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787384625.530092:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787384625.530098:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787384625.550566:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787384625.550579:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787384625.552097:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787384625.552106:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787384625.557691:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787384625.557883:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787384625.557890:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787384625.560321:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787384625.560332:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1787384625.624214:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787384625.625679:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1787384625.625685:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787384625.634820:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787384625.634840:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787384625.637585:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787384625.637767:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787384625.637773:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787384625.638757:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787384625.638765:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787384625.641062:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787384625.641229:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787384625.641234:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787384625.646639:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787384625.646665:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787384625.647469:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787384625.647948:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787384625.647953:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787384625.648982:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787384625.648990:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787384625.689004:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787384625.689392:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787384625.689398:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787384625.691174:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787384625.691253:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787384625.693704:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787384625.693717:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787384625.699031:0:17129:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787384625.699063:0:17129:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1787384625.699068:0:17129:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.145@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787384625.699168:0:17129:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.145@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787384625.699200:0:17129:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.145@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1787384625.699205:0:17129:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787384625.699207:0:17129:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787384625.699208:0:17129:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384625.699209:0:17129:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384625.699210:0:17129:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384625.699211:0:17129:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384625.699212:0:17129:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787384625.699214:0:17129:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787384625.699216:0:17129:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384625.699217:0:17129:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787384625.699221:0:17129:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1787384625.699223:0:17129:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787384625.699224:0:17129:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787384625.699225:0:17129:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384625.699226:0:17129:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384625.699227:0:17129:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384625.699228:0:17129:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384625.699229:0:17129:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787384625.699230:0:17129:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787384625.699248:0:17129:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384625.699249:0:17129:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787384625.699288:0:17129:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787384625.699307:0:17129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17129:1874208203382400:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787384625.699392:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384625.699442:0:17129:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f87c9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787384625.699633:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203382400 00000100:00100000:2.0:1787384625.699640:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203382400 00000100:00100000:2.0:1787384625.699746:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787384625.699754:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+5:17129:x1874208203382400:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787384625.699822:0:17144:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787384625.699825:0:17144:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787384625.699828:0:17144:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1787384625.703268:0:17166:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787384625.704398:0:17144:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:2.0:1787384625.705872:0:17167:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1787384625.705879:0:17167:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1787384625.705882:0:17167:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1787384625.705884:0:17167:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1787384625.706056:0:17167:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1787384625.706252:0:17144:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787384625.706263:0:17144:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787384625.711448:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+5:17129:x1874208203382400:12345-0@lo:253:mount.lustre.0 Request processed in 11685us (12047us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384625.711462:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787384625.711585:0:17129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17129:1874208203382400:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787384625.711600:0:17129:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787384625.711603:0:17129:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787384625.711605:0:17129:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787384625.711606:0:17129:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787384625.711608:0:17129:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787384625.711609:0:17129:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787384625.711610:0:17129:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787384625.711625:0:17129:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787384625.711627:0:17129:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787384625.711629:0:17129:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787384625.711630:0:17129:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787384625.711971:0:17129:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98f8f7d47800 from lustre-MDT0000 10000000:01000000:0.0:1787384625.712179:0:17129:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787384625.712183:0:17129:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787384625.712187:0:17129:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff98f8f1813380 10000000:01000000:0.0:1787384625.712192:0:17129:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787384625.712199:0:17129:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff98f8f1813380 from 1 10000000:01000000:0.0:1787384625.712201:0:17129:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787384625.712236:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8c6141a00/0x7ef423838fba38c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384625.712247:0:17129:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8c6141a00/0x7ef423838fba38c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384625.712256:0:17129:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8c6141a00/0x7ef423838fba38c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384625.712348:0:17129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a83480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17129:1874208203382528:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787384625.712401:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384625.712442:0:17129:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c2fd3480 going to sleep for 11 seconds 00000100:00100000:3.0:1787384625.712622:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203382528 00000100:00100000:3.0:1787384625.712629:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203382528 00000100:00100000:3.0:1787384625.713218:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787384625.713228:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+5:17129:x1874208203382528:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787384625.713241:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384625.713257:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f902158e00/0x7ef423838fba38cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba38c4 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384625.713461:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f902158e00/0x7ef423838fba38cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba38c4 expref: 6 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384625.713473:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f902158e00/0x7ef423838fba38cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba38c4 expref: 6 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384625.713482:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f902158e00, rc 0) 00000100:00100000:3.0:1787384625.714221:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+6:17129:x1874208203382528:12345-0@lo:101:mount.lustre.0 Request processed in 992us (1816us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384625.714229:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787384625.714241:0:17129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a83480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17129:1874208203382528:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787384625.714257:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8c6141a00/0x7ef423838fba38c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba38cb expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384625.714266:0:17129:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8c6141a00/0x7ef423838fba38c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba38cb expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384625.714410:0:17129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17129:1874208203382656:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787384625.714448:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384625.714491:0:17129:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9354c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787384625.714586:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203382656 00000100:00100000:0.0:1787384625.714593:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203382656 00000100:00100000:0.0:1787384625.714630:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787384625.714638:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+6:17129:x1874208203382656:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787384625.714847:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+6:17129:x1874208203382656:12345-0@lo:501:mount.lustre.0 Request processed in 209us (398us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787384625.714856:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787384625.716668:0:17129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17129:1874208203382656:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787384625.716714:0:17129:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787384625.716733:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8c6141a00/0x7ef423838fba38c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba38cb expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384625.716758:0:17129:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8c6141a00/0x7ef423838fba38c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba38cb expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384625.716766:0:17129:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98f8f7d47800 10000000:01000000:2.0:1787384625.716772:0:17129:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787384625.716803:0:17129:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98f8f7d47800 10000000:01000000:2.0:1787384625.716807:0:17129:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787384625.716810:0:17129:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff98f8f7d47800 from 1 10000000:01000000:2.0:1787384625.716813:0:17129:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787384625.716848:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8d965a800/0x7ef423838fba38d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384625.716856:0:17129:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8d965a800/0x7ef423838fba38d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384625.716865:0:17129:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8d965a800/0x7ef423838fba38d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384625.716884:0:17129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17129:1874208203382784:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787384625.716938:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384625.716967:0:17129:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9354c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787384625.717392:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203382784 00000100:00100000:0.0:1787384625.717407:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203382784 00000100:00100000:0.0:1787384625.717457:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787384625.717466:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+6:17129:x1874208203382784:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787384625.717478:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384625.717493:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8c6141400/0x7ef423838fba38d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba38d2 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384625.717515:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8c6141400/0x7ef423838fba38d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba38d2 expref: 7 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384625.717601:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8c6141400/0x7ef423838fba38d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba38d2 expref: 7 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384625.717611:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6141400, rc 0) 00000100:00100000:0.0:1787384625.717880:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+7:17129:x1874208203382784:12345-0@lo:101:mount.lustre.0 Request processed in 414us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384625.717888:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787384625.722020:0:17129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17129:1874208203382784:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787384625.722048:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8d965a800/0x7ef423838fba38d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba38d9 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384625.722061:0:17129:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8d965a800/0x7ef423838fba38d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba38d9 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384625.722101:0:17129:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787384625.722109:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8d965a800/0x7ef423838fba38d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba38d9 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384625.722116:0:17129:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8d965a800/0x7ef423838fba38d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba38d9 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384625.722122:0:17129:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787384625.725217:0:17129:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787384625.725252:0:17129:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98f8f7d47800 10000000:01000000:3.0:1787384625.725256:0:17129:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787384625.725260:0:17129:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787384625.725263:0:17129:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787384625.725314:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902159800/0x7ef423838fba38e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384625.725327:0:17129:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f902159800/0x7ef423838fba38e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384625.725337:0:17129:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f902159800/0x7ef423838fba38e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384625.725371:0:17129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17129:1874208203382912:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787384625.725434:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384625.725469:0:17129:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3a5e540 going to sleep for 11 seconds 00000100:00100000:0.0:1787384625.725773:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203382912 00000100:00100000:0.0:1787384625.725807:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203382912 00000100:00100000:0.0:1787384625.725857:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787384625.725865:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+7:17129:x1874208203382912:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787384625.725879:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384625.725890:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8c6140c00/0x7ef423838fba38e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba38e0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384625.725911:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8c6140c00/0x7ef423838fba38e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba38e0 expref: 8 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384625.725921:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8c6140c00/0x7ef423838fba38e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba38e0 expref: 8 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384625.725937:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6140c00, rc 0) 00000100:00100000:0.0:1787384625.725980:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+8:17129:x1874208203382912:12345-0@lo:101:mount.lustre.0 Request processed in 115us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384625.725986:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787384625.726120:0:17129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17129:1874208203382912:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787384625.726135:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f902159800/0x7ef423838fba38e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba38e7 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384625.726143:0:17129:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f902159800/0x7ef423838fba38e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba38e7 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384625.726204:0:17129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17129:1874208203383040:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787384625.726240:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384625.726260:0:17129:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7186e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787384625.726378:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203383040 00000100:00100000:0.0:1787384625.726382:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203383040 00000100:00100000:0.0:1787384625.726413:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787384625.726420:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+8:17129:x1874208203383040:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787384625.726561:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+9:17129:x1874208203383040:12345-0@lo:501:mount.lustre.0 Request processed in 140us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384625.726568:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787384625.726758:0:17129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17129:1874208203383040:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787384625.726810:0:17129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17129:1874208203383168:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787384625.726847:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384625.726866:0:17129:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7186e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787384625.727002:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203383168 00000100:00100000:3.0:1787384625.727006:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203383168 00000100:00100000:3.0:1787384625.727026:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787384625.727032:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+9:17129:x1874208203383168:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787384625.728652:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+9:17129:x1874208203383168:12345-0@lo:503:mount.lustre.0 Request processed in 1612us (1797us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384625.728662:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787384625.728746:0:17129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17129:1874208203383168:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787384625.729178:0:17168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57899b24-a33b-4177-9883-79b5fe35053f:17168:1874208203383296:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787384625.729222:0:17168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384625.729317:0:17168:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7186540 going to sleep for 11 seconds 00000100:00100000:0.0:1787384625.731399:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203383296 00000100:00100000:0.0:1787384625.731412:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203383296 00000100:00100000:0.0:1787384625.731472:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787384625.731482:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+9:17168:x1874208203383296:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787384625.733478:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+9:17168:x1874208203383296:12345-0@lo:502:llog_process_th.0 Request processed in 1990us (4248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384625.733491:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787384625.734654:0:17168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57899b24-a33b-4177-9883-79b5fe35053f:17168:1874208203383296:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787384625.734702:0:17168:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787384625.734714:0:17168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384625.734716:0:17168:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787384625.734722:0:17168:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787384625.734725:0:17168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787384625.734740:0:17168:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff98f8f1814d40) 00000020:00000080:1.0:1787384625.734757:0:17168:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787384625.734763:0:17168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787384625.734900:0:17168:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787384625.734908:0:17168:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7ef423838fba38f5 00000020:00000080:1.0:1787384625.735115:0:17168:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787384625.735120:0:17168:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384625.735124:0:17168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384625.735125:0:17168:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787384625.735128:0:17168:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787384625.735132:0:17168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384625.735133:0:17168:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787384625.735137:0:17168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787384625.735144:0:17168:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff98f8f91f0000) 00000020:00000080:1.0:1787384625.735154:0:17168:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787384625.735159:0:17168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787384625.735160:0:17168:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787384625.735163:0:17168:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787384625.735168:0:17168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787384625.735213:0:17168:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f8f7d47800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787384625.735226:0:17168:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff98f8f91f4d40) 00000020:00000080:1.0:1787384625.735234:0:17168:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787384625.735301:0:17168:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787384625.735307:0:17168:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7ef423838fba390a 00000020:00000080:1.0:1787384625.735420:0:17168:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787384625.735433:0:17168:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787384625.735438:0:17168:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x7ef423838fba3911 00080000:01000000:1.0:1787384625.735443:0:17168:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787384625.735445:0:17168:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7ef423838fba3918 00010000:00010000:0.0:1787384625.816918:0:17168:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1787384625.817437:0:17168:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967529 00000001:00080000:0.0:1787384625.818002:0:17168:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787384625.821086:0:17168:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff98f8f54b4d40) 00000020:00000080:0.0:1787384625.821107:0:17168:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1787384625.821187:0:17168:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787384625.821193:0:17168:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7ef423838fba3926 00000020:00000080:2.0:1787384625.832963:0:17168:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787384625.837998:0:17168:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x7ef423838fba392d 00000020:00000080:2.0:1787384625.838551:0:17168:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787384625.838562:0:17168:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384625.838568:0:17168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384625.838570:0:17168:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787384625.838573:0:17168:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787384625.838576:0:17168:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1787384625.838577:0:17168:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787384625.838579:0:17168:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787384625.838580:0:17168:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787384625.838583:0:17168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384625.838584:0:17168:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787384625.838586:0:17168:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787384625.838591:0:17168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384625.838593:0:17168:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787384625.838597:0:17168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787384625.838637:0:17168:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787384625.838663:0:17168:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384625.838667:0:17168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384625.838669:0:17168:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787384625.838671:0:17168:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787384625.838681:0:17168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384625.838682:0:17168:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1787384625.838686:0:17168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787384625.838693:0:17168:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.145@tcp to nid 0x20000c0a8cb91 (192.168.203.145@tcp) 00000020:00000080:2.0:1787384625.838716:0:17168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787384625.838730:0:17168:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff98f8f7d30000) 00000020:00000080:2.0:1787384625.838745:0:17168:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1787384625.838750:0:17168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787384625.838838:0:17168:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1787384625.838844:0:17168:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787384625.838850:0:17168:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7ef423838fba393b 00010000:00080000:2.0:1787384625.838881:0:17168:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f8f9131000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.145@tcp at head 00010000:00010000:2.0:1787384625.840477:0:17168:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1787384625.843426:0:17168:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787384625.843443:0:17168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1787384625.843610:0:17168:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787384625.843633:0:17168:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7ef423838fba3942 00000100:00080000:2.0:1787384625.843713:0:17168:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787384625.843720:0:17168:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98f8f9131000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:2.0:1787384625.843757:0:17168:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f914a680 x1874208203383424/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787384625.843843:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203383424:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787384625.843914:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787384625.843999:0:17168:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1787384625.844063:0:17168:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384625.844068:0:17168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384625.844070:0:17168:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1787384625.844072:0:17168:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787384625.844075:0:17168:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1787384625.844076:0:17168:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787384625.844077:0:17168:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787384625.844079:0:17168:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787384625.844081:0:17168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384625.844089:0:17168:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787384625.844092:0:17168:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787384625.844098:0:17168:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787384625.844101:0:17168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384625.844102:0:17168:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787384625.844105:0:17168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787384625.844108:0:17168:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.145@tcp to nid 0x20000c0a8cb91 (192.168.203.145@tcp) 00000020:01000000:2.0:1787384625.844128:0:17168:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787384625.844131:0:17168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787384625.844143:0:17168:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff98f8f7d33380) 00000020:00000080:2.0:1787384625.844155:0:17168:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1787384625.844160:0:17168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787384625.844221:0:17168:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787384625.844228:0:17168:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787384625.844245:0:17168:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7ef423838fba3950 00010000:00080000:2.0:1787384625.844406:0:17168:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f8d8503000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.145@tcp at head 00010000:00010000:2.0:1787384625.844925:0:17168:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1787384625.846943:0:17168:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787384625.847161:0:17168:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1787384625.850092:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203383424 00000100:00100000:1.0:1787384625.850108:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203383424 00000100:00100000:1.0:1787384625.850287:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787384625.850301:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1874208203383424:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1787384625.850322:0:17155:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:00080000:2.0:1787384625.855449:0:17168:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787384625.860152:0:17168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1787384625.872285:0:17168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1787384625.884496:0:17174:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787384625.884509:0:17174:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:0.0:1787384625.884646:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1874208203383424:12345-0@lo:38:llog_process_th.0 Request processed in 34339us (40720us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787384625.884670:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787384625.885006:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f9131000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787384625.885012:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787384625.885017:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203383424:0@lo:38:llog_process_th.0 00000020:00000080:1.0:1787384625.886247:0:17168:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787384625.886260:0:17168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787384625.886438:0:17168:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787384625.886458:0:17168:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7ef423838fba3957 00000100:00080000:1.0:1787384625.886467:0:17168:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787384625.886473:0:17168:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98f8d8503000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:1.0:1787384625.886626:0:17168:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f7c422ce00 x1874208203383552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787384625.886841:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203383552:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787384625.886890:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874208203383552 offset 0 length 520: 4 00000100:00080000:1.0:1787384625.887031:0:17168:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787384625.887105:0:17168:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384625.887111:0:17168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384625.887112:0:17168:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787384625.887115:0:17168:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787384625.887118:0:17168:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1787384625.887120:0:17168:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787384625.887121:0:17168:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787384625.887123:0:17168:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787384625.887125:0:17168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384625.887126:0:17168:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787384625.887128:0:17168:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787384625.887132:0:17168:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1787384625.887141:0:17168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384625.887142:0:17168:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787384625.887147:0:17168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787384625.887151:0:17168:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.145@tcp to nid 0x20000c0a8cb91 (192.168.203.145@tcp) 00000020:01000000:1.0:1787384625.887171:0:17168:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787384625.887174:0:17168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787384625.887185:0:17168:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff98f8f91f3380) 00000020:00000080:1.0:1787384625.887198:0:17168:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1787384625.887203:0:17168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787384625.887288:0:17168:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787384625.887300:0:17168:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:1.0:1787384625.887307:0:17168:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7ef423838fba3965 00010000:00080000:1.0:1787384625.887335:0:17168:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f8f9135000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.145@tcp at head 00010000:00010000:1.0:1787384625.887844:0:17168:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1787384625.887910:0:17168:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787384625.887925:0:17168:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787384625.892021:0:17168:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787384625.892258:0:17168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1787384625.892774:0:17168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1787384625.894112:0:17176:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787384625.894118:0:17176:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787384625.894983:0:17168:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787384625.894996:0:17168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787384625.895030:0:17168:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787384625.895051:0:17168:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7ef423838fba396c 00000100:00080000:0.0:1787384625.895061:0:17168:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787384625.895067:0:17168:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98f8f9135000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:0.0:1787384625.895101:0:17168:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f7c3a81880 x1874208203383680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787384625.895123:0:17168:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787384625.895410:0:17168:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384625.895415:0:17168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384625.895417:0:17168:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787384625.895420:0:17168:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787384625.895423:0:17168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384625.895425:0:17168:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787384625.895428:0:17168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787384625.895430:0:17168:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787384625.895432:0:17168:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384625.895435:0:17168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384625.895436:0:17168:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787384625.895438:0:17168:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787384625.895440:0:17168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384625.895441:0:17168:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787384625.895445:0:17168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787384625.895497:0:17168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a83480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57899b24-a33b-4177-9883-79b5fe35053f:17168:1874208203383808:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787384625.895637:0:17168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384625.895771:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203383680:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1787384625.895852:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203383808 00000100:00100000:3.0:1787384625.895859:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203383808 00000100:00100000:3.0:1787384625.895896:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787384625.895905:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+9:17168:x1874208203383808:12345-0@lo:502:llog_process_th.0 00000400:00000100:2.0:1787384625.896226:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874208203383680 offset 0 length 520: 4 00000100:00100000:3.0:1787384625.896440:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+9:17168:x1874208203383808:12345-0@lo:502:llog_process_th.0 Request processed in 535us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384625.896448:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787384625.896618:0:17168:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c2fd3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787384625.896734:0:17168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a83480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57899b24-a33b-4177-9883-79b5fe35053f:17168:1874208203383808:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787384625.896761:0:17168:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384625.896766:0:17168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384625.896768:0:17168:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787384625.896772:0:17168:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1787384625.896963:0:17129:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1787384625.896986:0:17129:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787384625.897045:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902159800/0x7ef423838fba38e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba38e7 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384625.897056:0:17129:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f902159800/0x7ef423838fba38e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba38e7 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384625.897064:0:17129:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98f8f7d47800 from 1 10000000:01000000:2.0:1787384625.897067:0:17129:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787384625.897102:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8d965b600/0x7ef423838fba3973 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384625.897110:0:17129:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8d965b600/0x7ef423838fba3973 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384625.897118:0:17129:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8d965b600/0x7ef423838fba3973 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384625.897133:0:17129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17129:1874208203383936:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787384625.897173:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384625.897248:0:17129:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f1b9ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787384625.897768:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203383936 00000100:00100000:1.0:1787384625.897775:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203383936 00000100:00100000:1.0:1787384625.898001:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787384625.898017:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+9:17129:x1874208203383936:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787384625.898030:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384625.898053:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c3953a00/0x7ef423838fba397a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba3973 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384625.898076:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c3953a00/0x7ef423838fba397a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba3973 expref: 10 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384625.898087:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c3953a00/0x7ef423838fba397a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba3973 expref: 10 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384625.898096:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3953a00, rc 0) 00000100:00100000:1.0:1787384625.898158:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+10:17129:x1874208203383936:12345-0@lo:101:mount.lustre.0 Request processed in 150us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384625.898166:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787384625.898229:0:17129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17129:1874208203383936:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787384625.898251:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8d965b600/0x7ef423838fba3973 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba397a expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384625.898259:0:17129:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8d965b600/0x7ef423838fba3973 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba397a expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384625.899197:0:17129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17129:1874208203384064:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787384625.899432:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384625.899862:0:17129:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f1b9ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787384625.899953:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203384064 00000100:00100000:3.0:1787384625.899959:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203384064 00000100:00100000:3.0:1787384625.899989:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787384625.899996:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+10:17129:x1874208203384064:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787384625.900013:0:17143:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787384625.900020:0:17143:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787384625.900094:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+10:17129:x1874208203384064:12345-0@lo:256:mount.lustre.0 Request processed in 98us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384625.900102:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787384625.900179:0:17129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17129:1874208203384064:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787384625.901204:0:17129:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787384625.901223:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8d965b600/0x7ef423838fba3973 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba397a expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384625.901234:0:17129:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8d965b600/0x7ef423838fba3973 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba397a expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384625.901242:0:17129:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98f8f7d47800 from 1 10000000:01000000:2.0:1787384625.901245:0:17129:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787384625.901400:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8d965b000/0x7ef423838fba3981 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384625.901408:0:17129:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8d965b000/0x7ef423838fba3981 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384625.901418:0:17129:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8d965b000/0x7ef423838fba3981 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384625.901437:0:17129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17129:1874208203384192:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787384625.901601:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384625.901632:0:17129:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f1b9ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787384625.901827:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203384192 00000100:00100000:3.0:1787384625.901834:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203384192 00000100:00100000:3.0:1787384625.901866:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787384625.901875:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+10:17129:x1874208203384192:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787384625.901886:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384625.901897:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f902159a00/0x7ef423838fba3988 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba3981 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384625.901917:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f902159a00/0x7ef423838fba3988 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba3981 expref: 11 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384625.901928:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f902159a00/0x7ef423838fba3988 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba3981 expref: 11 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384625.901946:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f902159a00, rc 0) 00000100:00100000:3.0:1787384625.901979:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+11:17129:x1874208203384192:12345-0@lo:101:mount.lustre.0 Request processed in 105us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384625.901984:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787384625.902070:0:17129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17129:1874208203384192:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787384625.902083:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8d965b000/0x7ef423838fba3981 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3988 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384625.902100:0:17129:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8d965b000/0x7ef423838fba3981 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba3988 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384625.902162:0:17129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17129:1874208203384320:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787384625.902187:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384625.902286:0:17129:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f1b9ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787384625.902477:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203384320 00000100:00100000:1.0:1787384625.902490:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203384320 00000100:00100000:1.0:1787384625.902514:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787384625.902528:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+11:17129:x1874208203384320:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787384625.902982:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+11:17129:x1874208203384320:12345-0@lo:501:mount.lustre.0 Request processed in 461us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384625.902990:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787384625.903074:0:17129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17129:1874208203384320:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787384625.903111:0:17129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17129:1874208203384448:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787384625.903153:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384625.903181:0:17129:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f1b9ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787384625.903226:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203384448 00000100:00100000:1.0:1787384625.903230:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203384448 00000100:00100000:1.0:1787384625.903251:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787384625.903258:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+11:17129:x1874208203384448:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787384625.903473:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+11:17129:x1874208203384448:12345-0@lo:503:mount.lustre.0 Request processed in 215us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384625.903489:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787384625.903922:0:17129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17129:1874208203384448:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787384625.904374:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57899b24-a33b-4177-9883-79b5fe35053f:17178:1874208203384576:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787384625.904421:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384625.904462:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fc1d8480 going to sleep for 11 seconds 00000100:00100000:0.0:1787384625.904574:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203384576 00000100:00100000:0.0:1787384625.904579:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203384576 00000100:00100000:0.0:1787384625.904620:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787384625.904629:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+11:17178:x1874208203384576:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787384625.905324:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+11:17178:x1874208203384576:12345-0@lo:502:llog_process_th.0 Request processed in 695us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384625.905332:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787384625.905494:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57899b24-a33b-4177-9883-79b5fe35053f:17178:1874208203384576:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787384625.905520:0:17178:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787384625.905528:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384625.905530:0:17178:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787384625.905536:0:17178:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f8f7d47800 00000020:00000080:1.0:1787384625.905539:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787384625.905546:0:17178:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384625.905553:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384625.905554:0:17178:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787384625.905556:0:17178:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787384625.905558:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384625.905559:0:17178:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787384625.905561:0:17178:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f8f7d47800 00000020:00000080:1.0:1787384625.905563:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787384625.905617:0:17178:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384625.905621:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384625.905622:0:17178:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787384625.905624:0:17178:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787384625.905626:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384625.905627:0:17178:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787384625.905630:0:17178:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f8f7d47800 00000020:00000080:1.0:1787384625.905632:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787384625.907414:0:17178:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384625.907423:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384625.907425:0:17178:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787384625.907429:0:17178:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787384625.907432:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384625.907433:0:17178:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787384625.907437:0:17178:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f8f7d47800 00000020:00000080:1.0:1787384625.907439:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787384625.907518:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57899b24-a33b-4177-9883-79b5fe35053f:17178:1874208203384704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787384625.907586:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384625.907619:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fc1d8480 going to sleep for 11 seconds 00000100:00100000:3.0:1787384625.911578:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203384704 00000100:00100000:3.0:1787384625.911590:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203384704 00000100:00100000:1.0:1787384625.912893:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787384625.912904:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+11:17178:x1874208203384704:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787384625.913055:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+11:17178:x1874208203384704:12345-0@lo:502:llog_process_th.0 Request processed in 152us (5467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384625.913062:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787384625.913135:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57899b24-a33b-4177-9883-79b5fe35053f:17178:1874208203384704:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787384625.913169:0:17178:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384625.913178:0:17178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384625.913180:0:17178:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787384625.913184:0:17178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1787384625.914835:0:17129:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787384625.914865:0:17129:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787384625.914882:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8d965b000/0x7ef423838fba3981 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3988 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384625.914894:0:17129:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8d965b000/0x7ef423838fba3981 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3988 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384625.914944:0:17129:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787384625.914947:0:17129:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98f8f7d47800 10000000:01000000:3.0:1787384625.914949:0:17129:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98f8f7d47800 10000000:01000000:3.0:1787384625.914953:0:17129:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787384625.914959:0:17129:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98f8f7d47800 from 1 10000000:01000000:3.0:1787384625.914961:0:17129:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787384625.914992:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba398f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384625.915001:0:17129:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba398f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384625.915011:0:17129:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba398f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384625.915041:0:17129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17129:1874208203384832:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787384625.915096:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384625.915136:0:17129:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3a5e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384625.915260:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203384832 00000100:00100000:1.0:1787384625.915266:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203384832 00000100:00100000:1.0:1787384625.915384:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787384625.915393:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c370c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+11:17129:x1874208203384832:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787384625.915406:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384625.915419:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c3952000/0x7ef423838fba3996 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba398f expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384625.915445:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c3952000/0x7ef423838fba3996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba398f expref: 12 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384625.915455:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c3952000/0x7ef423838fba3996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba398f expref: 12 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384625.915465:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3952000, rc 0) 00000100:00100000:1.0:1787384625.915751:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c370c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+12:17129:x1874208203384832:12345-0@lo:101:mount.lustre.0 Request processed in 358us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384625.915759:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787384625.915929:0:17129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17129:1874208203384832:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787384625.915943:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba398f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3996 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384625.915951:0:17129:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba398f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba3996 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384625.916001:0:17129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17129:1874208203384960:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787384625.916026:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384625.916045:0:17129:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3a5e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384625.916057:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203384960 00000100:00100000:3.0:1787384625.916060:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203384960 00000100:00100000:3.0:1787384625.916088:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787384625.916093:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c370dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+12:17129:x1874208203384960:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787384625.916202:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c370dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+12:17129:x1874208203384960:12345-0@lo:501:mount.lustre.0 Request processed in 107us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384625.916208:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787384625.916235:0:17129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17129:1874208203384960:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787384625.916270:0:17129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17129:1874208203385088:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787384625.917636:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384625.918594:0:17129:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2956e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787384625.918629:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203385088 00000100:00100000:3.0:1787384625.918636:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203385088 00000100:00100000:3.0:1787384625.918999:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787384625.919008:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c370c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+12:17129:x1874208203385088:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787384625.919119:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c370c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+12:17129:x1874208203385088:12345-0@lo:503:mount.lustre.0 Request processed in 112us (1484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384625.919127:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787384625.920431:0:17129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17129:1874208203385088:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787384625.931557:0:17182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57899b24-a33b-4177-9883-79b5fe35053f:17182:1874208203385216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787384625.931636:0:17182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384625.931872:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203385216 00000100:00100000:3.0:1787384625.931880:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203385216 00000100:00100000:3.0:1787384625.931923:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787384625.931932:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c370ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+12:17182:x1874208203385216:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787384625.932049:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c370ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+12:17182:x1874208203385216:12345-0@lo:502:llog_process_th.0 Request processed in 118us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384625.932057:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787384625.932114:0:17182:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3a5e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384625.932135:0:17182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57899b24-a33b-4177-9883-79b5fe35053f:17182:1874208203385216:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1787384625.932191:0:17182:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787384625.932205:0:17182:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff98f7c2898000) 00000020:00000080:3.0:1787384625.932226:0:17182:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1787384625.932467:0:17182:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f8f7d47800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787384625.932471:0:17182:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f8f7d47800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787384625.932474:0:17182:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f8f7d47800 4 00010000:00080000:3.0:1787384625.933201:0:17182:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f8f7d8a800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.145@tcp at head 00010000:00010000:3.0:1787384625.938841:0:17182:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1787384625.938946:0:17182:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787384625.938985:0:17182:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787384625.938996:0:17182:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x7ef423838fba39a4 00000100:00080000:3.0:1787384625.939006:0:17182:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787384625.939011:0:17182:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98f8f7d8a800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:3.0:1787384625.939041:0:17182:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f91d9180 x1874208203385344/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787384625.939065:0:17182:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787384625.939477:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874208203385344:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787384625.939553:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787384625.939844:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787384625.939849:0:16239:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787384625.939852:0:16239:0:(import.c:65:import_set_state_nolock()) ffff98f8f9131000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787384625.939856:0:16239:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 520 00000100:00080000:0.0:1787384625.939860:0:16239:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787384625.939864:0:16239:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98f8f9131000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:0.0:1787384625.939895:0:16239:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f7c3a83480 x1874208203385472/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787384625.939913:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787384625.939917:0:16239:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787384625.939919:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787384625.939927:0:16239:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787384625.941417:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203385472:0@lo:38:kworker.0 00000100:00100000:2.0:1787384625.941494:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384625.941581:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203385472 00000100:00100000:2.0:1787384625.941589:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203385472 00000100:00100000:2.0:1787384625.941622:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787384625.941629:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3650:x1874208203385472:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787384625.941773:0:17156:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787384625.941829:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3650:x1874208203385472:12345-0@lo:38:kworker.0 Request processed in 198us (334us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787384625.941836:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787384625.941881:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f9131000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787384625.941887:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787384625.941891:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203385472:0@lo:38:kworker.0 00000100:00100000:3.0:1787384625.942406:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203385344 00000100:00100000:3.0:1787384625.942413:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203385344 00000100:00100000:3.0:1787384625.942440:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787384625.942446:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1874208203385344:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787384625.942510:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1874208203385344:12345-0@lo:38:llog_process_th.0 Request processed in 61us (2954us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787384625.942516:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787384625.943420:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787384625.943429:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f7d8a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787384625.943433:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787384625.943437:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874208203385344:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787384625.946826:0:17182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57899b24-a33b-4177-9883-79b5fe35053f:17182:1874208203385600:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787384625.946906:0:17182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384625.946949:0:17182:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d956c180 going to sleep for 11 seconds 00000100:00100000:0.0:1787384625.947437:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203385600 00000100:00100000:0.0:1787384625.947445:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203385600 00000100:00100000:0.0:1787384625.947553:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787384625.947564:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c370f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+12:17182:x1874208203385600:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787384625.948424:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c370f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+12:17182:x1874208203385600:12345-0@lo:502:llog_process_th.0 Request processed in 860us (1516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384625.948434:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787384625.948549:0:17182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57899b24-a33b-4177-9883-79b5fe35053f:17182:1874208203385600:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787384625.948599:0:17182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a81f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57899b24-a33b-4177-9883-79b5fe35053f:17182:1874208203385728:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787384625.948638:0:17182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384625.949457:0:17182:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c61130c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384625.953158:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203385728 00000100:00100000:3.0:1787384625.953173:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203385728 00000100:00100000:2.0:1787384625.956063:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787384625.956078:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c370d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+12:17182:x1874208203385728:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384625.956283:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c370d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+12:17182:x1874208203385728:12345-0@lo:502:llog_process_th.0 Request processed in 198us (7633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384625.956291:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787384625.962961:0:17182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a81f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57899b24-a33b-4177-9883-79b5fe35053f:17182:1874208203385728:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787384625.967567:0:17182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787384625.968411:0:17129:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787384625.968437:0:17129:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787384625.968462:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba398f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3996 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384625.969650:0:17129:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f902158000/0x7ef423838fba398f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3996 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787384625.969848:0:17129:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787384625.969851:0:17129:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787384625.969852:0:17129:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384625.969854:0:17129:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384625.969855:0:17129:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384625.969857:0:17129:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384625.969858:0:17129:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787384625.969860:0:17129:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787384625.969861:0:17129:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384625.969863:0:17129:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787384625.969866:0:17129:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1787384625.969869:0:17129:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787384625.969870:0:17129:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787384625.969871:0:17129:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384625.969873:0:17129:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384625.969874:0:17129:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384625.969875:0:17129:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384625.969876:0:17129:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787384625.969877:0:17129:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787384625.969878:0:17129:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384625.969879:0:17129:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787384625.969907:0:17129:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787384625.969928:0:17129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17129:1874208203385856:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787384625.969997:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384625.970043:0:17129:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3a5e540 going to sleep for 11 seconds 00000100:00100000:2.0:1787384625.970186:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203385856 00000100:00100000:2.0:1787384625.970193:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203385856 00000100:00100000:2.0:1787384625.970244:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787384625.970252:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c370e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+12:17129:x1874208203385856:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787384625.970558:0:17143:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787384625.970572:0:17143:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787384625.981926:0:17143:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787384625.981940:0:17143:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787384625.982108:0:17166:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787384625.982113:0:17166:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787384625.982133:0:17166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98f7c3953c00/0x7ef423838fba39ab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384625.982152:0:17166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f7c3953a00/0x7ef423838fba397a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba3973 expref: 12 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384625.982173:0:17166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98f7c3953c00/0x7ef423838fba39ab lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384625.982207:0:17166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f7c3953a00/0x7ef423838fba397a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba3973 expref: 12 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384625.982221:0:17166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f7c3953a00/0x7ef423838fba397a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba3973 expref: 12 pid: 17144 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384625.982235:0:17166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1874208203385984:0@lo:104: 00000100:00100000:1.0:1787384625.982352:0:17166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384625.982399:0:17166:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fc1d8540 going to sleep for 11 seconds 00000100:00100000:2.0:1787384625.982460:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203385984 00000100:00100000:2.0:1787384625.982466:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203385984 00000100:00100000:2.0:1787384625.982514:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787384625.982521:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57899b24-a33b-4177-9883-79b5fe35053f+3:17166:x1874208203385984:12345-0@lo:104: 00010000:00010000:2.0:1787384625.982533:0:17133:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f8d965b600/0x7ef423838fba3973 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba397a expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384625.982596:0:17133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787384625.982602:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57899b24-a33b-4177-9883-79b5fe35053f+3:17166:x1874208203385984:12345-0@lo:104: Request processed in 81us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384625.982609:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1787384625.982626:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384625.982631:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8d965b600/0x7ef423838fba3973 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba397a expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384625.982638:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965b600 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384625.982642:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8d965b600/0x7ef423838fba3973 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba397a expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384625.982650:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8d965b600/0x7ef423838fba3973 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba397a expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384625.982657:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8d965b600/0x7ef423838fba3973 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba397a expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384625.982663:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787384625.982798:0:17139:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8d965b600/0x7ef423838fba3973 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba397a expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384625.982805:0:17139:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787384625.982823:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8d965b600/0x7ef423838fba3973 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba397a expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384625.982830:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8d965b600/0x7ef423838fba3973 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba397a expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384625.982853:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384625.982854:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384625.982856:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384625.982880:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57899b24-a33b-4177-9883-79b5fe35053f:3652:1874208203386112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787384625.982907:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384625.983050:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203386112 00000100:00100000:0.0:1787384625.983055:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203386112 00010000:00010000:0.0:1787384625.983070:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f7c3953a00/0x7ef423838fba397a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba3973 expref: 13 pid: 17144 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384625.983087:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787384625.983092:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57899b24-a33b-4177-9883-79b5fe35053f+13:3652:x1874208203386112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787384625.983101:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384625.983105:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f7c3953a00/0x7ef423838fba397a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba3973 expref: 13 pid: 17144 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384625.983115:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f7c3953a00/0x7ef423838fba397a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba3973 expref: 13 pid: 17144 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384625.983135:0:17135:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98f7c3953c00/0x7ef423838fba39ab lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384625.983142:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c3953c00/0x7ef423838fba39ab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787384625.983155:0:17135:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001042823s 00010000:00010000:0.0:1787384625.983160:0:17135:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f7c3953c00/0x7ef423838fba39ab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384625.983166:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f7c3953c00/0x7ef423838fba39ab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384625.983172:0:17135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98f7c3953c00/0x7ef423838fba39ab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384625.983178:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98f7c3953c00/0x7ef423838fba39ab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384625.983183:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3953c00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384625.983187:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98f7c3953c00/0x7ef423838fba39ab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384625.983193:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98f7c3953c00/0x7ef423838fba39ab lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384625.983202:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98f7c3953c00/0x7ef423838fba39ab lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384625.983211:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384625.983236:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57899b24-a33b-4177-9883-79b5fe35053f+13:3652:x1874208203386112:12345-0@lo:103:ldlm_bl.0 Request processed in 143us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384625.983247:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787384625.983321:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c3953a00/0x7ef423838fba397a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba3973 expref: 12 pid: 17144 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384625.983331:0:17166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1874208203385984:0@lo:104: 00010000:00010000:1.0:1787384625.983346:0:17166:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98f7c3953c00/0x7ef423838fba39ab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384625.983365:0:17166:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98f7c3953c00/0x7ef423838fba39ab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384625.983372:0:17166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98f7c3953c00/0x7ef423838fba39ab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384625.983378:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c3953c00/0x7ef423838fba39ab lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384625.983540:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57899b24-a33b-4177-9883-79b5fe35053f:3652:1874208203386112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787384625.983604:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c370e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+11:17129:x1874208203385856:12345-0@lo:253:mount.lustre.0 Request processed in 13353us (13607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384625.983613:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787384625.983983:0:17129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17129:1874208203385856:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787384625.983992:0:17129:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787384625.983995:0:17129:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787384625.983996:0:17129:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787384625.983997:0:17129:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787384625.983998:0:17129:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787384625.983999:0:17129:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787384625.984000:0:17129:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787384625.984002:0:17129:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787384625.984003:0:17129:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787384625.984005:0:17129:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787384625.984007:0:17129:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787384625.984021:0:17129:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:0.0:1787384626.004949:0:17129:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1787384626.005440:0:17129:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1787384626.005505:0:17190:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1787384626.005509:0:17190:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1787384626.005831:0:17191:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787384626.005997:0:17129:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:3.0:1787384626.006336:0:17192:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff98f8f91db800 x1874208203386240/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384626.006347:0:17192:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2956cc0 going to sleep for 0 seconds 00000040:00080000:0.0:1787384626.006648:0:17191:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1787384626.010085:0:17129:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787384626.010125:0:17129:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787384626.010703:0:17191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787384626.010774:0:17191:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00000080:1.0:1787384626.011427:0:17129:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787384626.011439:0:17129:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787384626.011566:0:17129:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787384626.012734:0:17129:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787384626.013393:0:17129:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787384626.013423:0:17129:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1787384626.014702:0:17129:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:2.0:1787384626.016615:0:17129:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1787384626.018176:0:17129:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787384626.018206:0:17129:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffac69414eb988 00100000:10000000:2.0:1787384626.018214:0:17129:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787384626.019087:0:17129:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787384626.019101:0:17129:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.145@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787384626.019119:0:17129:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787384626.019143:0:17129:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1787384626.023103:0:17129:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787384626.023396:0:17129:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787384626.551112:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787384627.001056:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787384627.063018:0:17192:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2956cc0 going to sleep for 0 seconds 10000000:01000000:2.0:1787384627.446879:0:17146:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787384627.446886:0:17146:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98f8f7d47800 from 7 10000000:01000000:2.0:1787384627.446891:0:17146:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787384627.446949:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8d965ba00/0x7ef423838fba39b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384627.446962:0:17146:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8d965ba00/0x7ef423838fba39b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384627.446991:0:17146:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8d965ba00/0x7ef423838fba39b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384627.447016:0:17146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203386368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787384627.447091:0:17146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384627.447147:0:17146:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fc1dd9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384627.447359:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203386368 00000100:00100000:3.0:1787384627.447366:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203386368 00000100:00100000:3.0:1787384627.447415:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787384627.447423:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c370f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+11:17146:x1874208203386368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384627.447435:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384627.447448:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f902158600/0x7ef423838fba39b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba39b2 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384627.447593:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f902158600/0x7ef423838fba39b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba39b2 expref: 12 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384627.447608:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f902158600/0x7ef423838fba39b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba39b2 expref: 12 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384627.447616:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f902158600, rc 0) 00000100:00100000:3.0:1787384627.447668:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c370f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+12:17146:x1874208203386368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 245us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384627.447675:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787384627.448025:0:17146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203386368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787384627.448100:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8d965ba00/0x7ef423838fba39b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba39b9 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384627.448111:0:17146:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8d965ba00/0x7ef423838fba39b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba39b9 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384627.448169:0:17146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203386496:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787384627.448204:0:17146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384627.448238:0:17146:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fc1dd9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384627.448291:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203386496 00000100:00100000:3.0:1787384627.448300:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203386496 00000100:00100000:3.0:1787384627.448332:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787384627.448421:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c370c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+12:17146:x1874208203386496:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787384627.448435:0:17143:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787384627.448451:0:17143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787384627.448453:0:17143:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1787384627.448638:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c370c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+12:17146:x1874208203386496:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 298us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384627.448645:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787384627.448723:0:17146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203386496:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787384627.448767:0:17146:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787384627.448774:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8d965ba00/0x7ef423838fba39b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba39b9 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384627.450212:0:17146:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8d965ba00/0x7ef423838fba39b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba39b9 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384627.576744:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787384628.026436:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787384628.086844:0:17192:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2956cc0 going to sleep for 0 seconds 00010000:00010000:0.0:1787384628.613598:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384629.128480:0:17192:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2956cc0 going to sleep for 0 seconds 00010000:00010000:3.0:1787384629.624697:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384630.135985:0:17192:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2956cc0 going to sleep for 0 seconds 00010000:00010000:1.0:1787384630.648094:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384631.160063:0:17192:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2956cc0 going to sleep for 0 seconds 00000100:00080000:1.0:1787384631.224695:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787384631.224702:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787384631.224707:0:37:0:(import.c:65:import_set_state_nolock()) ffff98f8f9131000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787384631.224716:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 521 00000100:00080000:1.0:1787384631.224721:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787384631.224728:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98f8f9131000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:1.0:1787384631.224752:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f7c422c700 x1874208203386752/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787384631.224766:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787384631.224770:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787384631.224773:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787384631.224792:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787384631.224795:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787384631.224798:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787384631.224800:0:37:0:(import.c:65:import_set_state_nolock()) ffff98f8f7d8a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787384631.224805:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98f8f7d8a800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:1.0:1787384631.224826:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f7c422f800 x1874208203386880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787384631.225501:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787384631.225517:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57899b24-a33b-4177-9883-79b5fe35053f:3654:1874208203386624:0@lo:400:kworker.0 00000100:00100000:3.0:1787384631.225586:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384631.225723:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203386752:0@lo:38:kworker.0 00000100:00100000:2.0:1787384631.225754:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384631.225804:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874208203386880:0@lo:38:kworker.0 00000100:00100000:2.0:1787384631.225829:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384631.225962:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203386624 00000100:00100000:1.0:1787384631.225972:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203386624 00000100:00100000:1.0:1787384631.226022:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787384631.226032:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c370e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+12:3654:x1874208203386624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384631.226082:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c370e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+12:3654:x1874208203386624:12345-0@lo:400:kworker.0 Request processed in 51us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384631.226088:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787384631.226127:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57899b24-a33b-4177-9883-79b5fe35053f:3654:1874208203386624:0@lo:400:kworker.0 00000100:00100000:3.0:1787384631.226227:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203386752 00000100:00100000:3.0:1787384631.226291:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203386752 00000100:00100000:3.0:1787384631.226454:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787384631.226459:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3650:x1874208203386752:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787384631.226476:0:17156:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787384631.227575:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203386880 00000100:00100000:0.0:1787384631.227585:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203386880 00000100:00100000:0.0:1787384631.227621:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787384631.227628:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9148380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1874208203386880:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787384631.227655:0:17152:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:0.0:1787384631.227691:0:17152:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x7ef423838fba39c0 00000004:00100000:0.0:1787384631.227709:0:17152:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787384631.227878:0:17152:0:(import.c:65:import_set_state_nolock()) ffff98f8f943c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787384631.227953:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9148380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874208203386880:12345-0@lo:38:kworker.0 Request processed in 324us (2122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384631.227961:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787384631.228597:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98f7c422f800 x1874208203386880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787384641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787384631.228615:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787384631.228623:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787384631.228628:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787384631.228631:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f7d8a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787384631.228637:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874208203386880:0@lo:38:kworker.0 00000001:02000400:0.0:1787384631.232622:0:17435:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg345-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1787384631.275008:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3650:x1874208203386752:12345-0@lo:38:kworker.0 Request processed in 48537us (49242us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787384631.275023:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1787384631.275125:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f9131000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787384631.275131:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787384631.275135:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203386752:0@lo:38:kworker.0 00010000:00010000:3.0:1787384631.670929:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384632.192966:0:17192:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2956cc0 going to sleep for 0 seconds 00000020:00000004:1.0:1787384632.408623:0:17487:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787384632.409010:0:17487:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787384632.697495:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384633.211112:0:17192:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2956cc0 going to sleep for 0 seconds 00000020:00000004:1.0:1787384633.657297:0:17537:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787384633.657488:0:17537:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787384633.720002:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384634.234183:0:17192:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2956cc0 going to sleep for 0 seconds 00010000:00010000:0.0:1787384634.744874:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384635.255220:0:17192:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2956cc0 going to sleep for 0 seconds 00000100:00100000:3.0:1787384635.318969:0:3650:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787384625/real 1787384625] req@ffff98f7c3a81880 x1874208203383680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384635 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384635.318999:0:3650:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98f7c3a81880 x1874208203383680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384635 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384635.319021:0:3650:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787384625/real 1787384625] req@ffff98f7c422ce00 x1874208203383552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384635 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384635.319034:0:3650:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98f7c422ce00 x1874208203383552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384635 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787384635.319072:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f9135000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787384635.319089:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787384635.319093:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203383680:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787384635.319099:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8d8503000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787384635.319105:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787384635.319109:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203383552:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787384635.319199:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787384635.319203:0:16239:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787384635.319207:0:16239:0:(import.c:65:import_set_state_nolock()) ffff98f8f9131000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787384635.319212:0:16239:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 526 00000100:00080000:0.0:1787384635.319216:0:16239:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787384635.319223:0:16239:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98f8f9131000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:0.0:1787384635.319243:0:16239:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f7c3a82d80 x1874208203387136/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787384635.319256:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57899b24-a33b-4177-9883-79b5fe35053f:3654:1874208203387008:0@lo:400:kworker.0 00000100:00100000:3.0:1787384635.319339:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787384635.319342:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787384635.319347:0:16239:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787384635.319348:0:16239:0:(import.c:65:import_set_state_nolock()) ffff98f8d8503000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787384635.319353:0:16239:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 520 00000100:00080000:0.0:1787384635.319356:0:16239:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787384635.319368:0:16239:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98f8d8503000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:0.0:1787384635.319386:0:16239:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f7c3a81c00 x1874208203387264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787384635.319401:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787384635.319404:0:16239:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787384635.319405:0:16239:0:(import.c:65:import_set_state_nolock()) ffff98f8f9135000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1787384635.319406:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203387008 00000100:00080000:0.0:1787384635.319410:0:16239:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 520 00000100:00080000:0.0:1787384635.319414:0:16239:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00100000:3.0:1787384635.319416:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203387008 00000100:00080000:0.0:1787384635.319419:0:16239:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98f8f9135000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:0.0:1787384635.319434:0:16239:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f7c3a83100 x1874208203387392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787384635.319468:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787384635.319479:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c370f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+12:3654:x1874208203387008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384635.319530:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c370f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+12:3654:x1874208203387008:12345-0@lo:400:kworker.0 Request processed in 53us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384635.319537:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787384635.319568:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203387136:0@lo:38:kworker.0 00000100:00100000:3.0:1787384635.319605:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384635.319623:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203387264:0@lo:8:kworker.0 00000400:00000100:3.0:1787384635.319641:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874208203387264 offset 0 length 520: 4 00000100:00100000:3.0:1787384635.319650:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203387392:0@lo:8:kworker.0 00000400:00000100:3.0:1787384635.319664:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874208203387392 offset 0 length 520: 4 00000100:00100000:3.0:1787384635.319681:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203387136 00000100:00100000:3.0:1787384635.319684:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203387136 00000100:00100000:3.0:1787384635.319706:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787384635.319711:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1874208203387136:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787384635.319726:0:17155:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787384635.320125:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57899b24-a33b-4177-9883-79b5fe35053f:3654:1874208203387008:0@lo:400:kworker.0 00000100:00100000:2.0:1787384635.320733:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203387520:0@lo:400:kworker.0 00000100:00100000:2.0:1787384635.320799:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384635.320876:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203387520 00000100:00100000:2.0:1787384635.320881:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203387520 00000100:00100000:2.0:1787384635.320919:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787384635.320929:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203387520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384635.321074:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203387520:12345-0@lo:400:kworker.0 Request processed in 146us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384635.321082:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787384635.321117:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98f7c3a81500 x1874208203387520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384635.321129:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203387520:0@lo:400:kworker.0 00000100:00100000:3.0:1787384635.333053:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1874208203387136:12345-0@lo:38:kworker.0 Request processed in 13333us (13439us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787384635.333067:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787384635.333136:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f9131000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787384635.333142:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787384635.333146:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203387136:0@lo:38:kworker.0 00010000:00010000:2.0:1787384635.768566:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384636.281072:0:17192:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2956cc0 going to sleep for 0 seconds 00010000:00010000:0.0:1787384636.791095:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384637.303428:0:17192:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2956cc0 going to sleep for 0 seconds 00010000:00010000:2.0:1787384637.816009:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787384638.264078:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787384638.327041:0:17192:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2956cc0 going to sleep for 0 seconds 00010000:00010000:0.0:1787384638.842377:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384639.352146:0:17192:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2956cc0 going to sleep for 0 seconds 00010000:00010000:2.0:1787384639.863129:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384640.378670:0:17192:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2956cc0 going to sleep for 0 seconds 00000100:00080000:1.0:1787384640.438955:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787384640.438962:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787384640.438965:0:37:0:(import.c:65:import_set_state_nolock()) ffff98f8f9131000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787384640.438972:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 530 00000100:00080000:1.0:1787384640.438977:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787384640.438983:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98f8f9131000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:1.0:1787384640.439006:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f7c422ca80 x1874208203387776/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787384640.439025:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787384640.439042:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787384640.439044:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787384640.439047:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787384640.439099:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203387776:0@lo:38:kworker.0 00000100:00100000:1.0:1787384640.439176:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384640.439238:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787384640.439246:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874208203387904:0@lo:400:kworker.0 00000100:00100000:1.0:1787384640.439287:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384640.439315:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203387776 00000100:00100000:1.0:1787384640.439323:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203387776 00000100:00100000:1.0:1787384640.439357:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787384640.439364:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3650:x1874208203387776:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787384640.439391:0:17156:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787384640.443384:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57899b24-a33b-4177-9883-79b5fe35053f:3652:1874208203387648:0@lo:400:kworker.0 00000100:00100000:2.0:1787384640.443475:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384640.443548:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203387904 00000100:00100000:2.0:1787384640.443557:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203387904 00000100:00100000:2.0:1787384640.443604:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787384640.443613:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874208203387904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384640.443690:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874208203387904:12345-0@lo:400:kworker.0 Request processed in 76us (4401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384640.443698:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787384640.443829:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203387648 00000100:00100000:2.0:1787384640.443834:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203387648 00000100:00100000:2.0:1787384640.443863:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787384640.443870:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+12:3652:x1874208203387648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384640.443909:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+12:3652:x1874208203387648:12345-0@lo:400:kworker.0 Request processed in 39us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384640.443915:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1787384640.443996:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98f7c422ce00 x1874208203387904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384640.444011:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874208203387904:0@lo:400:kworker.0 00000100:00100000:2.0:1787384640.444042:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57899b24-a33b-4177-9883-79b5fe35053f:3652:1874208203387648:0@lo:400:kworker.0 00000100:00100000:1.0:1787384640.459043:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3650:x1874208203387776:12345-0@lo:38:kworker.0 Request processed in 19669us (19858us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787384640.459057:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787384640.466276:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f9131000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787384640.466289:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787384640.466294:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203387776:0@lo:38:kworker.0 00010000:00010000:0.0:1787384640.890722:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787384640.988919:0:17882:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787384640.988924:0:17882:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1787384640.988926:0:17882:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787384640.989035:0:17882:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff98f8f7d8f800 00000020:01000004:3.0:1787384640.989052:0:17882:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1787384640.989065:0:17882:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787384640.989079:0:17882:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff98f7c289b380) 00000020:00000080:3.0:1787384640.989095:0:17882:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787384641.059034:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1787384641.059619:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787384641.060523:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1787384641.060849:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787384641.061439:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1787384641.062434:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787384641.063261:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1787384641.065307:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1787384641.067579:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1787384641.070458:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1787384641.072575:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1787384641.073471:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1787384641.073965:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1787384641.074323:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787384641.075671:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1787384641.075988:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1787384641.076329:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1787384641.077551:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1787384641.078125:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787384641.079156:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1787384641.079888:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:0.0:1787384641.080119:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1787384641.080431:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1787384641.080722:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:0.0:1787384641.081153:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1787384641.082303:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1787384641.083035:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1787384641.083413:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1787384641.083719:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1787384641.084048:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:0.0:1787384641.084571:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1787384641.084915:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1787384641.085577:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1787384641.086210:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1787384641.087047:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1787384641.087353:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1787384641.087808:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1787384641.088246:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1787384641.088452:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1787384641.088754:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1787384641.089031:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1787384641.089853:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1787384641.090260:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1787384641.090552:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1787384641.091523:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1787384641.091830:0:17882:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00080000:01000000:1.0:1787384641.096905:0:17882:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787384641.097140:0:17882:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1787384641.097152:0:17882:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787384641.097175:0:17882:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7ef423838fba39ce 00000020:01000004:1.0:1787384641.097182:0:17882:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1787384641.097203:0:17882:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.145@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787384641.097206:0:17882:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.145@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787384641.097212:0:17882:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1787384641.097238:0:17882:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1787384641.097242:0:17882:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.145@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1787384641.103266:0:17882:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.145@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787384641.103307:0:17882:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.145@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1787384641.103381:0:17882:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787384641.103385:0:17882:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787384641.103386:0:17882:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787384641.103388:0:17882:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787384641.103389:0:17882:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787384641.103390:0:17882:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787384641.103392:0:17882:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787384641.103393:0:17882:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787384641.103394:0:17882:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787384641.103398:0:17882:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1787384641.103400:0:17882:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787384641.103402:0:17882:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787384641.103403:0:17882:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787384641.103404:0:17882:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787384641.103405:0:17882:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787384641.103406:0:17882:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787384641.103407:0:17882:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787384641.103409:0:17882:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787384641.103410:0:17882:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787384641.103437:0:17882:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1787384641.103459:0:17882:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203388032:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787384641.103523:0:17882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384641.103635:0:17882:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fc20d300 going to sleep for 11 seconds 00000100:00100000:3.0:1787384641.103884:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203388032 00000100:00100000:3.0:1787384641.103892:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203388032 00000100:00100000:3.0:1787384641.104019:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787384641.104029:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+12:17882:x1874208203388032:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787384641.104059:0:17144:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787384641.104062:0:17144:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1787384641.104070:0:17144:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1787384641.104588:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+12:17882:x1874208203388032:12345-0@lo:253:mount.lustre.0 Request processed in 560us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384641.104596:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787384641.104672:0:17882:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203388032:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787384641.104749:0:17882:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1787384641.104753:0:17882:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787384641.104755:0:17882:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787384641.104756:0:17882:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787384641.104757:0:17882:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787384641.104759:0:17882:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787384641.104760:0:17882:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787384641.104761:0:17882:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787384641.104763:0:17882:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787384641.104764:0:17882:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787384641.104901:0:17882:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98f8f7d8f800 from lustre-MDT0001 10000000:01000000:1.0:1787384641.104941:0:17882:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1787384641.104948:0:17882:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1787384641.104955:0:17882:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98f8f1813380 local copy 00010000:00010000:1.0:1787384641.104965:0:17882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8c6141a00/0x7ef423838fba38c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba38cb expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384641.106302:0:17882:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203388160:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787384641.106368:0:17882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384641.106809:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203388160 00000100:00100000:3.0:1787384641.106816:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203388160 00000100:00100000:3.0:1787384641.106868:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787384641.106878:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+12:17882:x1874208203388160:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787384641.106965:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+12:17882:x1874208203388160:12345-0@lo:501:mount.lustre.0 Request processed in 88us (596us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787384641.106972:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787384641.108018:0:17882:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fc20d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384641.108050:0:17882:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203388160:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787384641.108073:0:17882:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.145@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787384641.108107:0:17882:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.145@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787384641.108115:0:17882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8c6141a00/0x7ef423838fba38c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba38cb expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384641.108125:0:17882:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8c6141a00/0x7ef423838fba38c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba38cb expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384641.108154:0:17882:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98f8f7d8f800 10000000:01000000:1.0:1787384641.108159:0:17882:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787384641.108177:0:17882:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff98f8f1813380 10000000:01000000:1.0:1787384641.108181:0:17882:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787384641.108184:0:17882:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff98f8f1813380 from 1 10000000:01000000:1.0:1787384641.108186:0:17882:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787384641.108219:0:17882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3953c00/0x7ef423838fba39d5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384641.108227:0:17882:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f7c3953c00/0x7ef423838fba39d5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384641.108260:0:17882:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f7c3953c00/0x7ef423838fba39d5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384641.108280:0:17882:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203388288:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787384641.108488:0:17882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384641.108522:0:17882:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fc20d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384641.108591:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203388288 00000100:00100000:3.0:1787384641.108597:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203388288 00000100:00100000:3.0:1787384641.108632:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787384641.108641:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+12:17882:x1874208203388288:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787384641.108659:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384641.108672:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f902159200/0x7ef423838fba39dc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba39d5 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384641.108703:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f902159200/0x7ef423838fba39dc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba39d5 expref: 13 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384641.108713:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f902159200/0x7ef423838fba39dc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba39d5 expref: 13 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384641.108721:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f902159200, rc 0) 00000100:00100000:3.0:1787384641.108760:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+13:17882:x1874208203388288:12345-0@lo:101:mount.lustre.0 Request processed in 120us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384641.108767:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787384641.108957:0:17882:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203388288:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787384641.108970:0:17882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f7c3953c00/0x7ef423838fba39d5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba39dc expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384641.108980:0:17882:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f7c3953c00/0x7ef423838fba39d5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba39dc expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384641.108994:0:17882:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787384641.109011:0:17882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3953c00/0x7ef423838fba39d5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba39dc expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384641.109018:0:17882:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f7c3953c00/0x7ef423838fba39d5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba39dc expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384641.109025:0:17882:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98f8f7d8f800 10000000:01000000:1.0:1787384641.109029:0:17882:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787384641.109032:0:17882:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff98f8f7d8f800 from 1 10000000:01000000:1.0:1787384641.109034:0:17882:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787384641.109048:0:17882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3953a00/0x7ef423838fba39e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384641.109054:0:17882:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f7c3953a00/0x7ef423838fba39e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384641.109068:0:17882:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f7c3953a00/0x7ef423838fba39e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384641.109082:0:17882:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203388416:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787384641.109109:0:17882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384641.109130:0:17882:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fc20d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384641.109309:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203388416 00000100:00100000:0.0:1787384641.109325:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203388416 00000100:00100000:0.0:1787384641.109359:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787384641.109367:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+13:17882:x1874208203388416:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787384641.109375:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384641.109502:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8c6140400/0x7ef423838fba39ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba39e3 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384641.109518:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8c6140400/0x7ef423838fba39ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba39e3 expref: 14 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384641.109537:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8c6140400/0x7ef423838fba39ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba39e3 expref: 14 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384641.109544:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6140400, rc 0) 00000100:00100000:0.0:1787384641.109584:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+14:17882:x1874208203388416:12345-0@lo:101:mount.lustre.0 Request processed in 217us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384641.109589:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787384641.109638:0:17882:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203388416:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787384641.109650:0:17882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f7c3953a00/0x7ef423838fba39e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba39ea expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384641.109658:0:17882:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f7c3953a00/0x7ef423838fba39e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba39ea expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384641.109668:0:17882:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787384641.109714:0:17882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3953a00/0x7ef423838fba39e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba39ea expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384641.109722:0:17882:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f7c3953a00/0x7ef423838fba39e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba39ea expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384641.109729:0:17882:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787384641.109734:0:17882:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787384641.109739:0:17882:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98f8f7d8f800 10000000:01000000:2.0:1787384641.109742:0:17882:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787384641.109745:0:17882:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1787384641.109747:0:17882:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787384641.109762:0:17882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8d965a600/0x7ef423838fba39f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384641.109768:0:17882:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8d965a600/0x7ef423838fba39f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384641.109803:0:17882:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8d965a600/0x7ef423838fba39f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384641.109818:0:17882:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9148e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203388544:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787384641.109846:0:17882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384641.109878:0:17882:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7186e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787384641.110014:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203388544 00000100:00100000:0.0:1787384641.110019:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203388544 00000100:00100000:0.0:1787384641.110052:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787384641.110059:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd620c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+14:17882:x1874208203388544:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787384641.110066:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384641.110074:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8c6140800/0x7ef423838fba39f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba39f1 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384641.110087:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8c6140800/0x7ef423838fba39f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba39f1 expref: 15 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384641.110096:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8c6140800/0x7ef423838fba39f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba39f1 expref: 15 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384641.110103:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6140800, rc 0) 00000100:00100000:0.0:1787384641.110188:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd620c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+15:17882:x1874208203388544:12345-0@lo:101:mount.lustre.0 Request processed in 129us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384641.110194:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787384641.112041:0:17882:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9148e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203388544:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787384641.112067:0:17882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8d965a600/0x7ef423838fba39f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba39f8 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384641.112079:0:17882:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8d965a600/0x7ef423838fba39f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba39f8 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787384641.114434:0:17882:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:2.0:1787384641.115628:0:17882:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787384641.121138:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787384641.121278:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1787384641.121295:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1787384641.121763:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1787384641.121820:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:2.0:1787384641.121839:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:2.0:1787384641.121852:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:2.0:1787384641.121865:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1787384641.121876:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1787384641.121888:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:2.0:1787384641.121901:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:2.0:1787384641.121913:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:2.0:1787384641.121938:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:2.0:1787384641.121954:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1787384641.121986:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1787384641.121998:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:2.0:1787384641.122010:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1787384641.122023:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1787384641.122035:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:2.0:1787384641.122049:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1787384641.122065:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1787384641.122078:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1787384641.122091:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1787384641.122120:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:2.0:1787384641.122126:0:17882:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:2.0:1787384641.122239:0:17882:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9148e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203388672:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787384641.122828:0:17882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384641.122881:0:17882:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7ce4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787384641.123061:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203388672 00000100:00100000:0.0:1787384641.123070:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203388672 00000100:00100000:0.0:1787384641.123133:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787384641.123142:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+15:17882:x1874208203388672:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787384641.123518:0:17882:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9148e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203388672:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787384641.123562:0:17882:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203388800:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787384641.123608:0:17882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384641.123641:0:17882:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fc20d600 going to sleep for 11 seconds 00000100:00100000:0.0:1787384641.123673:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+15:17882:x1874208203388672:12345-0@lo:501:mount.lustre.0 Request processed in 174us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384641.123681:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787384641.123705:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203388800 00000100:00100000:0.0:1787384641.123709:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203388800 00000100:00100000:0.0:1787384641.123724:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787384641.123729:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+15:17882:x1874208203388800:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787384641.124565:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+15:17882:x1874208203388800:12345-0@lo:503:mount.lustre.0 Request processed in 832us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384641.124574:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787384641.124705:0:17882:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203388800:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787384641.125142:0:17882:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787384641.125225:0:17882:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203388928:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787384641.125279:0:17882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384641.125321:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203388928 00000100:00100000:1.0:1787384641.125323:0:17882:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fc20d600 going to sleep for 11 seconds 00000100:00100000:3.0:1787384641.125326:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203388928 00000100:00100000:3.0:1787384641.125369:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787384641.125377:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd621c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+15:17882:x1874208203388928:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787384641.126011:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd621c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+15:17882:x1874208203388928:12345-0@lo:502:mount.lustre.0 Request processed in 633us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384641.126019:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787384641.126034:0:17882:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203388928:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787384641.126648:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787384641.126681:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:1.0:1787384641.126694:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:1.0:1787384641.126707:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:1.0:1787384641.126721:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:1.0:1787384641.126733:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:1.0:1787384641.126745:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:1.0:1787384641.126757:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:1.0:1787384641.126768:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:1.0:1787384641.126840:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:1.0:1787384641.126853:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:1.0:1787384641.126864:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:1.0:1787384641.126876:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:1.0:1787384641.126887:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:1.0:1787384641.126899:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:1.0:1787384641.126914:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:1.0:1787384641.126940:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:1.0:1787384641.126954:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:1.0:1787384641.126967:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:1.0:1787384641.126980:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:1.0:1787384641.126993:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:1.0:1787384641.127005:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:1.0:1787384641.127017:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:1.0:1787384641.127029:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:1.0:1787384641.127040:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:1.0:1787384641.127053:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:1.0:1787384641.127064:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:1.0:1787384641.127076:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:1.0:1787384641.127089:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:1.0:1787384641.127101:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:1.0:1787384641.127115:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:1.0:1787384641.127130:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:1.0:1787384641.127142:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:1.0:1787384641.127154:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:1.0:1787384641.127180:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:1.0:1787384641.127195:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:1.0:1787384641.127206:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:1.0:1787384641.127217:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:1.0:1787384641.127231:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:1.0:1787384641.127246:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:1.0:1787384641.127269:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:1.0:1787384641.127283:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:1.0:1787384641.127310:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:1.0:1787384641.127322:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:1.0:1787384641.127357:0:17882:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203389056:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787384641.127426:0:17882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384641.127460:0:17882:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fc20d600 going to sleep for 11 seconds 00000100:00100000:0.0:1787384641.127740:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203389056 00000100:00100000:0.0:1787384641.127747:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203389056 00000100:00100000:0.0:1787384641.127819:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787384641.127829:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd622450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+15:17882:x1874208203389056:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787384641.128040:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd622450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+15:17882:x1874208203389056:12345-0@lo:502:mount.lustre.0 Request processed in 212us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384641.128048:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787384641.128113:0:17882:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203389056:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787384641.128175:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:3.0:1787384641.128185:0:17882:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1787384641.129133:0:17886:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787384641.129144:0:17886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384641.129147:0:17886:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787384641.129152:0:17886:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1787384641.129155:0:17886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787384641.129178:0:17886:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff98f8f91f19c0) 00000020:00000080:1.0:1787384641.129197:0:17886:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1787384641.129203:0:17886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787384641.129297:0:17886:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787384641.129304:0:17886:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7ef423838fba3a06 00000020:00000080:1.0:1787384641.129505:0:17886:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1787384641.129511:0:17886:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384641.129515:0:17886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384641.129517:0:17886:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787384641.129520:0:17886:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787384641.129523:0:17886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384641.129524:0:17886:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1787384641.129528:0:17886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787384641.129535:0:17886:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff98f8f96899c0) 00000020:00000080:1.0:1787384641.129547:0:17886:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1787384641.129550:0:17886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787384641.129553:0:17886:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1787384641.129555:0:17886:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1787384641.129560:0:17886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787384641.129602:0:17886:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f8f7d8f800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1787384641.129613:0:17886:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff98f8f968b380) 00000020:00000080:1.0:1787384641.129622:0:17886:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1787384641.129696:0:17886:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787384641.129703:0:17886:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7ef423838fba3a1b 00000020:00000080:1.0:1787384641.129817:0:17886:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1787384641.129824:0:17886:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787384641.129829:0:17886:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x7ef423838fba3a22 00080000:01000000:1.0:1787384641.129834:0:17886:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787384641.129837:0:17886:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7ef423838fba3a29 00010000:00010000:2.0:1787384641.238468:0:17886:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1787384641.239516:0:17886:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1787384641.241175:0:17886:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787384641.243086:0:17886:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1787384641.243099:0:17886:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787384641.243105:0:17886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384641.243266:0:17886:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1787384641.243273:0:17886:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787384641.243279:0:17886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384641.243283:0:17886:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1787384641.243285:0:17886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787384641.243290:0:17886:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.145@tcp to nid 0x20000c0a8cb91 (192.168.203.145@tcp) 00000020:00000080:3.0:1787384641.243316:0:17886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787384641.243330:0:17886:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff98f7c289cd40) 00000020:00000080:3.0:1787384641.243351:0:17886:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1787384641.243356:0:17886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787384641.243425:0:17886:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1787384641.243433:0:17886:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787384641.243439:0:17886:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7ef423838fba3a37 00010000:00080000:3.0:1787384641.243470:0:17886:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f8f87a4800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.145@tcp at head 00010000:00010000:3.0:1787384641.246275:0:17886:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1787384641.252508:0:17886:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787384641.252524:0:17886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787384641.252563:0:17886:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787384641.252585:0:17886:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7ef423838fba3a3e 00000100:00080000:0.0:1787384641.252596:0:17886:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787384641.252602:0:17886:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff98f8f87a4800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:0.0:1787384641.252639:0:17886:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f7c3a81180 x1874208203389184/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787384641.252753:0:17886:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1787384641.252852:0:17886:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384641.252856:0:17886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384641.252857:0:17886:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1787384641.252861:0:17886:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787384641.252863:0:17886:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1787384641.252865:0:17886:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787384641.252866:0:17886:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787384641.252867:0:17886:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787384641.252870:0:17886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384641.252871:0:17886:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787384641.252874:0:17886:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787384641.252878:0:17886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384641.252879:0:17886:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1787384641.252883:0:17886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787384641.252909:0:17886:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787384641.252921:0:17886:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384641.253001:0:17886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384641.253004:0:17886:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1787384641.253008:0:17886:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787384641.253010:0:17886:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1787384641.253011:0:17886:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787384641.253012:0:17886:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787384641.253014:0:17886:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787384641.253017:0:17886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384641.253018:0:17886:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787384641.253020:0:17886:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787384641.253023:0:17886:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1787384641.253026:0:17886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384641.253027:0:17886:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787384641.253030:0:17886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787384641.253035:0:17886:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.145@tcp to nid 0x20000c0a8cb91 (192.168.203.145@tcp) 00000020:01000000:0.0:1787384641.253065:0:17886:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1787384641.253068:0:17886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787384641.253090:0:17886:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff98f8f54b0000) 00000020:00000080:0.0:1787384641.253104:0:17886:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1787384641.253110:0:17886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00080000:2.0:1787384641.253216:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787384641.253221:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787384641.253224:0:37:0:(import.c:65:import_set_state_nolock()) ffff98f8f9131000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787384641.253229:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 535 00000100:00080000:2.0:1787384641.253232:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787384641.253235:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98f8f9131000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:2.0:1787384641.253263:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f914bb80 x1874208203389312/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787384641.253273:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384641.253277:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787384641.253285:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384641.253288:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787384641.253331:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874208203389440:0@lo:400:kworker.0 00000100:00100000:2.0:1787384641.253392:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384641.253456:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203389440 00000100:00100000:2.0:1787384641.253463:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203389440 00000100:00100000:2.0:1787384641.253504:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787384641.253514:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874208203389440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384641.253565:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874208203389440:12345-0@lo:400:kworker.0 Request processed in 52us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384641.253572:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787384641.253608:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98f8f9149880 x1874208203389440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384641.253621:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874208203389440:0@lo:400:kworker.0 00000100:00100000:1.0:1787384641.253736:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203389184:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787384641.253773:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384641.253817:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203389312:0@lo:38:kworker.0 00000100:00100000:1.0:1787384641.253838:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384641.253866:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203389184 00000100:00100000:1.0:1787384641.253870:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203389184 00000100:00100000:1.0:1787384641.253883:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203389312 00000100:00100000:1.0:1787384641.253886:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203389312 00000100:00100000:1.0:1787384641.253893:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787384641.253897:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3650:x1874208203389184:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787384641.253917:0:17156:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:1.0:1787384641.253991:0:17156:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7ef423838fba3a4c 00000004:00100000:1.0:1787384641.254006:0:17156:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1787384641.254012:0:17156:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000004:00080000:0.0:1787384641.254531:0:17886:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1787384641.254539:0:17886:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787384641.254547:0:17886:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7ef423838fba3a53 00010000:00080000:0.0:1787384641.254577:0:17886:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f8d9107000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.145@tcp at head 00010000:00010000:0.0:1787384641.255045:0:17886:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:0.0:1787384641.256484:0:17886:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787384641.256899:0:17886:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1787384641.263543:0:17886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787384641.263987:0:17886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1787384641.264145:0:17886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00080000:1.0:1787384641.265112:0:17156:0:(import.c:65:import_set_state_nolock()) ffff98f7c2055000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787384641.265223:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3650:x1874208203389184:12345-0@lo:38:llog_process_th.0 Request processed in 11321us (11446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384641.265233:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787384641.265271:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787384641.265277:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3650:x1874208203389312:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1787384641.265318:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3650:x1874208203389312:12345-0@lo:38:kworker.0 Request processed in 40us (11479us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787384641.265332:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787384641.266069:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787384641.266081:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1787384641.266089:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1787384641.266094:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787384641.266097:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f87a4800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787384641.266115:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203389184:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787384641.266131:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787384641.266136:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f9131000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787384641.266139:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787384641.266142:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203389312:0@lo:38:kworker.0 00000100:00100000:2.0:1787384641.266369:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787384641.266385:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203389568:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787384641.266435:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384641.266472:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203389568 00000100:00100000:2.0:1787384641.266478:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203389568 00000100:00100000:2.0:1787384641.266518:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787384641.266526:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3652:x1874208203389568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787384641.266551:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787384641.266588:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3652:x1874208203389568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384641.266594:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787384641.266636:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203389568:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1787384641.267982:0:17891:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787384641.267988:0:17891:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787384641.270406:0:17886:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787384641.270421:0:17886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787384641.270459:0:17886:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787384641.270486:0:17886:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7ef423838fba3a5a 00000100:00080000:0.0:1787384641.270495:0:17886:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787384641.270501:0:17886:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff98f8d9107000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:0.0:1787384641.270536:0:17886:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f7c3a81180 x1874208203389696/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787384641.270568:0:17886:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787384641.270598:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787384641.270602:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787384641.270604:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787384641.270607:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:0.0:1787384641.270648:0:17886:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384641.270652:0:17886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384641.270654:0:17886:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787384641.270657:0:17886:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787384641.270660:0:17886:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1787384641.270661:0:17886:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787384641.270663:0:17886:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787384641.270665:0:17886:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787384641.270667:0:17886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384641.270668:0:17886:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787384641.270671:0:17886:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787384641.270675:0:17886:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1787384641.270678:0:17886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384641.270679:0:17886:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787384641.270691:0:17886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000100:00100000:3.0:1787384641.270693:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203389696:0@lo:8:llog_process_th.0 00000020:00000080:0.0:1787384641.270695:0:17886:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.145@tcp to nid 0x20000c0a8cb91 (192.168.203.145@tcp) 00000020:01000000:0.0:1787384641.270717:0:17886:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1787384641.270719:0:17886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787384641.270729:0:17886:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff98f8f54b3380) 00000400:00000100:3.0:1787384641.270742:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874208203389696 offset 0 length 520: 4 00000020:00000080:0.0:1787384641.270744:0:17886:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1787384641.270749:0:17886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787384641.270826:0:17886:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1787384641.270833:0:17886:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787384641.270839:0:17886:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7ef423838fba3a68 00010000:00080000:0.0:1787384641.270865:0:17886:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f8f919a800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.145@tcp at head 00010000:00010000:0.0:1787384641.271348:0:17886:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1787384641.271575:0:17886:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787384641.271590:0:17886:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1787384641.274122:0:17886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787384641.274583:0:17886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1787384641.274889:0:17886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1787384641.277419:0:17893:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787384641.277429:0:17893:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787384641.278301:0:17886:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787384641.278313:0:17886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787384641.278354:0:17886:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787384641.278388:0:17886:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7ef423838fba3a6f 00000100:00080000:0.0:1787384641.278399:0:17886:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787384641.278405:0:17886:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98f8f919a800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:0.0:1787384641.278439:0:17886:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f7c3a80700 x1874208203389824/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787384641.278467:0:17886:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787384641.278518:0:17886:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384641.278523:0:17886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384641.278525:0:17886:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787384641.278527:0:17886:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787384641.278531:0:17886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384641.278533:0:17886:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787384641.278536:0:17886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787384641.278538:0:17886:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787384641.278540:0:17886:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384641.278542:0:17886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384641.278552:0:17886:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787384641.278555:0:17886:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787384641.278557:0:17886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384641.278559:0:17886:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787384641.278562:0:17886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787384641.278587:0:17886:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384641.278589:0:17886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384641.278591:0:17886:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787384641.278593:0:17886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00100000:3.0:1787384641.278686:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203389824:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787384641.278741:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874208203389824 offset 0 length 520: 4 00000020:01000000:3.0:1787384641.278827:0:17882:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1787384641.278858:0:17882:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1787384641.278876:0:17882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8d965a600/0x7ef423838fba39f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba39f8 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384641.278887:0:17882:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8d965a600/0x7ef423838fba39f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba39f8 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384641.278906:0:17882:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98f8f7d8f800 from 1 10000000:01000000:3.0:1787384641.278908:0:17882:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787384641.278934:0:17882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902158200/0x7ef423838fba3a76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384641.278941:0:17882:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f902158200/0x7ef423838fba3a76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384641.278952:0:17882:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f902158200/0x7ef423838fba3a76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384641.278967:0:17882:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203389952:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787384641.279005:0:17882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384641.279024:0:17882:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f8749cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384641.279042:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203389952 00000100:00100000:3.0:1787384641.279049:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203389952 00000100:00100000:3.0:1787384641.279085:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787384641.279092:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+15:17882:x1874208203389952:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787384641.279105:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384641.279116:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f902158c00/0x7ef423838fba3a7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba3a76 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384641.279138:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f902158c00/0x7ef423838fba3a7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba3a76 expref: 16 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384641.279147:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f902158c00/0x7ef423838fba3a7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba3a76 expref: 16 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384641.279177:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f902158c00, rc 0) 00000100:00100000:3.0:1787384641.279214:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+16:17882:x1874208203389952:12345-0@lo:101:mount.lustre.0 Request processed in 121us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384641.279221:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787384641.279277:0:17882:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203389952:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787384641.279290:0:17882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f902158200/0x7ef423838fba3a76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3a7d expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384641.279299:0:17882:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f902158200/0x7ef423838fba3a76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba3a7d expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787384641.279474:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384641.279479:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787384641.279481:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384641.279484:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787384641.280248:0:17882:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203390080:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787384641.280309:0:17882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384641.280337:0:17882:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2956540 going to sleep for 11 seconds 00000100:00100000:0.0:1787384641.280455:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203390080 00000100:00100000:0.0:1787384641.280460:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203390080 00000100:00100000:0.0:1787384641.280501:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787384641.280509:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+16:17882:x1874208203390080:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1787384641.280523:0:17142:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787384641.280540:0:17142:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787384641.280543:0:17142:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1787384641.280630:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+16:17882:x1874208203390080:12345-0@lo:256:mount.lustre.0 Request processed in 121us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384641.280638:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787384641.281431:0:17882:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203390080:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1787384641.282095:0:17882:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787384641.282116:0:17882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902158200/0x7ef423838fba3a76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3a7d expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384641.282127:0:17882:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f902158200/0x7ef423838fba3a76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3a7d expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384641.282135:0:17882:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98f8f7d8f800 from 1 10000000:01000000:1.0:1787384641.282138:0:17882:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787384641.283315:0:17882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3952a00/0x7ef423838fba3a84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384641.283331:0:17882:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f7c3952a00/0x7ef423838fba3a84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384641.283341:0:17882:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f7c3952a00/0x7ef423838fba3a84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384641.283368:0:17882:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203390208:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787384641.283443:0:17882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384641.283475:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203390208 00000100:00100000:1.0:1787384641.283480:0:17882:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c41c3900 going to sleep for 11 seconds 00000100:00100000:2.0:1787384641.283482:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203390208 00000100:00100000:2.0:1787384641.283538:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787384641.283547:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+16:17882:x1874208203390208:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787384641.283560:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384641.283573:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8d965a000/0x7ef423838fba3a8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba3a84 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384641.283596:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8d965a000/0x7ef423838fba3a8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba3a84 expref: 17 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384641.283606:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8d965a000/0x7ef423838fba3a8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba3a84 expref: 17 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384641.283614:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965a000, rc 0) 00000100:00100000:2.0:1787384641.283649:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+17:17882:x1874208203390208:12345-0@lo:101:mount.lustre.0 Request processed in 103us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384641.283656:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787384641.283871:0:17882:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203390208:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787384641.283884:0:17882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f7c3952a00/0x7ef423838fba3a84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3a8b expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384641.283898:0:17882:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f7c3952a00/0x7ef423838fba3a84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba3a8b expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787384641.284024:0:17882:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787384641.284058:0:17882:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203390336:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787384641.284086:0:17882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384641.284113:0:17882:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c41c36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384641.284221:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203390336 00000100:00100000:2.0:1787384641.284226:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203390336 00000100:00100000:2.0:1787384641.284266:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787384641.284272:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+17:17882:x1874208203390336:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787384641.284352:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+17:17882:x1874208203390336:12345-0@lo:501:mount.lustre.0 Request processed in 80us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384641.284358:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787384641.285635:0:17882:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203390336:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787384641.285683:0:17882:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203390464:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787384641.285742:0:17882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384641.285876:0:17882:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c41c36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384641.286429:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203390464 00000100:00100000:2.0:1787384641.286435:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203390464 00000100:00100000:2.0:1787384641.286477:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787384641.286484:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+17:17882:x1874208203390464:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787384641.286603:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+17:17882:x1874208203390464:12345-0@lo:503:mount.lustre.0 Request processed in 119us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384641.286610:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787384641.288065:0:17882:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203390464:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787384641.288572:0:17882:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787384641.288902:0:17882:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203390592:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787384641.288968:0:17882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384641.289052:0:17882:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c41c3900 going to sleep for 11 seconds 00000100:00100000:0.0:1787384641.292808:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203390592 00000100:00100000:0.0:1787384641.292823:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203390592 00000100:00100000:0.0:1787384641.292881:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787384641.292890:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+17:17882:x1874208203390592:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787384641.293052:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+17:17882:x1874208203390592:12345-0@lo:502:mount.lustre.0 Request processed in 162us (4084us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384641.293061:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787384641.293298:0:17882:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203390592:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787384641.293538:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787384641.293570:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1787384641.293584:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1787384641.293596:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1787384641.293607:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1787384641.293620:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1787384641.293633:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1787384641.293665:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:1.0:1787384641.293699:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787384641.293714:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:1.0:1787384641.293728:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:1.0:1787384641.293761:0:17882:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203390720:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787384641.293839:0:17882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384641.293874:0:17882:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c41c3900 going to sleep for 11 seconds 00000100:00100000:3.0:1787384641.294348:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203390720 00000100:00100000:3.0:1787384641.294353:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203390720 00000100:00100000:3.0:1787384641.294395:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787384641.294403:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+17:17882:x1874208203390720:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787384641.294516:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+17:17882:x1874208203390720:12345-0@lo:502:mount.lustre.0 Request processed in 112us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384641.294523:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787384641.295803:0:17882:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203390720:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787384641.295902:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:1.0:1787384641.295916:0:17882:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787384641.297601:0:17895:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787384641.297614:0:17895:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384641.297617:0:17895:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787384641.297624:0:17895:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f8f7d8f800 00000020:00000080:3.0:1787384641.297627:0:17895:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787384641.297635:0:17895:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787384641.297637:0:17895:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384641.297638:0:17895:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787384641.297640:0:17895:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787384641.297670:0:17895:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384641.297672:0:17895:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787384641.297676:0:17895:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f8f7d8f800 00000020:00000080:3.0:1787384641.297678:0:17895:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787384641.297735:0:17895:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787384641.297739:0:17895:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384641.297740:0:17895:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787384641.299900:0:17895:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787384641.299910:0:17895:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384641.299912:0:17895:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787384641.299918:0:17895:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f8f7d8f800 00000020:00000080:3.0:1787384641.299921:0:17895:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787384641.299971:0:17895:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787384641.299975:0:17895:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384641.299976:0:17895:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787384641.299979:0:17895:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787384641.299981:0:17895:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384641.299982:0:17895:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787384641.299985:0:17895:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f8f7d8f800 00000020:00000080:3.0:1787384641.299987:0:17895:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787384641.300021:0:17895:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787384641.300024:0:17895:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384641.300026:0:17895:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787384641.300029:0:17895:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:3.0:1787384641.300100:0:17882:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787384641.300127:0:17882:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787384641.300151:0:17882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3952a00/0x7ef423838fba3a84 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3a8b expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384641.300173:0:17882:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f7c3952a00/0x7ef423838fba3a84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3a8b expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384641.300219:0:17882:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787384641.300226:0:17882:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98f8f7d8f800 10000000:01000000:3.0:1787384641.300229:0:17882:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98f8f7d8f800 10000000:01000000:3.0:1787384641.300232:0:17882:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787384641.300238:0:17882:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98f8f7d8f800 from 1 10000000:01000000:3.0:1787384641.300240:0:17882:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787384641.300288:0:17882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902159600/0x7ef423838fba3a92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384641.300296:0:17882:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f902159600/0x7ef423838fba3a92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384641.300306:0:17882:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f902159600/0x7ef423838fba3a92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384641.300328:0:17882:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203390848:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787384641.300387:0:17882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384641.300424:0:17882:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f8749d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787384641.304541:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203390848 00000100:00100000:0.0:1787384641.304555:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203390848 00000100:00100000:0.0:1787384641.304607:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787384641.304615:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+17:17882:x1874208203390848:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787384641.304637:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384641.307813:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8c6140200/0x7ef423838fba3a99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba3a92 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384641.307856:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8c6140200/0x7ef423838fba3a99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba3a92 expref: 18 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384641.307869:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8c6140200/0x7ef423838fba3a99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba3a92 expref: 18 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384641.307877:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6140200, rc 0) 00000100:00100000:0.0:1787384641.307949:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+18:17882:x1874208203390848:12345-0@lo:101:mount.lustre.0 Request processed in 3333us (7560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384641.307957:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787384641.309381:0:17882:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203390848:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787384641.309404:0:17882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f902159600/0x7ef423838fba3a92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3a99 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384641.309416:0:17882:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f902159600/0x7ef423838fba3a92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba3a99 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787384641.314715:0:17882:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1787384641.316553:0:17882:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787384641.316801:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1787384641.316831:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:1.0:1787384641.316849:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:1.0:1787384641.316863:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:1.0:1787384641.316878:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:1.0:1787384641.316897:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:1.0:1787384641.316914:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:1.0:1787384641.316931:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:1.0:1787384641.316945:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:1.0:1787384641.316958:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:1.0:1787384641.316972:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:1.0:1787384641.317003:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:1.0:1787384641.317019:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:1.0:1787384641.317033:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:1.0:1787384641.317044:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:1.0:1787384641.317055:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:1.0:1787384641.317068:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:1.0:1787384641.317082:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:1.0:1787384641.317096:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:1.0:1787384641.317111:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:1.0:1787384641.317137:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:1.0:1787384641.317152:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:1.0:1787384641.317165:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:1.0:1787384641.317179:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:1.0:1787384641.317193:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:1.0:1787384641.317207:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:1.0:1787384641.317220:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:1.0:1787384641.317262:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:1.0:1787384641.317290:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:1.0:1787384641.317296:0:17882:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1787384641.317391:0:17882:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203390976:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787384641.317456:0:17882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384641.317503:0:17882:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fc1dc240 going to sleep for 11 seconds 00000100:00100000:3.0:1787384641.318461:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203390976 00000100:00100000:3.0:1787384641.318471:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203390976 00000100:00100000:3.0:1787384641.318520:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787384641.318529:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd592c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+18:17882:x1874208203390976:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787384641.318682:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd592c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+18:17882:x1874208203390976:12345-0@lo:501:mount.lustre.0 Request processed in 153us (1225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384641.318696:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787384641.318791:0:17882:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203390976:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787384641.318834:0:17882:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203391104:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787384641.318873:0:17882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384641.318903:0:17882:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f8749240 going to sleep for 11 seconds 00000100:00100000:1.0:1787384641.321115:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203391104 00000100:00100000:1.0:1787384641.321130:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203391104 00000100:00100000:1.0:1787384641.321188:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787384641.321198:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+18:17882:x1874208203391104:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787384641.321370:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+18:17882:x1874208203391104:12345-0@lo:503:mount.lustre.0 Request processed in 173us (2496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384641.321379:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787384641.321390:0:17882:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203391104:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787384641.321860:0:17882:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787384641.321960:0:17882:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203391232:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787384641.322010:0:17882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384641.322041:0:17882:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f8749d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787384641.322117:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203391232 00000100:00100000:1.0:1787384641.322122:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203391232 00000100:00100000:1.0:1787384641.322162:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787384641.322171:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+18:17882:x1874208203391232:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787384641.322268:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+18:17882:x1874208203391232:12345-0@lo:502:mount.lustre.0 Request processed in 98us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384641.324299:0:17882:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203391232:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787384641.326625:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1787384641.326680:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:2.0:1787384641.326773:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000100:00100000:1.0:1787384641.326773:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000040:00080000:2.0:1787384641.326817:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:2.0:1787384641.326832:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:2.0:1787384641.326849:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:2.0:1787384641.326864:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:2.0:1787384641.326876:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:2.0:1787384641.326889:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:2.0:1787384641.326902:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:2.0:1787384641.326913:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:2.0:1787384641.327203:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:2.0:1787384641.327225:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:2.0:1787384641.327240:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:2.0:1787384641.327275:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:2.0:1787384641.327291:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:2.0:1787384641.327322:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:2.0:1787384641.327337:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:2.0:1787384641.327349:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:2.0:1787384641.327362:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:2.0:1787384641.327627:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:2.0:1787384641.327649:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:2.0:1787384641.327665:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:2.0:1787384641.327679:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:2.0:1787384641.328061:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:2.0:1787384641.328087:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:2.0:1787384641.328101:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:2.0:1787384641.328230:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:2.0:1787384641.328261:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:2.0:1787384641.328278:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:2.0:1787384641.328290:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:2.0:1787384641.328303:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:2.0:1787384641.328331:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:2.0:1787384641.328346:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:2.0:1787384641.328358:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:2.0:1787384641.328370:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:2.0:1787384641.328724:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:2.0:1787384641.328744:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:2.0:1787384641.328759:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:2.0:1787384641.328771:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:2.0:1787384641.328820:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:2.0:1787384641.328836:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:2.0:1787384641.328850:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:2.0:1787384641.328866:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:2.0:1787384641.328878:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:2.0:1787384641.328889:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:2.0:1787384641.328902:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:2.0:1787384641.328941:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:2.0:1787384641.329014:0:17882:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203391360:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787384641.329098:0:17882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384641.329150:0:17882:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f1b9f540 going to sleep for 11 seconds 00000100:00100000:1.0:1787384641.329298:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203391360 00000100:00100000:1.0:1787384641.329312:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203391360 00000100:00100000:1.0:1787384641.329371:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787384641.329380:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+18:17882:x1874208203391360:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787384641.329500:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+18:17882:x1874208203391360:12345-0@lo:502:mount.lustre.0 Request processed in 121us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384641.329508:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787384641.329694:0:17882:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203391360:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787384641.329904:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:2.0:1787384641.329943:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:2.0:1787384641.329969:0:17882:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203391488:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787384641.330007:0:17882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384641.330052:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203391488 00000100:00100000:2.0:1787384641.330054:0:17882:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f1b9f540 going to sleep for 11 seconds 00000100:00100000:1.0:1787384641.330058:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203391488 00000100:00100000:1.0:1787384641.330094:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787384641.330101:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd590850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+18:17882:x1874208203391488:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787384641.330175:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd590850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+18:17882:x1874208203391488:12345-0@lo:502:mount.lustre.0 Request processed in 73us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384641.330182:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787384641.330259:0:17882:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203391488:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787384641.330296:0:17882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:2.0:1787384641.330303:0:17882:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1787384641.331181:0:17900:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1787384641.331197:0:17900:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff98f8fc2b4d40) 00000020:00000080:0.0:1787384641.331218:0:17900:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1787384641.331404:0:17900:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f8f7d8f800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1787384641.331409:0:17900:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f8f7d8f800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1787384641.331411:0:17900:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f8f7d8f800 3 00010000:00080000:0.0:1787384641.331444:0:17900:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f8ee0cb000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.145@tcp at head 00010000:00010000:0.0:1787384641.333168:0:17900:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1787384641.333297:0:17900:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1787384641.333338:0:17900:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787384641.333351:0:17900:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x7ef423838fba3aa7 00000100:00080000:0.0:1787384641.333362:0:17900:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787384641.333369:0:17900:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff98f8ee0cb000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:0.0:1787384641.333406:0:17900:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f7c3a80e00 x1874208203391616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787384641.333451:0:17900:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787384641.333472:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874208203391616:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787384641.333538:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787384641.334205:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384641.334212:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787384641.334215:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384641.334217:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787384641.338444:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203391616 00000100:00100000:0.0:1787384641.338460:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203391616 00000100:00100000:0.0:1787384641.338518:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787384641.338527:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1874208203391616:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787384641.338580:0:17151:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:0.0:1787384641.338621:0:17151:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x7ef423838fba3aae 00000004:00100000:0.0:1787384641.338638:0:17151:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787384641.338674:0:17151:0:(import.c:65:import_set_state_nolock()) ffff98f8ee0c8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787384641.338752:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874208203391616:12345-0@lo:38:llog_process_th.0 Request processed in 224us (5212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384641.338759:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:0.0:1787384641.338896:0:17900:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:2.0:1787384641.339488:0:17882:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787384641.339526:0:17882:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787384641.339551:0:17882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902159600/0x7ef423838fba3a92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3a99 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384641.339563:0:17882:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f902159600/0x7ef423838fba3a92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3a99 expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787384641.339614:0:17882:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787384641.339620:0:17882:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787384641.339621:0:17882:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787384641.339622:0:17882:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787384641.339623:0:17882:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787384641.339624:0:17882:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787384641.339626:0:17882:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787384641.339627:0:17882:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787384641.339628:0:17882:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787384641.339632:0:17882:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1787384641.339634:0:17882:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787384641.339635:0:17882:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787384641.339636:0:17882:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787384641.339637:0:17882:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787384641.339638:0:17882:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787384641.339639:0:17882:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787384641.339639:0:17882:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787384641.339640:0:17882:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787384641.339641:0:17882:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787384641.339662:0:17882:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1787384641.339680:0:17882:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203391744:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787384641.339743:0:17882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384641.339802:0:17882:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f1b9f540 going to sleep for 11 seconds 00000100:00100000:1.0:1787384641.339881:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203391744 00000100:00100000:1.0:1787384641.339887:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203391744 00000100:00100000:1.0:1787384641.339935:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787384641.339945:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+18:17882:x1874208203391744:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787384641.339967:0:17144:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787384641.339983:0:17144:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1787384641.344026:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98f7c3a80e00 x1874208203391616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787384651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384641.344043:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787384641.344053:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1787384641.344061:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787384641.344067:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787384641.344070:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8ee0cb000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787384641.344076:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874208203391616:0@lo:38:llog_process_th.0 00000001:00100000:3.0:1787384641.344607:0:17130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1787384641.344771:0:17144:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787384641.344847:0:17144:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1787384641.344858:0:17166:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787384641.344863:0:17166:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787384641.344890:0:17166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98f902159400/0x7ef423838fba3ab5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384641.344906:0:17166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f902158600/0x7ef423838fba39b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba39b2 expref: 18 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384641.344915:0:17166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f902158c00/0x7ef423838fba3a7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba3a76 expref: 18 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384641.344922:0:17166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98f902159400/0x7ef423838fba3ab5 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384641.344959:0:17166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f902158c00/0x7ef423838fba3a7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba3a76 expref: 18 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384641.344986:0:17166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f902158c00/0x7ef423838fba3a7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba3a76 expref: 18 pid: 17144 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384641.345000:0:17166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91db100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1874208203391872:0@lo:104: 00000100:00100000:3.0:1787384641.345054:0:17166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787384641.345098:0:17166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f902158600/0x7ef423838fba39b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba39b2 expref: 18 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384641.345106:0:17166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f902158600/0x7ef423838fba39b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba39b2 expref: 18 pid: 17142 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384641.345114:0:17166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91dad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1874208203392000:0@lo:104: 00000100:00100000:3.0:1787384641.345135:0:17166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384641.345157:0:17166:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f8749b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787384641.345487:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203391872 00000100:00100000:0.0:1787384641.345494:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203391872 00000100:00100000:0.0:1787384641.345525:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203392000 00000100:00100000:0.0:1787384641.345528:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203392000 00000100:00100000:0.0:1787384641.345546:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787384641.345556:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:57899b24-a33b-4177-9883-79b5fe35053f+4:17166:x1874208203391872:12345-0@lo:104: 00010000:00010000:0.0:1787384641.345570:0:17134:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f902158200/0x7ef423838fba3a76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba3a7d expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384641.345639:0:17134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787384641.345645:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:57899b24-a33b-4177-9883-79b5fe35053f+4:17166:x1874208203391872:12345-0@lo:104: Request processed in 90us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384641.345663:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787384641.345679:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787384641.345686:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:57899b24-a33b-4177-9883-79b5fe35053f+3:17166:x1874208203392000:12345-0@lo:104: 00010000:00010000:0.0:1787384641.345693:0:17134:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f8d965ba00/0x7ef423838fba39b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba39b9 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384641.345726:0:17134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787384641.345731:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:57899b24-a33b-4177-9883-79b5fe35053f+3:17166:x1874208203392000:12345-0@lo:104: Request processed in 47us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384641.345737:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787384641.345753:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787384641.345758:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f902158200/0x7ef423838fba3a76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba3a7d expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384641.345765:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f902158200 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:0.0:1787384641.345770:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f902158200/0x7ef423838fba3a76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba3a7d expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384641.345806:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f902158200/0x7ef423838fba3a76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba3a7d expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384641.345815:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:0.0:1787384641.345815:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f902158200/0x7ef423838fba3a76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba3a7d expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384641.345825:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787384641.345857:0:17139:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f902158200/0x7ef423838fba3a76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba3a7d expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384641.345865:0:17139:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787384641.345895:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f902158200/0x7ef423838fba3a76 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba3a7d expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384641.345902:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f902158200/0x7ef423838fba3a76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba3a7d expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384641.345915:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384641.345917:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384641.345918:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384641.345932:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57899b24-a33b-4177-9883-79b5fe35053f:3652:1874208203392128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384641.345963:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384641.346017:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203392128 00000100:00100000:2.0:1787384641.346022:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203392128 00010000:00010000:2.0:1787384641.346046:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f902158c00/0x7ef423838fba3a7d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba3a76 expref: 19 pid: 17144 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384641.346065:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+19:17882:x1874208203391744:12345-0@lo:253:mount.lustre.0 Request processed in 6120us (6321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384641.346073:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787384641.346077:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787384641.346096:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57899b24-a33b-4177-9883-79b5fe35053f+18:3652:x1874208203392128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787384641.346108:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384641.346124:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f902158c00/0x7ef423838fba3a7d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba3a76 expref: 18 pid: 17144 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384641.346128:0:17882:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:17882:1874208203391744:0@lo:253:mount.lustre.0 00010000:00010000:2.0:1787384641.346140:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f902158c00/0x7ef423838fba3a7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba3a76 expref: 18 pid: 17144 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384641.346143:0:17882:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1787384641.346147:0:17882:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787384641.346150:0:17882:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787384641.346153:0:17882:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787384641.346155:0:17882:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787384641.346158:0:17882:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787384641.346161:0:17882:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787384641.346163:0:17882:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787384641.346164:0:17882:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787384641.346166:0:17882:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:2.0:1787384641.346171:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:02000000:0.0:1787384641.346180:0:17882:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1787384641.346206:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57899b24-a33b-4177-9883-79b5fe35053f+18:3652:x1874208203392128:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384641.346213:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787384641.346243:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57899b24-a33b-4177-9883-79b5fe35053f:3652:1874208203392128:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787384641.346899:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f902158c00/0x7ef423838fba3a7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba3a76 expref: 17 pid: 17144 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384641.346924:0:17166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91db100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1874208203391872:0@lo:104: 00000100:00100000:3.0:1787384641.346938:0:17166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91dad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1874208203392000:0@lo:104: 00010000:00010000:3.0:1787384641.346954:0:17166:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98f902159400/0x7ef423838fba3ab5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384641.347142:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384641.347145:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384641.347147:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384641.347205:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8d965ba00/0x7ef423838fba39b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba39b9 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384641.347213:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965ba00 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384641.347216:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8d965ba00/0x7ef423838fba39b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba39b9 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384641.347225:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8d965ba00/0x7ef423838fba39b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba39b9 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384641.347231:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8d965ba00/0x7ef423838fba39b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba39b9 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384641.347236:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787384641.347279:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8d965ba00/0x7ef423838fba39b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba39b9 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384641.347285:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787384641.347302:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8d965ba00/0x7ef423838fba39b2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba39b9 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384641.347309:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8d965ba00/0x7ef423838fba39b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba39b9 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384641.347331:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384641.347333:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384641.347334:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384641.347346:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57899b24-a33b-4177-9883-79b5fe35053f:3653:1874208203392256:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787384641.347386:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384641.347454:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203392256 00000100:00100000:3.0:1787384641.347459:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203392256 00010000:00010000:3.0:1787384641.347477:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f902158600/0x7ef423838fba39b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba39b2 expref: 17 pid: 17142 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384641.347507:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787384641.347515:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57899b24-a33b-4177-9883-79b5fe35053f+17:3653:x1874208203392256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787384641.347524:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384641.347529:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f902158600/0x7ef423838fba39b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba39b2 expref: 17 pid: 17142 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384641.347539:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f902158600/0x7ef423838fba39b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba39b2 expref: 17 pid: 17142 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384641.347550:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f902158600/0x7ef423838fba39b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba39b2 expref: 17 pid: 17142 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384641.347562:0:17137:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98f902159400/0x7ef423838fba3ab5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384641.347578:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f902159400/0x7ef423838fba3ab5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787384641.347591:0:17137:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002728446s 00010000:00010000:3.0:1787384641.347596:0:17137:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f902159400/0x7ef423838fba3ab5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384641.347603:0:17137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f902159400/0x7ef423838fba3ab5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384641.347609:0:17137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98f902159400/0x7ef423838fba3ab5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384641.347616:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98f902159400/0x7ef423838fba3ab5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384641.347621:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f902159400 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:3.0:1787384641.347624:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98f902159400/0x7ef423838fba3ab5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384641.347631:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98f902159400/0x7ef423838fba3ab5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384641.347643:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98f902159400/0x7ef423838fba3ab5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384641.347652:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384641.347684:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57899b24-a33b-4177-9883-79b5fe35053f+16:3653:x1874208203392256:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384641.347691:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1787384641.347716:0:17166:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98f902159400/0x7ef423838fba3ab5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384641.347723:0:17166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98f902159400/0x7ef423838fba3ab5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384641.347728:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f902159400/0x7ef423838fba3ab5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384641.347766:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57899b24-a33b-4177-9883-79b5fe35053f:3653:1874208203392256:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1787384641.375130:0:17907:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000040:01000000:0.0:1787384641.375132:0:17882:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1787384641.375138:0:17907:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1787384641.375953:0:17908:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787384641.377225:0:17882:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1787384641.379235:0:17909:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91dad80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17909:1874208203392384:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787384641.379335:0:17909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384641.379362:0:17909:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f87493c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384641.379481:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203392384 00000100:00100000:2.0:1787384641.379489:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203392384 00000100:00100000:2.0:1787384641.379542:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787384641.379551:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17909:x1874208203392384:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787384641.379630:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17909:x1874208203392384:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 80us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384641.379638:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000040:01000000:2.0:1787384641.379811:0:17882:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1787384641.379851:0:17882:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787384641.380626:0:17882:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787384641.380638:0:17882:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1787384641.381078:0:17882:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787384641.381515:0:17909:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91dad80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17909:1874208203392384:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1787384641.381556:0:17909:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1787384641.381600:0:17909:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91dad80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17909:1874208203392512:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787384641.381660:0:17909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384641.381705:0:17909:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f87493c0 going to sleep for 11 seconds 00000040:00080000:0.0:1787384641.381711:0:17908:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787384641.383607:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203392512 00000100:00100000:2.0:1787384641.383620:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203392512 00000100:00100000:2.0:1787384641.383667:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787384641.383676:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17909:x1874208203392512:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787384641.383895:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17909:x1874208203392512:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 218us (2234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384641.383903:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000040:00080000:2.0:1787384641.384529:0:17882:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787384641.385069:0:17882:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787384641.385100:0:17882:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1787384641.385224:0:17882:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787384641.385712:0:17909:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91dad80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17909:1874208203392512:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787384641.385876:0:17909:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91dad80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17909:1874208203392640:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1787384641.385940:0:17909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384641.385978:0:17909:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f8749f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787384641.386095:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203392640 00000100:00100000:1.0:1787384641.386101:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203392640 00000100:00100000:1.0:1787384641.386137:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787384641.386145:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17909:x1874208203392640:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1787384641.386202:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17909:x1874208203392640:12345-0@lo:900:lod0001_rec0000.0 Request processed in 58us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384641.386220:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787384641.386579:0:17909:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98f8f91dad80 x1874208203392640/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787384657 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384641.386591:0:17909:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91dad80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17909:1874208203392640:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1787384641.386648:0:17909:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91dad80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17909:1874208203392768:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787384641.386690:0:17909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384641.386714:0:17909:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f87493c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384641.386904:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203392768 00000100:00100000:3.0:1787384641.386909:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203392768 00000100:00100000:3.0:1787384641.386949:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787384641.386955:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17909:x1874208203392768:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787384641.387015:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17909:x1874208203392768:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 60us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384641.387021:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787384641.387048:0:17909:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91dad80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17909:1874208203392768:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1787384641.387089:0:17909:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787384641.390657:0:17882:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000040:00080000:3.0:1787384641.391578:0:17909:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000040:00080000:0.0:1787384641.391609:0:17908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787384641.391650:0:17909:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787384641.391672:0:17908:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787384641.391677:0:17908:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:2.0:1787384641.396496:0:17882:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1787384641.401048:0:17882:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000100:00100000:1.0:1787384641.401068:0:17192:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2956cc0 going to sleep for 0 seconds 00000004:00000080:2.0:1787384641.401092:0:17882:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffac6941853988 00100000:10000000:2.0:1787384641.401102:0:17882:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1787384641.403174:0:17882:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787384641.403207:0:17882:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.145@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787384641.403235:0:17882:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787384641.403277:0:17882:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1787384641.404095:0:17882:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787384641.404383:0:17882:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787384641.911892:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787384642.359402:0:17904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787384642.423945:0:17192:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2956cc0 going to sleep for 0 seconds 00010000:00010000:3.0:1787384642.935661:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787384643.126893:0:17146:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787384643.126902:0:17146:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98f8f7d8f800 from 8 10000000:01000000:3.0:1787384643.126907:0:17146:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787384643.126955:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902159400/0x7ef423838fba3abc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384643.126968:0:17146:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f902159400/0x7ef423838fba3abc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384643.126978:0:17146:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f902159400/0x7ef423838fba3abc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384643.127022:0:17146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203392896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787384643.127091:0:17146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384643.127155:0:17146:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8c419c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384643.127319:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203392896 00000100:00100000:1.0:1787384643.127326:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203392896 00000100:00100000:1.0:1787384643.127641:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787384643.127653:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+16:17146:x1874208203392896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787384643.127667:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384643.127682:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c3952200/0x7ef423838fba3ac3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba3abc expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384643.127706:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c3952200/0x7ef423838fba3ac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba3abc expref: 17 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384643.127716:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c3952200/0x7ef423838fba3ac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba3abc expref: 17 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384643.127726:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3952200, rc 0) 00000100:00100000:1.0:1787384643.127815:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+17:17146:x1874208203392896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384643.127822:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787384643.127926:0:17146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203392896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384643.127941:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f902159400/0x7ef423838fba3abc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3ac3 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384643.127951:0:17146:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f902159400/0x7ef423838fba3abc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba3ac3 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384643.128008:0:17146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203393024:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787384643.128042:0:17146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384643.130259:0:17146:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8c419c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384643.139790:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203393024 00000100:00100000:2.0:1787384643.139814:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203393024 00000100:00100000:2.0:1787384643.139867:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787384643.139876:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+17:17146:x1874208203393024:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787384643.139900:0:17143:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787384643.139931:0:17143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787384643.139935:0:17143:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1787384643.140061:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+17:17146:x1874208203393024:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 185us (12016us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384643.140069:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787384643.140868:0:17146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203393024:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787384643.141020:0:17146:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787384643.141030:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902159400/0x7ef423838fba3abc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3ac3 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384643.141040:0:17146:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f902159400/0x7ef423838fba3abc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3ac3 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384643.141050:0:17146:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787384643.141053:0:17146:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98f8f7d47800 from 8 10000000:01000000:2.0:1787384643.141056:0:17146:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787384643.141085:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8d965be00/0x7ef423838fba3aca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384643.141104:0:17146:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8d965be00/0x7ef423838fba3aca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384643.141114:0:17146:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8d965be00/0x7ef423838fba3aca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384643.141135:0:17146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9148a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203393152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787384643.141177:0:17146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384643.141209:0:17146:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8c419c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384643.141222:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203393152 00000100:00100000:2.0:1787384643.141227:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203393152 00000100:00100000:2.0:1787384643.141261:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787384643.141268:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd593c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+17:17146:x1874208203393152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787384643.141277:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384643.141288:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8d965ba00/0x7ef423838fba3ad1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba3aca expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384643.141308:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8d965ba00/0x7ef423838fba3ad1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba3aca expref: 18 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384643.141317:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8d965ba00/0x7ef423838fba3ad1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba3aca expref: 18 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384643.141325:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965ba00, rc 0) 00000100:00100000:2.0:1787384643.141353:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd593c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+18:17146:x1874208203393152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384643.141360:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787384643.141398:0:17146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9148a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203393152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787384643.141409:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8d965be00/0x7ef423838fba3aca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3ad1 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384643.141417:0:17146:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8d965be00/0x7ef423838fba3aca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba3ad1 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384643.141456:0:17146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9148a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203393280:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787384643.141483:0:17146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384643.141495:0:17146:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8c419c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384643.141506:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203393280 00000100:00100000:2.0:1787384643.141509:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203393280 00000100:00100000:2.0:1787384643.141525:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787384643.141531:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+18:17146:x1874208203393280:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787384643.141541:0:17143:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787384643.142044:0:17143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787384643.142048:0:17143:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1787384643.142127:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+18:17146:x1874208203393280:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 594us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384643.142134:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787384643.144136:0:17146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9148a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203393280:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787384643.144207:0:17146:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787384643.144217:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8d965be00/0x7ef423838fba3aca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3ad1 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384643.144227:0:17146:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8d965be00/0x7ef423838fba3aca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3ad1 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787384643.384559:0:17904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787384643.450062:0:17192:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2956cc0 going to sleep for 0 seconds 00010000:00010000:0.0:1787384643.960205:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384644.470905:0:17192:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2956cc0 going to sleep for 0 seconds 00010000:00010000:0.0:1787384644.983194:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384645.495885:0:17192:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2956cc0 going to sleep for 0 seconds 00010000:00010000:3.0:1787384646.007361:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787384646.048647:0:18152:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg345-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1787384646.519857:0:17192:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2956cc0 going to sleep for 0 seconds 00000100:00100000:3.0:1787384646.584394:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384646.584416:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203393408:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787384646.584502:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384646.584569:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203393408 00000100:00100000:3.0:1787384646.584576:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203393408 00000100:00100000:3.0:1787384646.584625:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787384646.584634:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203393408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787384646.584668:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787384646.584716:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203393408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384646.584724:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787384646.584813:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203393408:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787384646.587095:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57899b24-a33b-4177-9883-79b5fe35053f:3651:1874208203393536:0@lo:400:kworker.0 00000100:00100000:2.0:1787384646.587311:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787384646.587423:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787384646.587428:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787384646.587432:0:36:0:(import.c:65:import_set_state_nolock()) ffff98f8f9131000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787384646.587441:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff98f8f9131000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:0.0:1787384646.587469:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f7c3a83b80 x1874208203393664/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787384646.587485:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787384646.587488:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787384646.587491:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787384646.587494:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787384646.587542:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203393536 00000100:00100000:1.0:1787384646.587550:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203393536 00000100:00100000:1.0:1787384646.587599:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787384646.587620:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd592050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+18:3651:x1874208203393536:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787384646.587722:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787384646.587726:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787384646.587728:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787384646.587731:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787384646.587770:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874208203393920:0@lo:400:kworker.0 00000100:00100000:0.0:1787384646.587838:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384646.588280:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd592050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+18:3651:x1874208203393536:12345-0@lo:400:kworker.0 Request processed in 660us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384646.588283:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203393664:0@lo:38:kworker.0 00000100:00100000:1.0:1787384646.588292:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787384646.588327:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384646.589461:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874208203393792:0@lo:400:kworker.0 00000100:00100000:3.0:1787384646.589508:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384646.589546:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203393920 00000100:00100000:3.0:1787384646.589554:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203393920 00000100:00100000:3.0:1787384646.589591:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203393792 00000100:00100000:3.0:1787384646.589594:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203393792 00000100:00100000:3.0:1787384646.589608:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787384646.589615:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874208203393920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384646.589667:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874208203393920:12345-0@lo:400:kworker.0 Request processed in 51us (1828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384646.589673:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787384646.589688:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787384646.589695:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874208203393792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384646.589727:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874208203393792:12345-0@lo:400:kworker.0 Request processed in 32us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384646.589733:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787384646.589775:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f7c3a82300 x1874208203393920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384646.589830:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874208203393920:0@lo:400:kworker.0 00010000:00080000:3.0:1787384646.589864:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f7c3a80380 x1874208203393792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384646.589874:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874208203393792:0@lo:400:kworker.0 00000100:00100000:1.0:1787384646.590411:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203393664 00000100:00100000:1.0:1787384646.590418:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203393664 00000100:00100000:1.0:1787384646.590595:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787384646.590603:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1874208203393664:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787384646.590631:0:17155:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 541 last 0 00000020:00000080:1.0:1787384646.590668:0:17155:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7ef423838fba3ad8 00000004:00100000:1.0:1787384646.590685:0:17155:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1787384646.590691:0:17155:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1787384646.592895:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57899b24-a33b-4177-9883-79b5fe35053f:3651:1874208203393536:0@lo:400:kworker.0 00000100:00080000:1.0:1787384646.601056:0:17155:0:(import.c:65:import_set_state_nolock()) ffff98f8f569f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787384646.601182:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1874208203393664:12345-0@lo:38:kworker.0 Request processed in 10575us (12854us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384646.601193:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1787384646.601266:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787384646.601276:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1787384646.601282:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787384646.601284:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f9131000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1787384646.601336:0:3650:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000070f0aeba): req@ffff98f8f91db800 x1874208203386240/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384646.601354:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203393664:0@lo:38:kworker.0 00000100:00100000:1.0:1787384646.601420:0:17192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384646.601443:0:17192:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2956cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384646.601458:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203386240 00000100:00100000:1.0:1787384646.601473:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203386240 00000100:00100000:1.0:1787384646.601510:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787384646.601518:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17192:x1874208203386240:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787384646.601588:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17192:x1874208203386240:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 70us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384646.601595:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787384646.601619:0:17192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91db800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17192:1874208203386240:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1787384646.601654:0:17192:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787384646.601696:0:17192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ea00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17192:1874208203394048:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787384646.601725:0:17192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384646.601751:0:17192:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7240180 going to sleep for 11 seconds 00000100:00100000:1.0:1787384646.601763:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203394048 00000100:00100000:1.0:1787384646.601766:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203394048 00000100:00100000:1.0:1787384646.601800:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787384646.601807:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17192:x1874208203394048:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787384646.601901:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17192:x1874208203394048:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 94us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384646.601908:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787384646.601933:0:17192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ea00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17192:1874208203394048:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787384646.602001:0:17192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ea00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17192:1874208203394176:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787384646.602026:0:17192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384646.602041:0:17192:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7240180 going to sleep for 11 seconds 00000100:00100000:1.0:1787384646.602057:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203394176 00000100:00100000:1.0:1787384646.602061:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203394176 00000100:00100000:1.0:1787384646.602079:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787384646.602086:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17192:x1874208203394176:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787384646.602156:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17192:x1874208203394176:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 70us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384646.602163:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787384646.602260:0:17192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ea00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17192:1874208203394176:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1787384646.602300:0:17192:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787384646.603462:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203394304:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787384646.603514:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384646.603560:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203394304 00000100:00100000:1.0:1787384646.603567:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203394304 00000100:00100000:1.0:1787384646.603600:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787384646.603608:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3654:x1874208203394304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787384646.603636:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787384646.603678:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3654:x1874208203394304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384646.603685:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787384646.603723:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203394304:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1787384646.607243:0:17192:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787384646.607316:0:17192:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:2.0:1787384646.607321:0:17192:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:0.0:1787384646.950100:0:18204:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787384646.950400:0:18204:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787384647.032340:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787384647.924474:0:18254:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787384647.924721:0:18254:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787384648.065522:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787384648.504633:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:0.0:1787384648.902614:0:18303:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007fff302c23b0 00000020:00000080:0.0:1787384648.902630:0:18303:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:0.0:1787384648.902635:0:18303:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:0.0:1787384648.902642:0:18303:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff302c4640 20000000:00000080:0.0:1787384648.902649:0:18303:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98f8c74ecc00 uarg=0000000000000000 20000000:01000000:0.0:1787384648.902690:0:18303:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787384648.902697:0:18303:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787384648.902702:0:18303:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787384648.903314:0:18304:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1787384648.903457:0:18303:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787384648.911512:0:18303:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787384648.911633:0:18303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98f7c3952600/0x7ef423838fba3adf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384648.911654:0:18303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f902159a00/0x7ef423838fba3988 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba3981 expref: 17 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384648.911662:0:18303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f8d965a000/0x7ef423838fba3a8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba3a84 expref: 17 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384648.911669:0:18303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98f7c3952600/0x7ef423838fba3adf lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384648.911714:0:18303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f8d965a000/0x7ef423838fba3a8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba3a84 expref: 17 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384648.911747:0:18303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f8d965a000/0x7ef423838fba3a8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba3a84 expref: 17 pid: 17143 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384648.911763:0:18303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18303:1874208203394432:0@lo:104: 00000100:00100000:1.0:1787384648.912336:0:18303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787384648.912389:0:18303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f902159a00/0x7ef423838fba3988 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba3981 expref: 17 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384648.912399:0:18303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f902159a00/0x7ef423838fba3988 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba3981 expref: 17 pid: 17143 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384648.912409:0:18303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18303:1874208203394560:0@lo:104: 00000100:00100000:1.0:1787384648.912431:0:18303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384648.912449:0:18303:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d10773c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384648.912839:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203394432 00000100:00100000:3.0:1787384648.912846:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203394432 00000100:00100000:3.0:1787384648.912881:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203394560 00000100:00100000:3.0:1787384648.912884:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203394560 00000100:00100000:3.0:1787384648.912898:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787384648.912906:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57899b24-a33b-4177-9883-79b5fe35053f+4:18303:x1874208203394432:12345-0@lo:104: 00010000:00010000:3.0:1787384648.912927:0:17133:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f7c3952a00/0x7ef423838fba3a84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba3a8b expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384648.912981:0:17133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787384648.912987:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57899b24-a33b-4177-9883-79b5fe35053f+4:18303:x1874208203394432:12345-0@lo:104: Request processed in 82us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384648.912995:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787384648.913012:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787384648.913018:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57899b24-a33b-4177-9883-79b5fe35053f+3:18303:x1874208203394560:12345-0@lo:104: 00010000:00010000:3.0:1787384648.913037:0:17133:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f8d965b000/0x7ef423838fba3981 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba3988 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384648.913228:0:17133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787384648.913233:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57899b24-a33b-4177-9883-79b5fe35053f+3:18303:x1874208203394560:12345-0@lo:104: Request processed in 215us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384648.913239:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787384648.913254:0:17902:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787384648.913259:0:17902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f7c3952a00/0x7ef423838fba3a84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba3a8b expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384648.913277:0:17902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3952a00 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:3.0:1787384648.913281:0:17902:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f7c3952a00/0x7ef423838fba3a84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba3a8b expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384648.913289:0:17902:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f7c3952a00/0x7ef423838fba3a84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba3a8b expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787384648.913296:0:17902:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f7c3952a00/0x7ef423838fba3a84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba3a8b expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384648.913302:0:17902:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787384648.913342:0:17902:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f7c3952a00/0x7ef423838fba3a84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba3a8b expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384648.913347:0:17902:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787384648.913364:0:17902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f7c3952a00/0x7ef423838fba3a84 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba3a8b expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384648.913371:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f7c3952a00/0x7ef423838fba3a84 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba3a8b expref: -99 pid: 17882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384648.913384:0:17902:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384648.913387:0:17902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8d965b000/0x7ef423838fba3981 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba3988 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384648.913393:0:17902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965b000 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:3.0:1787384648.913396:0:17902:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8d965b000/0x7ef423838fba3981 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba3988 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384648.913412:0:17902:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8d965b000/0x7ef423838fba3981 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba3988 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787384648.913418:0:17902:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8d965b000/0x7ef423838fba3981 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba3988 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384648.913423:0:17902:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787384648.913435:0:17902:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8d965b000/0x7ef423838fba3981 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba3988 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384648.913441:0:17902:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787384648.913447:0:17902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8d965b000/0x7ef423838fba3981 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba3988 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384648.913453:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8d965b000/0x7ef423838fba3981 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba3988 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384648.913466:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384648.913467:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384648.913469:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384648.913488:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57899b24-a33b-4177-9883-79b5fe35053f:3652:1874208203394816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787384648.913519:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384648.913540:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787384648.913546:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57899b24-a33b-4177-9883-79b5fe35053f:3652:1874208203394688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787384648.913565:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384648.913587:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203394816 00000100:00100000:3.0:1787384648.913591:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203394816 00010000:00010000:3.0:1787384648.913607:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f902159a00/0x7ef423838fba3988 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba3981 expref: 18 pid: 17143 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384648.913635:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203394688 00000100:00100000:3.0:1787384648.913639:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203394688 00010000:00010000:3.0:1787384648.913650:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f8d965a000/0x7ef423838fba3a8b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba3a84 expref: 19 pid: 17143 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384648.913661:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787384648.913667:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57899b24-a33b-4177-9883-79b5fe35053f+19:3652:x1874208203394816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787384648.913677:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384648.913682:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f902159a00/0x7ef423838fba3988 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba3981 expref: 19 pid: 17143 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384648.913690:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f902159a00/0x7ef423838fba3988 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba3981 expref: 19 pid: 17143 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384648.913705:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384648.913732:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57899b24-a33b-4177-9883-79b5fe35053f+19:3652:x1874208203394816:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384648.913737:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787384648.913749:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787384648.913755:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57899b24-a33b-4177-9883-79b5fe35053f+18:3652:x1874208203394688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787384648.913762:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384648.913766:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f8d965a000/0x7ef423838fba3a8b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba3a84 expref: 18 pid: 17143 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384648.913775:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f8d965a000/0x7ef423838fba3a8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba3a84 expref: 18 pid: 17143 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384648.913809:0:17137:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98f7c3952600/0x7ef423838fba3adf lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384648.913823:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c3952600/0x7ef423838fba3adf lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384648.913838:0:17137:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f7c3952600/0x7ef423838fba3adf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384648.913845:0:17137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f7c3952600/0x7ef423838fba3adf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384648.913851:0:17137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98f7c3952600/0x7ef423838fba3adf lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384648.913857:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98f7c3952600/0x7ef423838fba3adf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384648.913862:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3952600 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:3.0:1787384648.913866:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98f7c3952600/0x7ef423838fba3adf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384648.913872:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98f7c3952600/0x7ef423838fba3adf lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384648.913880:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98f7c3952600/0x7ef423838fba3adf lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384648.913889:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384648.913922:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57899b24-a33b-4177-9883-79b5fe35053f+18:3652:x1874208203394688:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384648.913929:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787384648.913958:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57899b24-a33b-4177-9883-79b5fe35053f:3652:1874208203394688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787384648.913972:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57899b24-a33b-4177-9883-79b5fe35053f:3652:1874208203394816:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787384648.914259:0:18303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8d965a000/0x7ef423838fba3a8b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba3a84 expref: 17 pid: 17143 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384648.914269:0:18303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18303:1874208203394432:0@lo:104: 00010000:00010000:1.0:1787384648.914277:0:18303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f902159a00/0x7ef423838fba3988 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba3981 expref: 16 pid: 17143 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384648.914285:0:18303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18303:1874208203394560:0@lo:104: 00010000:00010000:1.0:1787384648.914298:0:18303:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98f7c3952600/0x7ef423838fba3adf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384648.914307:0:18303:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98f7c3952600/0x7ef423838fba3adf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384648.914333:0:18303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98f7c3952600/0x7ef423838fba3adf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384648.914339:0:18303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c3952600/0x7ef423838fba3adf lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384648.919821:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384649.079010:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787384649.985321:0:17146:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787384649.985329:0:17146:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98f8f7d8f800 from 13 10000000:01000000:3.0:1787384649.985334:0:17146:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787384649.985384:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba3ae6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384649.985397:0:17146:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba3ae6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384649.985408:0:17146:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba3ae6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384649.985434:0:17146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203394944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787384649.985507:0:17146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384649.985543:0:17146:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7fdf600 going to sleep for 11 seconds 00000100:00100000:3.0:1787384649.985707:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203394944 00000100:00100000:3.0:1787384649.985714:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203394944 00000100:00100000:3.0:1787384649.985762:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787384649.985770:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+16:17146:x1874208203394944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384649.985809:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384649.985823:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f902158c00/0x7ef423838fba3aed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba3ae6 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384649.985847:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f902158c00/0x7ef423838fba3aed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba3ae6 expref: 17 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384649.985857:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f902158c00/0x7ef423838fba3aed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba3ae6 expref: 17 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384649.985884:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f902158c00, rc 0) 00000100:00100000:3.0:1787384649.985927:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+17:17146:x1874208203394944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384649.985934:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787384649.986553:0:17146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203394944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384649.986569:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba3ae6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3aed expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384649.986579:0:17146:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba3ae6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba3aed expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384649.986641:0:17146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203395072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384649.986674:0:17146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384649.986693:0:17146:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7fdf600 going to sleep for 11 seconds 00000100:00100000:3.0:1787384649.986921:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203395072 00000100:00100000:3.0:1787384649.986926:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203395072 00000100:00100000:3.0:1787384649.986957:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787384649.986964:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+17:17146:x1874208203395072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384649.987161:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+17:17146:x1874208203395072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 196us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384649.987168:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787384649.987217:0:17146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203395072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384649.987246:0:17146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203395200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384649.987290:0:17146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384649.987312:0:17146:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7fdf600 going to sleep for 11 seconds 00000100:00100000:3.0:1787384649.987324:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203395200 00000100:00100000:3.0:1787384649.987328:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203395200 00000100:00100000:3.0:1787384649.987351:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787384649.987358:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+17:17146:x1874208203395200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384649.987433:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+17:17146:x1874208203395200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384649.987439:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787384649.987477:0:17146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203395200:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787384649.988102:0:18348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787384649.988164:0:17146:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787384649.988186:0:17146:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787384649.997657:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba3ae6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3aed expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384649.997733:0:17146:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba3ae6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3aed expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384649.997745:0:17146:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787384649.997748:0:17146:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98f8f7d47800 from 13 10000000:01000000:3.0:1787384649.997751:0:17146:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787384649.997804:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902159e00/0x7ef423838fba3af4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384649.997813:0:17146:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f902159e00/0x7ef423838fba3af4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384649.997825:0:17146:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f902159e00/0x7ef423838fba3af4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384649.997863:0:17146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203395328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787384649.997925:0:17146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384649.997974:0:17146:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7fdf9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384649.998307:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203395328 00000100:00100000:0.0:1787384649.998316:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203395328 00000100:00100000:0.0:1787384649.998376:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787384649.998385:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4038850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+17:17146:x1874208203395328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787384649.998398:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384649.998412:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8c6140600/0x7ef423838fba3afb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba3af4 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384649.998445:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8c6140600/0x7ef423838fba3afb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba3af4 expref: 18 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384649.998456:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8c6140600/0x7ef423838fba3afb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba3af4 expref: 18 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384649.998465:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6140600, rc 0) 00000100:00100000:0.0:1787384649.998508:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4038850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+18:17146:x1874208203395328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384649.998516:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787384649.998560:0:17146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203395328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787384649.998573:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f902159e00/0x7ef423838fba3af4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3afb expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384649.998581:0:17146:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f902159e00/0x7ef423838fba3af4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba3afb expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384649.998648:0:17146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203395456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384649.998673:0:17146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384649.998687:0:17146:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2aacc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787384649.998699:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203395456 00000100:00100000:0.0:1787384649.998703:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203395456 00000100:00100000:0.0:1787384649.998725:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787384649.998731:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c403b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+18:17146:x1874208203395456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384649.998853:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c403b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+18:17146:x1874208203395456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384649.998868:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787384649.998901:0:17146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203395456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384649.998927:0:17146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203395584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787384649.998962:0:17146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384649.998974:0:17146:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2aacc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787384649.998985:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203395584 00000100:00100000:0.0:1787384649.998988:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203395584 00000100:00100000:0.0:1787384649.999009:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787384649.999015:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4039050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+18:17146:x1874208203395584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787384649.999098:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4039050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+18:17146:x1874208203395584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384649.999107:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787384649.999216:0:17146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203395584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787384650.000431:0:18350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787384650.000597:0:17146:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787384650.000620:0:17146:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787384650.000630:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902159e00/0x7ef423838fba3af4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3afb expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384650.000641:0:17146:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f902159e00/0x7ef423838fba3af4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3afb expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384650.102904:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384650.680525:0:3650:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787384635/real 1787384635] req@ffff98f7c3a81c00 x1874208203387264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384650 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384650.680558:0:3650:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98f7c3a81c00 x1874208203387264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384650 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384650.680567:0:3650:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787384635/real 1787384635] req@ffff98f7c3a83100 x1874208203387392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384650 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384650.680578:0:3650:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98f7c3a83100 x1874208203387392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384650 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787384650.680597:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8d8503000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787384650.680619:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787384650.680623:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203387264:0@lo:8:kworker.0 00000100:00080000:1.0:1787384650.680628:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f9135000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787384650.680634:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787384650.680637:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203387392:0@lo:8:kworker.0 00000100:00080000:3.0:1787384650.680760:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787384650.680765:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787384650.680768:0:36:0:(import.c:65:import_set_state_nolock()) ffff98f8d8503000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787384650.680773:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 530 00000100:00080000:3.0:1787384650.680798:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787384650.680806:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98f8d8503000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:3.0:1787384650.680824:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f91d9180 x1874208203395840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787384650.680839:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787384650.680842:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787384650.680844:0:36:0:(import.c:65:import_set_state_nolock()) ffff98f8f9135000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787384650.680847:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 530 00000100:00080000:3.0:1787384650.680850:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787384650.680854:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98f8f9135000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:3.0:1787384650.680864:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f91d8a80 x1874208203395968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787384650.680897:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787384650.680901:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787384650.680916:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787384650.680919:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787384650.680951:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203396224:0@lo:400:kworker.0 00000100:00100000:3.0:1787384650.681015:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384650.681043:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787384650.681049:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203396352:0@lo:400:kworker.0 00000100:00100000:3.0:1787384650.681074:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384650.681125:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203396352 00000100:00100000:3.0:1787384650.681133:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203396352 00000100:00100000:3.0:1787384650.681181:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787384650.681200:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203396352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384650.681246:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203396352:12345-0@lo:400:kworker.0 Request processed in 47us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384650.681253:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787384650.681290:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f8f7e69c00 x1874208203396352/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384650.681301:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203396352:0@lo:400:kworker.0 00000100:00100000:3.0:1787384650.681332:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203395840:0@lo:8:kworker.0 00000400:00000100:3.0:1787384650.681351:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874208203395840 offset 0 length 520: 4 00000100:00100000:3.0:1787384650.681373:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203395968:0@lo:8:kworker.0 00000400:00000100:3.0:1787384650.681388:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874208203395968 offset 0 length 520: 4 00000100:00100000:0.0:1787384650.681469:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874208203396096:0@lo:400:kworker.0 00000100:00100000:0.0:1787384650.681502:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384650.681526:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787384650.681531:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203395712:0@lo:400:kworker.0 00000100:00100000:0.0:1787384650.681551:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384650.682085:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203396096 00000100:00100000:3.0:1787384650.682091:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203396096 00000100:00100000:3.0:1787384650.682366:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787384650.682385:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874208203396096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384650.682447:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874208203396096:12345-0@lo:400:kworker.0 Request processed in 64us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384650.682455:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787384650.682981:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203396224 00000100:00100000:1.0:1787384650.682987:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203396224 00000100:00100000:1.0:1787384650.683013:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203395712 00000100:00100000:1.0:1787384650.683024:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203395712 00000100:00100000:1.0:1787384650.683044:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787384650.683051:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203396224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384650.683125:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203396224:12345-0@lo:400:kworker.0 Request processed in 67us (2103us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384650.683133:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787384650.683148:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787384650.683162:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3654:x1874208203395712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384650.683203:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3654:x1874208203395712:12345-0@lo:400:kworker.0 Request processed in 49us (1651us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384650.683209:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787384650.683512:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203396224:0@lo:400:kworker.0 00000100:00100000:2.0:1787384650.683926:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203395712:0@lo:400:kworker.0 00010000:00080000:2.0:1787384650.683941:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f8f91d9f80 x1874208203396096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384650.683951:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874208203396096:0@lo:400:kworker.0 00010000:00010000:2.0:1787384651.126990:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384651.704330:0:3650:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787384641/real 1787384641] req@ffff98f7c3a80700 x1874208203389824/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384651 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384651.704359:0:3650:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98f7c3a80700 x1874208203389824/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384651 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384651.704369:0:3650:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787384641/real 1787384641] req@ffff98f7c3a81180 x1874208203389696/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384651 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384651.704381:0:3650:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98f7c3a81180 x1874208203389696/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384651 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787384651.704400:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f919a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787384651.704415:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787384651.704419:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203389824:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787384651.704424:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8d9107000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787384651.704429:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787384651.704432:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203389696:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1787384651.704461:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203396480:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787384651.704524:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384651.704565:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203396480 00000100:00100000:3.0:1787384651.704572:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203396480 00000100:00100000:3.0:1787384651.704613:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787384651.704622:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203396480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787384651.704663:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787384651.704701:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203396480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384651.704708:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787384651.704755:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203396480:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1787384651.704835:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787384651.704839:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787384651.704842:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787384651.704845:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787384651.704853:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787384651.704856:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787384651.704859:0:37:0:(import.c:65:import_set_state_nolock()) ffff98f8d9107000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787384651.704862:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 536 00000100:00080000:3.0:1787384651.704867:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787384651.704871:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff98f8d9107000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:3.0:1787384651.704887:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f7e68e00 x1874208203396992/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787384651.704899:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787384651.704903:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787384651.704904:0:37:0:(import.c:65:import_set_state_nolock()) ffff98f8f919a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787384651.704907:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 536 00000100:00080000:3.0:1787384651.704909:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787384651.704912:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98f8f919a800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:3.0:1787384651.704929:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f7e6aa00 x1874208203397120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787384651.704954:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874208203396864:0@lo:400:kworker.0 00000100:00100000:3.0:1787384651.704980:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384651.704998:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787384651.705004:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203396736:0@lo:400:kworker.0 00000100:00100000:3.0:1787384651.705039:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384651.705062:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203396864 00000100:00100000:3.0:1787384651.705066:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203396864 00000100:00100000:3.0:1787384651.705091:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787384651.705109:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874208203396864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384651.705144:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874208203396864:12345-0@lo:400:kworker.0 Request processed in 46us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384651.705150:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787384651.705167:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57899b24-a33b-4177-9883-79b5fe35053f:3654:1874208203396608:0@lo:400:kworker.0 00000100:00100000:3.0:1787384651.705203:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384651.705226:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787384651.705231:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874208203397248:0@lo:400:kworker.0 00000100:00100000:3.0:1787384651.705251:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384651.705270:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203397248 00000100:00100000:3.0:1787384651.705273:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203397248 00000100:00100000:3.0:1787384651.705294:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787384651.705299:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874208203397248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384651.705330:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874208203397248:12345-0@lo:400:kworker.0 Request processed in 30us (78us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384651.705335:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787384651.705368:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f8f7e68380 x1874208203396864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384651.705377:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874208203396864:0@lo:400:kworker.0 00010000:00080000:3.0:1787384651.705395:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f8f7e6ad80 x1874208203397248/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384651.705403:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874208203397248:0@lo:400:kworker.0 00000100:00100000:3.0:1787384651.705419:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203396992:0@lo:8:kworker.0 00000400:00000100:3.0:1787384651.705437:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874208203396992 offset 0 length 520: 4 00000100:00100000:3.0:1787384651.705448:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203397120:0@lo:8:kworker.0 00000400:00000100:3.0:1787384651.705473:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874208203397120 offset 0 length 520: 4 00000100:00100000:3.0:1787384651.705495:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203396736 00000100:00100000:3.0:1787384651.705498:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203396736 00000100:00100000:3.0:1787384651.705520:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787384651.705526:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3652:x1874208203396736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384651.705558:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3652:x1874208203396736:12345-0@lo:400:kworker.0 Request processed in 33us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384651.705564:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787384651.705588:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203396736:0@lo:400:kworker.0 00000100:00100000:0.0:1787384651.706415:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203396608 00000100:00100000:0.0:1787384651.706420:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203396608 00000100:00100000:0.0:1787384651.706451:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787384651.706459:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4038c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+18:3654:x1874208203396608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384651.706503:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4038c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+18:3654:x1874208203396608:12345-0@lo:400:kworker.0 Request processed in 44us (1298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384651.706510:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787384651.706540:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787384651.706551:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203397376:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787384651.706576:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384651.706601:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203397376 00000100:00100000:0.0:1787384651.706604:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203397376 00000100:00100000:0.0:1787384651.706623:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787384651.706630:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3653:x1874208203397376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787384651.706652:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787384651.706684:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3653:x1874208203397376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384651.706691:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787384651.706843:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57899b24-a33b-4177-9883-79b5fe35053f:3654:1874208203396608:0@lo:400:kworker.0 00000100:00100000:0.0:1787384651.714767:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203397376:0@lo:41:osp-pre-1-0.0 00000001:00100000:1.0:1787384651.723699:0:17883:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1787384652.154955:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384653.174853:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787384653.627652:0:17904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787384654.198990:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384655.223715:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787384655.703661:0:18651:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787384655.703665:0:18651:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787384655.703667:0:18651:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787384655.703770:0:18651:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff98f8d9698000 00000020:01000004:2.0:1787384655.703891:0:18651:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787384655.703904:0:18651:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787384655.703917:0:18651:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff98f8f7d34d40) 00000020:00000080:2.0:1787384655.703934:0:18651:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787384655.756674:0:18651:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787384655.757751:0:18651:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787384655.758541:0:18651:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787384655.758742:0:18651:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787384655.758959:0:18651:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787384655.759398:0:18651:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787384655.759581:0:18651:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:2.0:1787384655.762540:0:18651:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787384655.762734:0:18651:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787384655.762746:0:18651:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787384655.762757:0:18651:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7ef423838fba3b09 00000020:01000004:2.0:1787384655.762763:0:18651:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787384655.762938:0:18651:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.145@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787384655.762942:0:18651:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.145@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787384655.762947:0:18651:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787384655.762953:0:18651:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787384655.762963:0:18651:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff98f8f7d319c0) 00000020:00000080:2.0:1787384655.762975:0:18651:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1787384655.764110:0:18651:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787384655.764271:0:18651:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787384655.764277:0:18651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787384655.773226:0:18651:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787384655.773245:0:18651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787384655.774386:0:18651:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787384655.774396:0:18651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787384655.776241:0:18651:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787384655.776479:0:18651:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787384655.776485:0:18651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787384655.777362:0:18651:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787384655.777371:0:18651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787384655.804981:0:18651:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787384655.806505:0:18651:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787384655.806514:0:18651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787384655.808544:0:18651:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787384655.808557:0:18651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787384655.809758:0:18651:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787384655.809769:0:18651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787384655.813012:0:18651:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787384655.815954:0:18651:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787384655.815964:0:18651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787384655.816998:0:18651:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787384655.817006:0:18651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1787384655.851144:0:18651:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787384655.851397:0:18651:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787384655.851404:0:18651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787384655.854446:0:18651:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787384655.854460:0:18651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787384655.855088:0:18651:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787384655.855116:0:18651:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1787384655.855122:0:18651:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.145@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787384655.866222:0:18651:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.145@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787384655.866340:0:18651:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.145@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1787384655.866345:0:18651:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787384655.866347:0:18651:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787384655.866349:0:18651:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787384655.866349:0:18651:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787384655.866350:0:18651:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787384655.866352:0:18651:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787384655.866353:0:18651:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787384655.866355:0:18651:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787384655.866356:0:18651:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787384655.866360:0:18651:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1787384655.866363:0:18651:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787384655.866364:0:18651:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787384655.866365:0:18651:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787384655.866366:0:18651:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787384655.866367:0:18651:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787384655.866369:0:18651:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787384655.866370:0:18651:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787384655.866371:0:18651:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787384655.866372:0:18651:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787384655.866397:0:18651:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787384655.866417:0:18651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:18651:1874208203397504:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787384655.866485:0:18651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384655.866577:0:18651:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9b413c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384655.866772:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203397504 00000100:00100000:1.0:1787384655.866835:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203397504 00000100:00100000:1.0:1787384655.866914:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787384655.866923:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c434c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+18:18651:x1874208203397504:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787384655.866953:0:17142:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787384655.866956:0:17142:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1787384655.866961:0:17142:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787384655.867248:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c434c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+18:18651:x1874208203397504:12345-0@lo:253:mount.lustre.0 Request processed in 324us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384655.867257:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787384655.867347:0:18651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:18651:1874208203397504:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787384655.867370:0:18651:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787384655.867372:0:18651:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787384655.867374:0:18651:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787384655.867375:0:18651:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787384655.867377:0:18651:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787384655.867378:0:18651:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787384655.867380:0:18651:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787384655.867381:0:18651:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787384655.867382:0:18651:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787384655.867383:0:18651:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787384655.867400:0:18651:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98f8d9698000 from lustre-OST0000 10000000:01000000:2.0:1787384655.867426:0:18651:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787384655.867429:0:18651:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787384655.867436:0:18651:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98f8f1813380 local copy 00010000:00010000:2.0:1787384655.867447:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8c6141a00/0x7ef423838fba38c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba38cb expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384655.867556:0:18651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:18651:1874208203397632:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787384655.868019:0:18651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384655.870131:0:18651:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7240900 going to sleep for 11 seconds 00000100:00100000:0.0:1787384655.870234:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203397632 00000100:00100000:0.0:1787384655.870243:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203397632 00000100:00100000:3.0:1787384655.870323:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787384655.870335:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+18:18651:x1874208203397632:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787384655.870452:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+18:18651:x1874208203397632:12345-0@lo:501:mount.lustre.0 Request processed in 119us (2433us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787384655.870461:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787384655.870620:0:18651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:18651:1874208203397632:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787384655.870639:0:18651:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.145@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787384655.870674:0:18651:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.145@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787384655.870691:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8c6141a00/0x7ef423838fba38c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba38cb expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384655.870701:0:18651:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8c6141a00/0x7ef423838fba38c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba38cb expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384655.870731:0:18651:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98f8d9698000 10000000:01000000:2.0:1787384655.870746:0:18651:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787384655.870752:0:18651:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787384655.870755:0:18651:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787384655.870759:0:18651:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787384655.870762:0:18651:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787384655.870810:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8d965ac00/0x7ef423838fba3b17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384655.870819:0:18651:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8d965ac00/0x7ef423838fba3b17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384655.870829:0:18651:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8d965ac00/0x7ef423838fba3b17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384655.870847:0:18651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:18651:1874208203397760:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787384655.870891:0:18651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384655.870912:0:18651:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7240900 going to sleep for 11 seconds 00000100:00100000:3.0:1787384655.871174:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203397760 00000100:00100000:3.0:1787384655.871179:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203397760 00000100:00100000:3.0:1787384655.871202:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787384655.871208:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+18:18651:x1874208203397760:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787384655.871217:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384655.871228:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f902159a00/0x7ef423838fba3b1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba3b17 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384655.871248:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f902159a00/0x7ef423838fba3b1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba3b17 expref: 19 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384655.871259:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f902159a00/0x7ef423838fba3b1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba3b17 expref: 19 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384655.871268:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f902159a00, rc 0) 00000100:00100000:3.0:1787384655.871315:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+19:18651:x1874208203397760:12345-0@lo:101:mount.lustre.0 Request processed in 106us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384655.871322:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787384655.871558:0:18651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:18651:1874208203397760:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787384655.871570:0:18651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8d965ac00/0x7ef423838fba3b17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3b1e expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384655.871592:0:18651:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8d965ac00/0x7ef423838fba3b17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba3b1e expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787384655.873352:0:18651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787384655.874254:0:18651:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787384655.877330:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787384655.877386:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787384655.877416:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787384655.877432:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787384655.877454:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787384655.877466:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787384655.877489:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787384655.877495:0:18651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787384655.877591:0:18651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:18651:1874208203397888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787384655.877656:0:18651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384655.878193:0:18651:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7240480 going to sleep for 11 seconds 00000100:00100000:3.0:1787384655.878329:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203397888 00000100:00100000:3.0:1787384655.878336:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203397888 00000100:00100000:3.0:1787384655.878378:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787384655.878387:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+19:18651:x1874208203397888:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787384655.878558:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+19:18651:x1874208203397888:12345-0@lo:501:mount.lustre.0 Request processed in 171us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384655.878566:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787384655.878841:0:18651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:18651:1874208203397888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787384655.878880:0:18651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:18651:1874208203398016:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787384655.878919:0:18651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384655.878945:0:18651:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7240480 going to sleep for 11 seconds 00000100:00100000:3.0:1787384655.878991:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203398016 00000100:00100000:3.0:1787384655.878995:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203398016 00000100:00100000:3.0:1787384655.879013:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787384655.879017:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+19:18651:x1874208203398016:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787384655.879759:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+19:18651:x1874208203398016:12345-0@lo:503:mount.lustre.0 Request processed in 737us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384655.879768:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787384655.879956:0:18651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:18651:1874208203398016:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787384655.880425:0:18651:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787384655.880495:0:18651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:18651:1874208203398144:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787384655.880544:0:18651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384655.880570:0:18651:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7240900 going to sleep for 11 seconds 00000100:00100000:3.0:1787384655.880808:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203398144 00000100:00100000:3.0:1787384655.880814:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203398144 00000100:00100000:3.0:1787384655.880851:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787384655.880859:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+19:18651:x1874208203398144:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787384655.881193:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+19:18651:x1874208203398144:12345-0@lo:502:mount.lustre.0 Request processed in 334us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384655.881202:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787384655.881445:0:18651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:18651:1874208203398144:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787384655.881939:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787384655.881969:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787384655.881984:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787384655.881997:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787384655.882010:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787384655.882023:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787384655.882033:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787384655.882044:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787384655.882057:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1787384655.882086:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1787384655.882108:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1787384655.882121:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1787384655.882164:0:18651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:18651:1874208203398272:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787384655.882211:0:18651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384655.882328:0:18651:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7240900 going to sleep for 11 seconds 00000100:00100000:1.0:1787384655.882467:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203398272 00000100:00100000:1.0:1787384655.882474:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203398272 00000100:00100000:1.0:1787384655.882516:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787384655.882525:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+19:18651:x1874208203398272:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787384655.882642:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+19:18651:x1874208203398272:12345-0@lo:502:mount.lustre.0 Request processed in 117us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384655.882656:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787384655.882917:0:18651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:18651:1874208203398272:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787384655.882967:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1787384655.882975:0:18651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1787384655.883601:0:18669:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787384655.883609:0:18669:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1787384655.883617:0:18669:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384655.883619:0:18669:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787384655.883624:0:18669:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787384655.883638:0:18669:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff98f8f593b380) 00000020:00000080:2.0:1787384655.883661:0:18669:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787384655.883667:0:18669:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787384655.883740:0:18669:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f8d9698000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787384655.883747:0:18669:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787384655.883757:0:18669:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7ef423838fba3b2c 00010000:00010000:2.0:1787384655.892961:0:18669:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1787384655.893428:0:18669:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1787384655.895746:0:18669:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1787384655.900678:0:18669:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787384655.901470:0:18669:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384655.901547:0:18669:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384655.901550:0:18669:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787384655.901554:0:18669:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787384655.901558:0:18669:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1787384655.901559:0:18669:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787384655.901561:0:18669:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787384655.901563:0:18669:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787384655.901572:0:18669:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384655.901573:0:18669:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787384655.901576:0:18669:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787384655.901589:0:18669:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384655.901591:0:18669:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787384655.901595:0:18669:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787384655.901597:0:18669:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787384655.901600:0:18669:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384655.901602:0:18669:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384655.901604:0:18669:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787384655.901606:0:18669:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787384655.901608:0:18669:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384655.901610:0:18669:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787384655.901613:0:18669:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787384655.901643:0:18669:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384655.901646:0:18669:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384655.901647:0:18669:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787384655.901650:0:18669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1787384655.908372:0:18651:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1787384655.908416:0:18651:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787384655.908485:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8d965ac00/0x7ef423838fba3b17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3b1e expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384655.908498:0:18651:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8d965ac00/0x7ef423838fba3b17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3b1e expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384655.908507:0:18651:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98f8d9698000 from 1 10000000:01000000:1.0:1787384655.908510:0:18651:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787384655.908547:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3952800/0x7ef423838fba3b33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384655.908555:0:18651:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f7c3952800/0x7ef423838fba3b33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384655.908565:0:18651:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f7c3952800/0x7ef423838fba3b33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384655.908600:0:18651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:18651:1874208203398400:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787384655.908664:0:18651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384655.908717:0:18651:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9462d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787384655.909846:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203398400 00000100:00100000:0.0:1787384655.909856:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203398400 00000100:00100000:0.0:1787384655.910065:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787384655.910075:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+19:18651:x1874208203398400:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787384655.910090:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384655.910106:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8c6141c00/0x7ef423838fba3b3a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba3b33 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384655.910144:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8c6141c00/0x7ef423838fba3b3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba3b33 expref: 20 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384655.910166:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8c6141c00/0x7ef423838fba3b3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba3b33 expref: 20 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384655.910174:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6141c00, rc 0) 00000100:00100000:0.0:1787384655.910239:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+20:18651:x1874208203398400:12345-0@lo:101:mount.lustre.0 Request processed in 166us (1574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384655.910246:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787384655.910772:0:18651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:18651:1874208203398400:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787384655.910905:0:18651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f7c3952800/0x7ef423838fba3b33 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3b3a expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384655.910916:0:18651:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f7c3952800/0x7ef423838fba3b33 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba3b3a expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787384655.914526:0:18651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787384655.915054:0:18651:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787384655.915250:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787384655.915276:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787384655.915295:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787384655.915301:0:18651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787384655.915369:0:18651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:18651:1874208203398528:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787384655.915444:0:18651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384655.915485:0:18651:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3a5e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384655.915503:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203398528 00000100:00100000:3.0:1787384655.915510:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203398528 00000100:00100000:3.0:1787384655.915553:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787384655.915561:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+20:18651:x1874208203398528:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787384655.915755:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+20:18651:x1874208203398528:12345-0@lo:501:mount.lustre.0 Request processed in 194us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384655.915763:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787384655.916392:0:18651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:18651:1874208203398528:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787384655.916429:0:18651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:18651:1874208203398656:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787384655.916477:0:18651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384655.916549:0:18651:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3a5e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384655.916638:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203398656 00000100:00100000:0.0:1787384655.916644:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203398656 00000100:00100000:0.0:1787384655.916773:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787384655.917072:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+20:18651:x1874208203398656:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787384655.917271:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+20:18651:x1874208203398656:12345-0@lo:503:mount.lustre.0 Request processed in 202us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384655.917385:0:18651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:18651:1874208203398656:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787384655.917766:0:18651:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787384655.917939:0:18651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:18651:1874208203398784:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787384655.917984:0:18651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384655.918007:0:18651:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c2fd39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384655.918218:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203398784 00000100:00100000:3.0:1787384655.918223:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203398784 00000100:00100000:3.0:1787384655.918270:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787384655.918287:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+21:18651:x1874208203398784:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787384655.918380:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+21:18651:x1874208203398784:12345-0@lo:502:mount.lustre.0 Request processed in 103us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384655.918388:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787384655.918550:0:18651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:18651:1874208203398784:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787384655.918920:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787384655.918948:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1787384655.918963:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1787384655.918977:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1787384655.918991:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1787384655.919004:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1787384655.919018:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1787384655.919031:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1787384655.919046:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1787384655.919074:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1787384655.919090:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1787384655.919118:0:18651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:18651:1874208203398912:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787384655.919172:0:18651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384655.919194:0:18651:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3a5e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384655.919380:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203398912 00000100:00100000:3.0:1787384655.919386:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203398912 00000100:00100000:3.0:1787384655.919452:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787384655.919459:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+21:18651:x1874208203398912:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787384655.919538:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+21:18651:x1874208203398912:12345-0@lo:502:mount.lustre.0 Request processed in 80us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384655.919546:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787384655.919808:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787384655.919901:0:18651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:18651:1874208203398912:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787384655.919950:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1787384655.919959:0:18651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787384655.921071:0:18673:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787384655.921079:0:18673:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384655.921081:0:18673:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787384655.921086:0:18673:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f8d9698000 00000020:00000080:3.0:1787384655.921087:0:18673:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787384655.921093:0:18673:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787384655.921095:0:18673:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384655.921095:0:18673:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787384655.921097:0:18673:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787384655.921098:0:18673:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384655.921099:0:18673:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787384655.921101:0:18673:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f8d9698000 00000020:00000080:3.0:1787384655.921102:0:18673:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787384655.921161:0:18673:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787384655.921165:0:18673:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384655.921166:0:18673:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787384655.921169:0:18673:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787384655.921171:0:18673:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384655.921178:0:18673:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787384655.921182:0:18673:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f8d9698000 00000020:00000080:3.0:1787384655.921184:0:18673:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787384655.921202:0:18673:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787384655.921205:0:18673:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384655.921206:0:18673:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787384655.921208:0:18673:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787384655.921210:0:18673:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384655.921211:0:18673:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787384655.921214:0:18673:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f8d9698000 00000020:00000080:3.0:1787384655.921216:0:18673:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787384655.921234:0:18673:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787384655.921236:0:18673:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384655.921237:0:18673:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787384655.921239:0:18673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1787384655.922241:0:18651:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1787384655.922268:0:18651:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787384655.922385:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3952800/0x7ef423838fba3b33 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3b3a expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384655.922398:0:18651:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f7c3952800/0x7ef423838fba3b33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3b3a expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384655.922465:0:18651:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787384655.922468:0:18651:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98f8d9698000 10000000:01000000:2.0:1787384655.922472:0:18651:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98f8d9698000 10000000:01000000:2.0:1787384655.922477:0:18651:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787384655.922482:0:18651:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98f8d9698000 from 1 10000000:01000000:2.0:1787384655.922484:0:18651:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787384655.922518:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8d965a000/0x7ef423838fba3b41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384655.922527:0:18651:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8d965a000/0x7ef423838fba3b41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384655.922538:0:18651:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8d965a000/0x7ef423838fba3b41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384655.922561:0:18651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:18651:1874208203399040:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787384655.922634:0:18651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384655.922677:0:18651:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3a5e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384655.922923:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203399040 00000100:00100000:1.0:1787384655.922930:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203399040 00000100:00100000:1.0:1787384655.922980:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787384655.922989:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+20:18651:x1874208203399040:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787384655.923001:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384655.923018:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c3952a00/0x7ef423838fba3b48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba3b41 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384655.923042:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c3952a00/0x7ef423838fba3b48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba3b41 expref: 21 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384655.923053:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c3952a00/0x7ef423838fba3b48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba3b41 expref: 21 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384655.923061:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3952a00, rc 0) 00000100:00100000:1.0:1787384655.923100:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+21:18651:x1874208203399040:12345-0@lo:101:mount.lustre.0 Request processed in 112us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384655.923107:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787384655.923193:0:18651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:18651:1874208203399040:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787384655.923213:0:18651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8d965a000/0x7ef423838fba3b41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3b48 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384655.923222:0:18651:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8d965a000/0x7ef423838fba3b41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba3b48 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787384655.927037:0:18651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1787384655.928447:0:18651:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787384655.928674:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787384655.929259:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787384655.931404:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787384655.931459:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787384655.931476:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787384655.931492:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787384655.931520:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787384655.931536:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787384655.931549:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787384655.931560:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787384655.931574:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787384655.931603:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787384655.931618:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787384655.931630:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787384655.931643:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787384655.931656:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787384655.931668:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787384655.932961:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787384655.933013:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787384655.933027:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787384655.933040:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787384655.933052:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787384655.933083:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787384655.933099:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787384655.933120:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1787384655.933133:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1787384655.933146:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1787384655.933172:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1787384655.933185:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1787384655.933198:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1787384655.933210:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1787384655.933223:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1787384655.933236:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1787384655.933248:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1787384655.933261:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1787384655.934599:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1787384655.934660:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1787384655.935506:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1787384655.935519:0:18651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1787384655.935619:0:18651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:18651:1874208203399168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787384655.936500:0:18651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384655.936542:0:18651:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3a5e300 going to sleep for 11 seconds 00000100:00100000:0.0:1787384655.937649:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203399168 00000100:00100000:0.0:1787384655.937661:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203399168 00000100:00100000:0.0:1787384655.937713:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787384655.937722:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+21:18651:x1874208203399168:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787384655.937906:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+21:18651:x1874208203399168:12345-0@lo:501:mount.lustre.0 Request processed in 184us (2223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384655.937914:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787384655.938383:0:18651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:18651:1874208203399168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787384655.938431:0:18651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:18651:1874208203399296:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787384655.938476:0:18651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384655.938511:0:18651:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3a5e300 going to sleep for 11 seconds 00000100:00100000:0.0:1787384655.939082:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203399296 00000100:00100000:0.0:1787384655.939089:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203399296 00000100:00100000:0.0:1787384655.939131:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787384655.939139:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+21:18651:x1874208203399296:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787384655.939249:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+21:18651:x1874208203399296:12345-0@lo:503:mount.lustre.0 Request processed in 110us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384655.939255:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787384655.939852:0:18651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:18651:1874208203399296:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787384655.940280:0:18651:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787384655.940359:0:18651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a82a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:18651:1874208203399424:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787384655.940413:0:18651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384655.940451:0:18651:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3999600 going to sleep for 11 seconds 00000100:00100000:1.0:1787384655.940634:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203399424 00000100:00100000:1.0:1787384655.940640:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203399424 00000100:00100000:1.0:1787384655.940674:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787384655.940682:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+21:18651:x1874208203399424:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787384655.940772:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+21:18651:x1874208203399424:12345-0@lo:502:mount.lustre.0 Request processed in 90us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384655.940795:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787384655.940899:0:18651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a82a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:18651:1874208203399424:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787384655.941075:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787384655.941101:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787384655.941115:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787384655.941127:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787384655.941163:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787384655.941178:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787384655.941189:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787384655.941199:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787384655.941209:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787384655.941219:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787384655.941230:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787384655.941241:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787384655.941251:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787384655.941261:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787384655.941272:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787384655.941285:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787384655.941297:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787384655.941317:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787384655.941328:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787384655.941339:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787384655.941361:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787384655.941373:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787384655.941384:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787384655.941396:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787384655.941406:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1787384655.941417:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1787384655.941429:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1787384655.941440:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1787384655.941452:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1787384655.941465:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1787384655.942139:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1787384655.942182:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1787384655.942197:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1787384655.942209:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1787384655.942221:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1787384655.942233:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1787384655.942261:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1787384655.942274:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1787384655.942288:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1787384655.942300:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1787384655.942311:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1787384655.942322:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1787384655.942334:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1787384655.942345:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1787384655.942356:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1787384655.942367:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1787384655.942379:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1787384655.942391:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1787384655.942434:0:18651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a82a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:18651:1874208203399552:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787384655.942729:0:18651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384655.942828:0:18651:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3999600 going to sleep for 11 seconds 00000100:00100000:1.0:1787384655.942970:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203399552 00000100:00100000:1.0:1787384655.942977:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203399552 00000100:00100000:1.0:1787384655.943056:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787384655.943064:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+21:18651:x1874208203399552:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787384655.943184:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+21:18651:x1874208203399552:12345-0@lo:502:mount.lustre.0 Request processed in 119us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384655.943191:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787384655.943264:0:18651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a82a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:18651:1874208203399552:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787384655.943435:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1787384655.943458:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1787384655.943556:0:18651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a82a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:18651:1874208203399680:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787384655.943593:0:18651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384655.943615:0:18651:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3999600 going to sleep for 11 seconds 00000100:00100000:0.0:1787384655.943630:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203399680 00000100:00100000:0.0:1787384655.943634:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203399680 00000100:00100000:0.0:1787384655.943669:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787384655.943675:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c370c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+21:18651:x1874208203399680:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787384655.943748:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c370c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+21:18651:x1874208203399680:12345-0@lo:502:mount.lustre.0 Request processed in 72us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384655.943754:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787384655.943808:0:18651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a82a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:18651:1874208203399680:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787384655.943839:0:18651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1787384655.943846:0:18651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1787384655.944319:0:18678:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787384655.944334:0:18678:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff98f8fc2b0000) 00000020:00000080:0.0:1787384655.944354:0:18678:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1787384655.944850:0:18678:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f8d9698000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787384655.944929:0:18678:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f8d9698000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787384655.944932:0:18678:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f8d9698000 3 00010000:00080000:1.0:1787384655.944961:0:18678:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f8f5698800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.145@tcp at head 00010000:00010000:1.0:1787384655.949450:0:18678:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1787384655.949546:0:18678:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787384655.949594:0:18678:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787384655.949619:0:18678:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x7ef423838fba3b56 00000100:00080000:1.0:1787384655.949629:0:18678:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787384655.949635:0:18678:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98f8f5698800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:1.0:1787384655.949683:0:18678:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f7c422ed80 x1874208203399808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787384655.949712:0:18678:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787384655.950190:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384655.950196:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787384655.950198:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384655.950201:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787384655.950228:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384655.950237:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787384655.950240:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384655.950243:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787384655.950998:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203399936:0@lo:400:kworker.0 00000100:00100000:2.0:1787384655.951064:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384655.951096:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787384655.951102:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203400064:0@lo:400:kworker.0 00000100:00100000:2.0:1787384655.951127:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384655.953037:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874208203400320:0@lo:400:kworker.0 00000100:00100000:2.0:1787384655.953100:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384655.953137:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787384655.953144:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203400192:0@lo:400:kworker.0 00000100:00100000:2.0:1787384655.953182:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384655.953216:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203400064 00000100:00100000:2.0:1787384655.953223:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203400064 00000100:00100000:2.0:1787384655.953257:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203400320 00000100:00100000:2.0:1787384655.953260:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203400320 00000100:00100000:0.0:1787384655.953621:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1874208203399808:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787384655.953655:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384655.953833:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203399936 00000100:00100000:0.0:1787384655.953838:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203399936 00000100:00100000:0.0:1787384655.953859:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203400192 00000100:00100000:0.0:1787384655.953868:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203400192 00000100:00100000:0.0:1787384655.953886:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787384655.953893:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9148700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203399936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384655.953950:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9148700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203399936:12345-0@lo:400:kworker.0 Request processed in 57us (2886us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384655.953958:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787384655.953974:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787384655.953980:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203400192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384655.954012:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203400192:12345-0@lo:400:kworker.0 Request processed in 32us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384655.954017:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787384655.954039:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203399808 00000100:00100000:0.0:1787384655.954043:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203399808 00000100:00100000:2.0:1787384655.956055:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787384655.956075:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203400064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384655.956146:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203400064:12345-0@lo:400:kworker.0 Request processed in 80us (5017us total) trans 0 rc 0/0 00010000:00080000:1.0:1787384655.958460:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f8f914a300 x1874208203400064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384655.958477:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203400064:0@lo:400:kworker.0 00000100:00100000:1.0:1787384655.958493:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203399936:0@lo:400:kworker.0 00000100:00100000:1.0:1787384655.960539:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203400192:0@lo:400:kworker.0 00000100:00100000:0.0:1787384655.960828:0:17151:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787384655.960839:0:17151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1787384655.960967:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787384655.960992:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787384655.961004:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874208203400320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384655.961088:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874208203400320:12345-0@lo:400:kworker.0 Request processed in 87us (7987us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384655.961102:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787384655.961115:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787384655.961120:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1874208203399808:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787384655.961128:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f8f914b100 x1874208203400320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1787384655.961140:0:17150:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 551 last 0 00000100:00100000:1.0:1787384655.961140:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874208203400320:0@lo:400:kworker.0 00000020:00000080:2.0:1787384655.961193:0:17150:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x7ef423838fba3b5d 00000004:00100000:2.0:1787384655.961210:0:17150:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787384655.961238:0:17150:0:(import.c:65:import_set_state_nolock()) ffff98f7c4323000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787384655.971539:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874208203399808:12345-0@lo:38:llog_process_th.0 Request processed in 10408us (17873us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384655.971554:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787384655.971639:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f7c422ed80 x1874208203399808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787384665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384655.971651:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787384655.971662:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1787384655.971671:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787384655.971676:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787384655.971679:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f5698800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787384655.971895:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1874208203399808:0@lo:38:llog_process_th.0 00000020:01000004:1.0:1787384655.978021:0:18678:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787384655.978039:0:18678:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff98f8f9688000) 00000020:00000080:1.0:1787384655.978065:0:18678:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1787384655.978221:0:18678:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f8d9698000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787384655.978225:0:18678:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f8d9698000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787384655.978233:0:18678:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f8d9698000 3 00010000:00080000:1.0:1787384655.978262:0:18678:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f7c40d4000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.145@tcp at head 00010000:00010000:1.0:1787384655.989447:0:18678:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1787384655.989550:0:18678:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1787384655.989611:0:18678:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787384655.989624:0:18678:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x7ef423838fba3b6b 00000100:00080000:1.0:1787384655.989634:0:18678:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787384655.989639:0:18678:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff98f7c40d4000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:1.0:1787384655.989672:0:18678:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f7c422df80 x1874208203400448/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787384655.990501:0:18678:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1787384655.990544:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3650:1874208203400448:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787384655.990619:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384655.990685:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203400448 00000100:00100000:2.0:1787384655.990692:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203400448 00000100:00100000:2.0:1787384655.990725:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787384655.990733:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1874208203400448:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787384655.990767:0:17151:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 551 last 0 00000020:00000080:2.0:1787384655.990826:0:17151:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x7ef423838fba3b72 00000004:00100000:2.0:1787384655.990840:0:17151:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787384655.990867:0:17151:0:(import.c:65:import_set_state_nolock()) ffff98f7c4320800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787384655.990914:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874208203400448:12345-0@lo:38:llog_process_th.0 Request processed in 181us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384655.990922:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787384655.990952:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98f7c422df80 x1874208203400448/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787384665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384655.990962:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787384655.990969:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1787384655.990975:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787384655.990979:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787384655.990982:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f7c40d4000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787384655.990987:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3650:1874208203400448:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1787384655.993191:0:18678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1787384655.993766:0:18651:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787384655.993812:0:18651:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787384655.993829:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8d965a000/0x7ef423838fba3b41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3b48 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384655.993842:0:18651:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8d965a000/0x7ef423838fba3b41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3b48 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787384655.993964:0:18651:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787384655.993966:0:18651:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787384655.993967:0:18651:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787384655.993968:0:18651:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787384655.993970:0:18651:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787384655.993971:0:18651:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787384655.993973:0:18651:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787384655.993974:0:18651:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787384655.993981:0:18651:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787384655.993985:0:18651:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787384655.993988:0:18651:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787384655.993989:0:18651:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787384655.993990:0:18651:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787384655.993991:0:18651:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787384655.993992:0:18651:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787384655.993993:0:18651:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787384655.993994:0:18651:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787384655.993995:0:18651:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787384655.993996:0:18651:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787384655.994022:0:18651:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787384655.994043:0:18651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:18651:1874208203400576:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787384655.994113:0:18651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384655.994146:0:18651:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3999840 going to sleep for 11 seconds 00000100:00100000:0.0:1787384655.994192:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203400576 00000100:00100000:0.0:1787384655.994198:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203400576 00000100:00100000:0.0:1787384655.994235:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787384655.994242:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c370dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+21:18651:x1874208203400576:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787384655.994265:0:17144:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787384655.994278:0:17144:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:3.0:1787384655.994850:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787384655.994913:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787384655.994916:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787384655.994919:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787384655.994923:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787384655.994926:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787384655.994929:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787384655.994932:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 20000000:01000000:1.0:1787384655.997561:0:17144:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787384655.997752:0:17166:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787384655.997757:0:17166:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787384655.997793:0:17166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98f902158200/0x7ef423838fba3b79 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384655.997821:0:17166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f7c3952200/0x7ef423838fba3ac3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba3abc expref: 21 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384655.997829:0:17166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f8d965ba00/0x7ef423838fba3ad1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba3aca expref: 21 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384655.997837:0:17166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98f902158200/0x7ef423838fba3b79 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384655.997888:0:17166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f8d965ba00/0x7ef423838fba3ad1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba3aca expref: 21 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384655.997902:0:17166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f8d965ba00/0x7ef423838fba3ad1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba3aca expref: 21 pid: 17143 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384655.997916:0:17166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e69c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1874208203400704:0@lo:104: 00000100:00100000:3.0:1787384655.997971:0:17166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787384655.998019:0:17166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f7c3952200/0x7ef423838fba3ac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba3abc expref: 21 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384655.998028:0:17166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f7c3952200/0x7ef423838fba3ac3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba3abc expref: 21 pid: 17142 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384655.998036:0:17166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e6ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1874208203400832:0@lo:104: 00000100:00100000:3.0:1787384655.998057:0:17166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384655.998072:0:17166:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c356bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787384655.998097:0:17133:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787384655.998112:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203400704 00000100:00100000:3.0:1787384655.998117:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203400704 00000100:00100000:3.0:1787384655.998165:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203400832 00000100:00100000:3.0:1787384655.998169:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203400832 00000100:00100000:3.0:1787384655.998184:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787384655.998191:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57899b24-a33b-4177-9883-79b5fe35053f+4:17166:x1874208203400704:12345-0@lo:104: 00010000:00010000:3.0:1787384655.998203:0:17133:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f8d965be00/0x7ef423838fba3aca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba3ad1 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384655.998249:0:17133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787384655.998254:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57899b24-a33b-4177-9883-79b5fe35053f+4:17166:x1874208203400704:12345-0@lo:104: Request processed in 64us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384655.998261:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787384655.998395:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787384655.998403:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c43bd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57899b24-a33b-4177-9883-79b5fe35053f+3:17166:x1874208203400832:12345-0@lo:104: 00010000:00010000:3.0:1787384655.998411:0:17133:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f902159400/0x7ef423838fba3abc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba3ac3 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384655.998444:0:17133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787384655.998449:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c43bd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57899b24-a33b-4177-9883-79b5fe35053f+3:17166:x1874208203400832:12345-0@lo:104: Request processed in 48us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384655.998454:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787384655.998502:0:17166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e69c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1874208203400704:0@lo:104: 00000100:00100000:3.0:1787384655.998510:0:17166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e6ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1874208203400832:0@lo:104: 00010000:00010000:3.0:1787384655.998527:0:17166:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98f902158200/0x7ef423838fba3b79 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384655.998542:0:17902:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787384655.998548:0:17902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8d965be00/0x7ef423838fba3aca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba3ad1 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384655.998563:0:17902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965be00 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:3.0:1787384655.998567:0:17902:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8d965be00/0x7ef423838fba3aca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba3ad1 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384655.998575:0:17902:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8d965be00/0x7ef423838fba3aca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba3ad1 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787384655.998676:0:17144:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787384655.999042:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c370dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+21:18651:x1874208203400576:12345-0@lo:253:mount.lustre.0 Request processed in 4799us (4928us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384655.999051:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 10000000:00010000:3.0:1787384655.999207:0:17902:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8d965be00/0x7ef423838fba3aca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba3ad1 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384655.999213:0:17902:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1787384655.999272:0:18651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:18651:1874208203400576:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787384655.999283:0:18651:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787384655.999286:0:18651:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787384655.999288:0:18651:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00010000:00010000:3.0:1787384655.999289:0:17902:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8d965be00/0x7ef423838fba3aca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba3ad1 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787384655.999289:0:18651:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787384655.999291:0:18651:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787384655.999292:0:18651:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787384655.999293:0:18651:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787384655.999295:0:18651:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00010000:00010000:3.0:1787384655.999296:0:17902:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:01000004:0.0:1787384655.999297:0:18651:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787384655.999298:0:18651:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787384655.999309:0:18651:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1787384655.999323:0:17902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8d965be00/0x7ef423838fba3aca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba3ad1 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384655.999331:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8d965be00/0x7ef423838fba3aca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba3ad1 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384655.999343:0:17902:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1787384655.999344:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57899b24-a33b-4177-9883-79b5fe35053f:3651:1874208203400960:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787384655.999347:0:17902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f902159400/0x7ef423838fba3abc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba3ac3 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384655.999355:0:17902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f902159400 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:3.0:1787384655.999357:0:17902:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f902159400/0x7ef423838fba3abc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba3ac3 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384655.999375:0:17902:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f902159400/0x7ef423838fba3abc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba3ac3 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787384655.999381:0:17902:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f902159400/0x7ef423838fba3abc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba3ac3 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384655.999390:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1787384655.999391:0:17902:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1787384655.999446:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203400960 00000100:00100000:2.0:1787384655.999452:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203400960 00010000:00010000:2.0:1787384655.999476:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f8d965ba00/0x7ef423838fba3ad1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba3aca expref: 21 pid: 17143 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384655.999499:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787384655.999508:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57899b24-a33b-4177-9883-79b5fe35053f+21:3651:x1874208203400960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787384655.999519:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384655.999532:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f8d965ba00/0x7ef423838fba3ad1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba3aca expref: 21 pid: 17143 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384655.999545:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f8d965ba00/0x7ef423838fba3ad1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba3aca expref: 21 pid: 17143 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384655.999560:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8d965ba00/0x7ef423838fba3ad1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba3aca expref: 21 pid: 17143 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384655.999572:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384655.999605:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57899b24-a33b-4177-9883-79b5fe35053f+20:3651:x1874208203400960:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384655.999611:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787384655.999638:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57899b24-a33b-4177-9883-79b5fe35053f:3651:1874208203400960:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787384655.999919:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1787384656.003586:0:18651:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787384656.006343:0:18651:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787384656.006352:0:18651:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787384656.006382:0:18651:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787384656.006417:0:18651:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.145@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787384656.006435:0:18651:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787384656.006461:0:18651:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1787384656.007169:0:18651:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787384656.007351:0:18651:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787384656.010496:0:17902:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f902159400/0x7ef423838fba3abc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba3ac3 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384656.010510:0:17902:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787384656.010531:0:17902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f902159400/0x7ef423838fba3abc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba3ac3 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384656.010539:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f902159400/0x7ef423838fba3abc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba3ac3 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384656.010558:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384656.010560:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384656.010562:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384656.010606:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57899b24-a33b-4177-9883-79b5fe35053f:3652:1874208203401088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787384656.010667:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384656.010914:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203401088 00000100:00100000:3.0:1787384656.010922:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203401088 00010000:00010000:3.0:1787384656.010948:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f7c3952200/0x7ef423838fba3ac3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba3abc expref: 20 pid: 17142 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384656.010974:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787384656.010987:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d8520450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57899b24-a33b-4177-9883-79b5fe35053f+20:3652:x1874208203401088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787384656.011008:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384656.011014:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f7c3952200/0x7ef423838fba3ac3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba3abc expref: 20 pid: 17142 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384656.011026:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f7c3952200/0x7ef423838fba3ac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba3abc expref: 20 pid: 17142 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384656.011038:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c3952200/0x7ef423838fba3ac3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba3abc expref: 20 pid: 17142 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384656.011051:0:17137:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98f902158200/0x7ef423838fba3b79 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384656.011061:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f902158200/0x7ef423838fba3b79 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787384656.011075:0:17137:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013318751s 00010000:00010000:3.0:1787384656.011080:0:17137:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f902158200/0x7ef423838fba3b79 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384656.011086:0:17137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f902158200/0x7ef423838fba3b79 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384656.011094:0:17137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98f902158200/0x7ef423838fba3b79 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384656.011099:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98f902158200/0x7ef423838fba3b79 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384656.011106:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f902158200 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:3.0:1787384656.011110:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98f902158200/0x7ef423838fba3b79 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384656.011124:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98f902158200/0x7ef423838fba3b79 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384656.011138:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98f902158200/0x7ef423838fba3b79 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384656.011158:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384656.011194:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d8520450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57899b24-a33b-4177-9883-79b5fe35053f+19:3652:x1874208203401088:12345-0@lo:103:ldlm_bl.0 Request processed in 212us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384656.012340:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1787384656.012408:0:17166:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98f902158200/0x7ef423838fba3b79 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384656.012419:0:17166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98f902158200/0x7ef423838fba3b79 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384656.012426:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f902158200/0x7ef423838fba3b79 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384656.012472:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57899b24-a33b-4177-9883-79b5fe35053f:3652:1874208203401088:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787384656.246986:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384656.822940:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203401216:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787384656.823010:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384656.823069:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203401216 00000100:00100000:3.0:1787384656.823076:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203401216 00000100:00100000:3.0:1787384656.823119:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787384656.823127:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203401216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787384656.823169:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787384656.823217:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203401216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384656.823224:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787384656.823281:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203401216:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787384656.826985:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787384656.827006:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203401344:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787384656.827074:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384656.827173:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203401344 00000100:00100000:3.0:1787384656.827181:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203401344 00000100:00100000:3.0:1787384656.827234:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787384656.827243:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203401344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787384656.827287:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787384656.827341:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203401344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384656.827349:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787384656.827399:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203401344:0@lo:41:osp-pre-1-0.0 00000020:00000004:0.0:1787384657.021018:0:18733:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787384657.021310:0:18733:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787384657.271968:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787384658.044000:0:17146:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787384658.044008:0:17146:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98f8f7d8f800 from 9 10000000:01000000:1.0:1787384658.044013:0:17146:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787384658.044076:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3953200/0x7ef423838fba3b80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384658.044107:0:17146:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f7c3953200/0x7ef423838fba3b80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384658.044119:0:17146:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f7c3953200/0x7ef423838fba3b80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384658.044154:0:17146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203401472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787384658.044234:0:17146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384658.044291:0:17146:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f1b06480 going to sleep for 11 seconds 00000100:00100000:0.0:1787384658.044309:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203401472 00000100:00100000:0.0:1787384658.044317:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203401472 00000100:00100000:0.0:1787384658.044370:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787384658.044379:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c370c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+19:17146:x1874208203401472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787384658.044392:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384658.044405:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8c6141200/0x7ef423838fba3b87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba3b80 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384658.044427:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8c6141200/0x7ef423838fba3b87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba3b80 expref: 20 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384658.044437:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8c6141200/0x7ef423838fba3b87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba3b80 expref: 20 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384658.044447:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6141200, rc 0) 00000100:00100000:0.0:1787384658.044492:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c370c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+20:17146:x1874208203401472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384658.044499:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787384658.044527:0:17146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203401472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787384658.044541:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f7c3953200/0x7ef423838fba3b80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3b87 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384658.044550:0:17146:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f7c3953200/0x7ef423838fba3b80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba3b87 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384658.044597:0:17146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203401600:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787384658.044626:0:17146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384658.044649:0:17146:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f1b06480 going to sleep for 11 seconds 00000100:00100000:0.0:1787384658.044692:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203401600 00000100:00100000:0.0:1787384658.044698:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203401600 00000100:00100000:0.0:1787384658.044729:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787384658.044736:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c370ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+20:17146:x1874208203401600:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787384658.044749:0:17144:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787384658.044769:0:17144:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787384658.044772:0:17144:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1787384658.044868:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c370ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+20:17146:x1874208203401600:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 132us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384658.044875:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787384658.044951:0:17146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203401600:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787384658.045004:0:17146:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787384658.045009:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3953200/0x7ef423838fba3b80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3b87 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384658.045017:0:17146:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f7c3953200/0x7ef423838fba3b80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3b87 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384658.045026:0:17146:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787384658.045028:0:17146:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98f8f7d47800 from 9 10000000:01000000:3.0:1787384658.045030:0:17146:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787384658.045056:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902158200/0x7ef423838fba3b8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384658.045073:0:17146:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f902158200/0x7ef423838fba3b8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384658.045081:0:17146:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f902158200/0x7ef423838fba3b8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384658.045094:0:17146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e69c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203401728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787384658.045121:0:17146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384658.045155:0:17146:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c356b840 going to sleep for 11 seconds 00000100:00100000:1.0:1787384658.045356:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203401728 00000100:00100000:1.0:1787384658.045361:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203401728 00000100:00100000:1.0:1787384658.045397:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787384658.045404:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c370f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+20:17146:x1874208203401728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787384658.045411:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384658.045420:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c3953000/0x7ef423838fba3b95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba3b8e expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384658.045445:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c3953000/0x7ef423838fba3b95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba3b8e expref: 21 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384658.045453:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c3953000/0x7ef423838fba3b95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba3b8e expref: 21 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384658.045460:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3953000, rc 0) 00000100:00100000:1.0:1787384658.045491:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c370f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+21:17146:x1874208203401728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384658.045497:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787384658.045529:0:17146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e69c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203401728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787384658.045539:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f902158200/0x7ef423838fba3b8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3b95 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384658.045547:0:17146:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f902158200/0x7ef423838fba3b8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba3b95 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384658.045587:0:17146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203401856:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787384658.045615:0:17146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384658.045629:0:17146:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f1b06480 going to sleep for 11 seconds 00000100:00100000:1.0:1787384658.045641:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203401856 00000100:00100000:1.0:1787384658.045644:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203401856 00000100:00100000:1.0:1787384658.045661:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787384658.045666:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c370d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+21:17146:x1874208203401856:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787384658.045677:0:17142:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787384658.045688:0:17142:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787384658.045695:0:17142:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1787384658.045757:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c370d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+21:17146:x1874208203401856:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 90us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384658.045763:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787384658.045814:0:17146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203401856:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787384658.045854:0:17146:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787384658.045860:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f902158200/0x7ef423838fba3b8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3b95 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384658.045868:0:17146:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f902158200/0x7ef423838fba3b8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3b95 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384658.298091:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787384658.753014:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787384659.319094:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384660.348372:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384661.367018:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384661.431975:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57899b24-a33b-4177-9883-79b5fe35053f:3651:1874208203401984:0@lo:400:kworker.0 00000100:00100000:3.0:1787384661.432049:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384661.432177:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203401984 00000100:00100000:1.0:1787384661.432185:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203401984 00000100:00100000:1.0:1787384661.432236:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787384661.432246:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c370e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+21:3651:x1874208203401984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384661.436468:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203402112:0@lo:400:kworker.0 00000100:00100000:3.0:1787384661.436552:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384661.436604:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203402112 00000100:00100000:3.0:1787384661.436610:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203402112 00000100:00100000:3.0:1787384661.436656:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787384661.436665:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203402112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384661.436737:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203402112:12345-0@lo:400:kworker.0 Request processed in 73us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384661.436756:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787384661.436817:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203402112:0@lo:400:kworker.0 00000100:00080000:2.0:1787384661.437073:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384661.437079:0:16239:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787384661.437082:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384661.437084:0:16239:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787384661.437134:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384661.437137:0:16239:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787384661.437140:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384661.437142:0:16239:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787384661.437214:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203402240:0@lo:400:kworker.0 00000100:00100000:2.0:1787384661.437248:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384661.437268:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203402752:0@lo:400:kworker.0 00000100:00100000:2.0:1787384661.437289:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384661.437306:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787384661.437311:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203402368:0@lo:400:kworker.0 00000100:00100000:2.0:1787384661.437332:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384661.437361:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203402240 00000100:00100000:2.0:1787384661.437365:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203402240 00000100:00100000:2.0:1787384661.437392:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203402752 00000100:00100000:2.0:1787384661.437395:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203402752 00000100:00100000:2.0:1787384661.437422:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787384661.437428:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203402240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384661.437464:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203402240:12345-0@lo:400:kworker.0 Request processed in 36us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384661.437471:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787384661.437484:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787384661.437490:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203402752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384661.437517:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203402752:12345-0@lo:400:kworker.0 Request processed in 28us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384661.437522:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787384661.437540:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203402368 00000100:00100000:2.0:1787384661.437543:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203402368 00000100:00100000:2.0:1787384661.437564:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787384661.437570:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203402368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384661.437600:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203402368:12345-0@lo:400:kworker.0 Request processed in 30us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384661.437613:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787384661.437645:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203402368:0@lo:400:kworker.0 00010000:00080000:2.0:1787384661.437657:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f914a300 x1874208203402240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384661.437666:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203402240:0@lo:400:kworker.0 00010000:00080000:2.0:1787384661.437675:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f914b100 x1874208203402752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384661.437683:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203402752:0@lo:400:kworker.0 00000100:00100000:2.0:1787384661.437716:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874208203402624:0@lo:400:kworker.0 00000100:00100000:2.0:1787384661.437741:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384661.437757:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787384661.437763:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874208203402496:0@lo:400:kworker.0 00000100:00100000:2.0:1787384661.437806:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384661.437827:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203402624 00000100:00100000:2.0:1787384661.437831:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203402624 00000100:00100000:2.0:1787384661.437852:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203402496 00000100:00100000:2.0:1787384661.437855:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203402496 00000100:00100000:2.0:1787384661.437868:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787384661.437874:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874208203402624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384661.437907:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874208203402624:12345-0@lo:400:kworker.0 Request processed in 33us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384661.437912:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787384661.437923:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787384661.437929:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874208203402496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384661.437978:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874208203402496:12345-0@lo:400:kworker.0 Request processed in 49us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384661.437994:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1787384661.438021:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f914b480 x1874208203402496/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384661.438046:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874208203402496:0@lo:400:kworker.0 00010000:00080000:2.0:1787384661.438058:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f914aa00 x1874208203402624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384661.438077:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874208203402624:0@lo:400:kworker.0 00000100:00080000:2.0:1787384661.438130:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787384661.438134:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787384661.438305:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c370e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+21:3651:x1874208203401984:12345-0@lo:400:kworker.0 Request processed in 6059us (6254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384661.438314:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787384661.442709:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57899b24-a33b-4177-9883-79b5fe35053f:3651:1874208203401984:0@lo:400:kworker.0 00000100:00100000:3.0:1787384661.944910:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384661.944934:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203402880:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787384661.945001:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384661.945049:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203402880 00000100:00100000:3.0:1787384661.945056:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203402880 00000100:00100000:3.0:1787384661.945105:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787384661.945125:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203402880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787384661.945159:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787384661.945201:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203402880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384661.945208:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787384661.945253:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203402880:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787384661.945566:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203403008:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787384661.945594:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384661.945680:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203403008 00000100:00100000:0.0:1787384661.945684:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203403008 00000100:00100000:0.0:1787384661.945718:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787384661.945725:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203403008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787384661.945743:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787384661.945926:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203403008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 201us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384661.945933:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787384661.960047:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203403008:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787384662.392529:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787384662.683963:0:19022:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg345-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787384663.418877:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787384663.863900:0:17904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1787384663.938767:0:19075:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787384663.939017:0:19075:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787384664.439199:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787384664.691877:0:19125:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787384664.692125:0:19125:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787384665.464111:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384666.236114:0:3650:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787384651/real 1787384651] req@ffff98f8f7e68e00 x1874208203396992/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384666 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384666.236171:0:3650:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98f8f7e68e00 x1874208203396992/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384666 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384666.236184:0:3650:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787384651/real 1787384651] req@ffff98f8f7e6aa00 x1874208203397120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384666 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384666.236390:0:3650:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98f8f7e6aa00 x1874208203397120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384666 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787384666.236415:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8d9107000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787384666.236439:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787384666.236443:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203396992:0@lo:8:kworker.0 00000100:00080000:1.0:1787384666.236449:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f919a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787384666.236455:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787384666.236457:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203397120:0@lo:8:kworker.0 00000100:00100000:1.0:1787384666.236634:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57899b24-a33b-4177-9883-79b5fe35053f:3652:1874208203403136:0@lo:400:kworker.0 00000100:00100000:1.0:1787384666.236716:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787384666.236841:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384666.236846:0:16239:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787384666.236849:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384666.236852:0:16239:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787384666.240465:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874208203403392:0@lo:400:kworker.0 00000100:00100000:3.0:1787384666.240561:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384666.240619:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787384666.240627:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203403264:0@lo:400:kworker.0 00000100:00100000:3.0:1787384666.240656:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384666.240706:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203403264 00000100:00100000:3.0:1787384666.240724:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203403264 00000100:00100000:3.0:1787384666.240806:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787384666.240816:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203403264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384666.240885:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203403264:12345-0@lo:400:kworker.0 Request processed in 69us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384666.240893:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787384666.240947:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203403264:0@lo:400:kworker.0 00000100:00100000:1.0:1787384666.243859:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787384666.243896:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203403520:0@lo:400:kworker.0 00000100:00100000:1.0:1787384666.243989:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384666.246906:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203403136 00000100:00100000:1.0:1787384666.246924:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203403136 00000100:00100000:1.0:1787384666.246994:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787384666.247005:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c370f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+21:3652:x1874208203403136:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787384666.247438:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384666.247444:0:16239:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787384666.247448:0:16239:0:(import.c:65:import_set_state_nolock()) ffff98f8d9107000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787384666.247455:0:16239:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 546 00000100:00080000:2.0:1787384666.247462:0:16239:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787384666.247469:0:16239:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff98f8d9107000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:2.0:1787384666.247511:0:16239:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f914b100 x1874208203403648/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787384666.247547:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384666.247550:0:16239:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787384666.247552:0:16239:0:(import.c:65:import_set_state_nolock()) ffff98f8f919a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787384666.247556:0:16239:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 546 00000100:00080000:2.0:1787384666.247559:0:16239:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787384666.247563:0:16239:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98f8f919a800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:2.0:1787384666.247576:0:16239:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f914a300 x1874208203403776/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787384666.248475:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c370f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+21:3652:x1874208203403136:12345-0@lo:400:kworker.0 Request processed in 1464us (11751us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384666.248487:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787384666.248540:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787384666.248558:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203403904:0@lo:400:kworker.0 00000100:00100000:1.0:1787384666.249771:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384666.249882:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203403392 00000100:00100000:1.0:1787384666.249893:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203403392 00000100:00100000:1.0:1787384666.249943:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203403904 00000100:00100000:1.0:1787384666.249946:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203403904 00000100:00100000:1.0:1787384666.249966:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787384666.249975:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874208203403392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384666.250027:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874208203403392:12345-0@lo:400:kworker.0 Request processed in 53us (9466us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384666.250034:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787384666.250050:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787384666.250055:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203403904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384666.250107:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203403904:12345-0@lo:400:kworker.0 Request processed in 51us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384666.250113:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787384666.250140:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203403520 00000100:00100000:1.0:1787384666.250144:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203403520 00000100:00100000:1.0:1787384666.250169:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787384666.250175:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203403520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384666.250206:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203403520:12345-0@lo:400:kworker.0 Request processed in 31us (6217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384666.250212:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1787384666.250251:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f914ad80 x1874208203403904/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384666.250266:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203403904:0@lo:400:kworker.0 00000100:00100000:1.0:1787384666.250324:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203404032:0@lo:400:kworker.0 00000100:00100000:1.0:1787384666.250352:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384666.250376:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787384666.250383:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203404160:0@lo:400:kworker.0 00000100:00100000:1.0:1787384666.250407:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384666.250426:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203404032 00000100:00100000:1.0:1787384666.250430:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203404032 00000100:00100000:1.0:1787384666.250456:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203404160 00000100:00100000:1.0:1787384666.250458:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203404160 00000100:00100000:1.0:1787384666.250470:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787384666.250475:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203404032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384666.250504:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203404032:12345-0@lo:400:kworker.0 Request processed in 29us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384666.250511:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787384666.250520:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787384666.250525:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203404160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384666.250545:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203404160:12345-0@lo:400:kworker.0 Request processed in 21us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384666.250551:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1787384666.250586:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f7c35d9c00 x1874208203404160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384666.250596:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203404160:0@lo:400:kworker.0 00010000:00080000:1.0:1787384666.250605:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f9149f80 x1874208203404032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384666.250614:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203404032:0@lo:400:kworker.0 00000100:00100000:1.0:1787384666.250636:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203403648:0@lo:8:kworker.0 00000100:00100000:1.0:1787384666.250668:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384666.250703:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203403776:0@lo:8:kworker.0 00000100:00100000:1.0:1787384666.250728:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384666.250769:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203403648 00000100:00100000:1.0:1787384666.250770:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203403776 00000100:00100000:1.0:1787384666.250773:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203403776 00000100:00100000:0.0:1787384666.250773:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203403648 00000100:00100000:0.0:1787384666.251044:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787384666.251051:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3650:x1874208203403648:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787384666.251196:0:18657:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 561 last 0 00000020:00000080:0.0:1787384666.251291:0:18657:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7ef423838fba3b9c 00002000:00100000:0.0:1787384666.251308:0:18657:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff98f7c38ae800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113671 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1787384666.251314:0:18657:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1787384666.251316:0:18657:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787384666.251533:0:18657:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1787384666.251564:0:18657:0:(import.c:65:import_set_state_nolock()) ffff98f7c38a8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787384666.251631:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3650:x1874208203403648:12345-0@lo:8:kworker.0 Request processed in 578us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384666.251648:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787384666.251671:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787384666.251675:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3650:x1874208203403776:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787384666.251689:0:18657:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787384666.252419:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203403520:0@lo:400:kworker.0 00000100:00100000:3.0:1787384666.252436:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57899b24-a33b-4177-9883-79b5fe35053f:3652:1874208203403136:0@lo:400:kworker.0 00010000:00080000:3.0:1787384666.253304:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f914aa00 x1874208203403392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384666.253319:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874208203403392:0@lo:400:kworker.0 00010000:00080000:1.0:1787384666.254802:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f914b100 x1874208203403648/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787384686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384666.254819:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787384666.254831:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1787384666.254843:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787384666.254850:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787384666.254855:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8d9107000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787384666.254894:0:3650:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787384666.254903:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203403648:0@lo:8:kworker.0 00000004:00080000:1.0:1787384666.254942:0:17891:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787384666.255069:0:17891:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 561335290185ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787384666.255077:0:17891:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1787384666.255335:0:17892:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1787384666.255362:0:17892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e6aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17892:1874208203404416:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1787384666.255433:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384666.255460:0:17892:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fc1dd840 going to sleep for 11 seconds 00000100:00100000:3.0:1787384666.255474:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203404288:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787384666.255497:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384666.255542:0:18656:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787384666.255549:0:18656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000004:00080000:3.0:1787384666.256619:0:17883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1787384666.261419:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203404288 00000100:00100000:1.0:1787384666.261661:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203404288 00000100:00100000:1.0:1787384666.261740:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787384666.261753:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1874208203404288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787384666.261818:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787384666.261994:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1874208203404288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 244us (6495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384666.262003:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787384666.262033:0:18658:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787384666.262045:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203404416 00000100:00100000:1.0:1787384666.262050:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203404416 00010000:00080000:3.0:1787384666.263397:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f7e68700 x1874208203404288/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384682 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384666.263432:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203404288:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787384666.265409:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787384666.265422:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787384666.265425:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384666.265826:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3650:x1874208203403776:12345-0@lo:8:kworker.0 Request processed in 14141us (15089us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787384666.265860:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787384666.266169:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787384666.266188:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17892:x1874208203404416:12345-0@lo:7:osp-pre-0-1.0 00000100:00080000:3.0:1787384666.269889:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f919a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787384666.269904:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787384666.269910:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203403776:0@lo:8:kworker.0 00002000:00080000:3.0:1787384666.274542:0:18657:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1787384666.274556:0:18657:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1787384666.274817:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17892:x1874208203404416:12345-0@lo:7:osp-pre-0-1.0 Request processed in 8630us (19377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384666.274830:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787384666.275621:0:17892:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f7e6aa00 x1874208203404416/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787384682 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384666.275642:0:17892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e6aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17892:1874208203404416:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1787384666.275672:0:17892:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:0.0:1787384666.275732:0:17892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a82680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17892:1874208203404544:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1787384666.275808:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384666.275845:0:17892:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9462cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384666.276475:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203404544 00000100:00100000:3.0:1787384666.276487:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203404544 00000100:00100000:3.0:1787384666.276563:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787384666.276575:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17892:x1874208203404544:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1787384666.276613:0:18658:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1787384666.276674:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17892:x1874208203404544:12345-0@lo:5:osp-pre-0-1.0 Request processed in 100us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384666.276681:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787384666.276769:0:17892:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f7c3a82680 x1874208203404544/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787384682 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384666.276816:0:17892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a82680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17892:1874208203404544:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1787384666.276830:0:17892:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1787384666.276870:0:17892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a82680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17892:1874208203404672:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1787384666.276906:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384666.276931:0:17892:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9462cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384666.276946:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203404672 00000100:00100000:0.0:1787384666.276950:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203404672 00000100:00100000:0.0:1787384666.276980:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787384666.276987:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17892:x1874208203404672:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1787384666.278634:0:18656:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:0.0:1787384666.302428:0:18652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1787384666.302447:0:18652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1787384666.304015:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17892:x1874208203404672:12345-0@lo:5:osp-pre-0-1.0 Request processed in 27021us (27101us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787384666.304027:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787384666.304509:0:17892:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f7c3a82680 x1874208203404672/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787384682 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384666.304522:0:17892:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787384666.304528:0:17892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a82680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17892:1874208203404672:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1787384666.304543:0:17892:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1787384666.304591:0:17892:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a82680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17892:1874208203404800:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1787384666.304627:0:17892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384666.304661:0:17892:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d9462cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384666.304875:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203404800 00000100:00100000:3.0:1787384666.304881:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203404800 00000100:00100000:3.0:1787384666.304924:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787384666.304933:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17892:x1874208203404800:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1787384666.304978:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17892:x1874208203404800:12345-0@lo:900:osp-pre-0-1.0 Request processed in 46us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384666.304992:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787384666.305054:0:17892:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f7c3a82680 x1874208203404800/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787384682 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384666.305065:0:17892:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a82680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17892:1874208203404800:0@lo:900:osp-pre-0-1.0 00010000:00010000:2.0:1787384666.487097:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384667.064410:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787384667.064434:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203404928:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787384667.064478:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203405056:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787384667.064505:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384667.064558:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203404928 00000100:00100000:0.0:1787384667.064565:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203404928 00000100:00100000:0.0:1787384667.064611:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787384667.064620:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203404928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787384667.064652:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787384667.064697:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203404928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384667.064706:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787384667.064734:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384667.064822:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203404928:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787384667.064847:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203405056 00000100:00100000:0.0:1787384667.064851:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203405056 00000100:00100000:0.0:1787384667.064875:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787384667.064883:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203405056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787384667.068794:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787384667.068883:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203405056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3996us (4143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384667.070067:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787384667.072859:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203405056:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787384667.510891:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384668.535567:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787384668.998613:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787384669.561028:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384670.343080:0:3650:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787384650/real 1787384650] req@ffff98f8f91d9180 x1874208203395840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384670 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384670.343107:0:3650:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98f8f91d9180 x1874208203395840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384670 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384670.343116:0:3650:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787384650/real 1787384650] req@ffff98f8f91d8a80 x1874208203395968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384670 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384670.343126:0:3650:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98f8f91d8a80 x1874208203395968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384670 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787384670.343143:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8d8503000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787384670.343172:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787384670.343176:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203395840:0@lo:8:kworker.0 00000100:00080000:2.0:1787384670.343181:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f9135000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787384670.343186:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787384670.343197:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203395968:0@lo:8:kworker.0 00000100:00080000:1.0:1787384670.343405:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787384670.343410:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787384670.343413:0:37:0:(import.c:65:import_set_state_nolock()) ffff98f8d8503000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787384670.343418:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 545 00000100:00080000:1.0:1787384670.343422:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787384670.343428:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98f8d8503000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:1.0:1787384670.343449:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f7c422ed80 x1874208203405440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787384670.343459:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787384670.343462:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787384670.343464:0:37:0:(import.c:65:import_set_state_nolock()) ffff98f8f9135000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787384670.343466:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 545 00000100:00080000:1.0:1787384670.343469:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787384670.343472:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98f8f9135000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:1.0:1787384670.343482:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f7c422ea00 x1874208203405568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787384670.343508:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787384670.343511:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787384670.343513:0:37:0:(import.c:65:import_set_state_nolock()) ffff98f8f919a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787384670.343515:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 561 00000100:00080000:1.0:1787384670.343518:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787384670.343528:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98f8f919a800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:1.0:1787384670.343538:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f914b480 x1874208203406080/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787384670.343575:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203405824:0@lo:400:kworker.0 00000100:00100000:1.0:1787384670.343635:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384670.343678:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203406464:0@lo:400:kworker.0 00000100:00100000:1.0:1787384670.343703:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384670.343722:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787384670.343728:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57899b24-a33b-4177-9883-79b5fe35053f:3653:1874208203405184:0@lo:400:kworker.0 00000100:00100000:1.0:1787384670.343754:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384670.343810:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203405952:0@lo:400:kworker.0 00000100:00100000:1.0:1787384670.343833:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384670.343859:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203405312:0@lo:400:kworker.0 00000100:00100000:1.0:1787384670.343878:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384670.343893:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f9149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203406208:0@lo:400:kworker.0 00000100:00100000:1.0:1787384670.343909:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384670.343925:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787384670.343930:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203405696:0@lo:400:kworker.0 00000100:00100000:1.0:1787384670.343948:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384670.343974:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203406336:0@lo:400:kworker.0 00000100:00100000:1.0:1787384670.343993:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384670.344021:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203405824 00000100:00100000:1.0:1787384670.344028:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203405824 00000100:00100000:1.0:1787384670.344193:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203405312 00000100:00100000:1.0:1787384670.344197:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203405312 00000100:00100000:1.0:1787384670.344220:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787384670.344228:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203405824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384670.344281:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203405824:12345-0@lo:400:kworker.0 Request processed in 52us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384670.344288:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787384670.344305:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787384670.344311:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203405312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384670.344341:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203405312:12345-0@lo:400:kworker.0 Request processed in 30us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384670.344347:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787384670.344363:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203406464 00000100:00100000:1.0:1787384670.344366:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203406464 00000100:00100000:1.0:1787384670.344393:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203406208 00000100:00100000:1.0:1787384670.344396:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203406208 00000100:00100000:1.0:1787384670.344404:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203405696 00000100:00100000:1.0:1787384670.344406:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203405696 00000100:00100000:1.0:1787384670.344415:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203406336 00000100:00100000:1.0:1787384670.344417:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203406336 00000100:00100000:1.0:1787384670.344429:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787384670.344435:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203406464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384670.344463:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203406464:12345-0@lo:400:kworker.0 Request processed in 27us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384670.344469:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787384670.344479:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787384670.344484:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee289180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203406208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384670.344506:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee289180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203406208:12345-0@lo:400:kworker.0 Request processed in 21us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384670.344521:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787384670.344532:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787384670.344537:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203405696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384670.344574:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203405696:12345-0@lo:400:kworker.0 Request processed in 37us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384670.344580:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787384670.344591:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787384670.344597:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee28a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203406336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384670.344620:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee28a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203406336:12345-0@lo:400:kworker.0 Request processed in 23us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384670.344625:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787384670.344642:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203405184 00000100:00100000:1.0:1787384670.344645:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203405184 00000100:00100000:1.0:1787384670.344666:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787384670.344671:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c370c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+21:3653:x1874208203405184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384670.344697:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c370c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+21:3653:x1874208203405184:12345-0@lo:400:kworker.0 Request processed in 26us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384670.344703:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787384670.344729:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203405952 00000100:00100000:1.0:1787384670.344732:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203405952 00000100:00100000:1.0:1787384670.344769:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787384670.344775:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203405952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384670.344824:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203405952:12345-0@lo:400:kworker.0 Request processed in 49us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384670.344830:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787384670.344881:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57899b24-a33b-4177-9883-79b5fe35053f:3653:1874208203405184:0@lo:400:kworker.0 00010000:00080000:1.0:1787384670.344894:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f914aa00 x1874208203405952/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384670.344905:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203405952:0@lo:400:kworker.0 00000100:00100000:1.0:1787384670.344914:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203405824:0@lo:400:kworker.0 00010000:00080000:1.0:1787384670.344923:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8ee28a680 x1874208203406464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384670.344932:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203406464:0@lo:400:kworker.0 00000100:00100000:2.0:1787384670.346292:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203405440:0@lo:8:kworker.0 00000100:00100000:2.0:1787384670.346345:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384670.346383:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203405568:0@lo:8:kworker.0 00000100:00100000:2.0:1787384670.346402:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384670.346417:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203406080:0@lo:8:kworker.0 00000100:00100000:2.0:1787384670.346438:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384670.346472:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203405440 00000100:00100000:2.0:1787384670.346477:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203405440 00000100:00100000:2.0:1787384670.346496:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203405568 00000100:00100000:2.0:1787384670.346498:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203405568 00000100:00100000:2.0:1787384670.346505:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203406080 00000100:00100000:2.0:1787384670.346507:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203406080 00000100:00100000:2.0:1787384670.346530:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787384670.346536:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3650:x1874208203405440:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787384670.346562:0:18657:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 565 last 0 00000020:00000080:2.0:1787384670.346589:0:18657:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7ef423838fba3ba3 00002000:00100000:2.0:1787384670.346601:0:18657:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff98f8d01e4800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113671 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787384670.346606:0:18657:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1787384670.346608:0:18657:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787384670.346677:0:18657:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787384670.346699:0:18657:0:(import.c:65:import_set_state_nolock()) ffff98f8d01e6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787384670.346740:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1874208203405440:12345-0@lo:8:kworker.0 Request processed in 202us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384670.346747:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787384670.346761:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787384670.346765:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3650:x1874208203405568:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787384670.346803:0:18657:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787384670.346827:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3650:x1874208203405568:12345-0@lo:8:kworker.0 Request processed in 60us (424us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787384670.346833:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787384670.346843:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787384670.346847:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3650:x1874208203406080:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787384670.346856:0:18657:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787384670.346873:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3650:x1874208203406080:12345-0@lo:8:kworker.0 Request processed in 25us (434us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787384670.346878:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787384670.347195:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f914a300 x1874208203405696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384670.347208:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203405696:0@lo:400:kworker.0 00010000:00080000:1.0:1787384670.347223:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f914ad80 x1874208203406336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384670.347230:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203406336:0@lo:400:kworker.0 00000100:00100000:1.0:1787384670.347242:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203405312:0@lo:400:kworker.0 00010000:00080000:1.0:1787384670.347252:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f9149f80 x1874208203406208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384670.347260:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f9149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203406208:0@lo:400:kworker.0 00000100:00080000:1.0:1787384670.347285:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787384670.347290:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787384670.347292:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787384670.347832:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f7c422ed80 x1874208203405440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787384695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384670.347843:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787384670.347850:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787384670.347860:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787384670.347866:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787384670.347869:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8d8503000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787384670.347892:0:3650:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787384670.347897:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203405440:0@lo:8:kworker.0 00000100:00080000:2.0:1787384670.347921:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f9135000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787384670.347925:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787384670.347929:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203405568:0@lo:8:kworker.0 00000100:00080000:2.0:1787384670.347948:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f919a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000004:00080000:1.0:1787384670.349209:0:17175:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:1.0:1787384670.349244:0:17175:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee28bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17175:1874208203406720:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787384670.349303:0:17175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384670.349332:0:17175:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c80e4600 going to sleep for 11 seconds 00000100:00100000:1.0:1787384670.349364:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787384670.349374:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203406592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787384670.349398:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384670.349426:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203406592 00000100:00100000:1.0:1787384670.349432:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203406592 00000100:00100000:1.0:1787384670.349481:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787384670.349490:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee28b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3653:x1874208203406592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787384670.349512:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787384670.349549:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee28b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3653:x1874208203406592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384670.349556:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787384670.349574:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787384670.349598:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8ee28a680 x1874208203406592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384686 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384670.349614:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203406592:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1787384670.349651:0:17174:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787384670.349733:0:17174:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 565429954222ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787384670.349740:0:17174:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1787384670.349930:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203406720 00000100:00100000:1.0:1787384670.349935:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203406720 00000100:00100000:1.0:1787384670.349972:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787384670.349979:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee28b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17175:x1874208203406720:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:2.0:1787384670.352091:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787384670.352107:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203406080:0@lo:8:kworker.0 00000004:00080000:2.0:1787384670.356849:0:17130:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:1.0:1787384670.366192:0:18657:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1787384670.366203:0:18657:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1787384670.366217:0:18657:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00002000:00010000:0.0:1787384670.390234:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384670.390246:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0a131ef/0x7ef423838fba3baa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.390264:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1787384670.390268:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384670.390274:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0a131ef/0x7ef423838fba3baa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.390290:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0a131ef/0x7ef423838fba3baa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.390300:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0a131ef/0x7ef423838fba3baa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.390308:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0a131ef/0x7ef423838fba3baa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.390339:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787384670.390626:0:17902:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384670.390634:0:17902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0a131ef/0x7ef423838fba3baa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384670.390643:0:17902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140000 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:3.0:1787384670.390648:0:17902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0a131ef/0x7ef423838fba3baa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384670.390658:0:17902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0a131ef/0x7ef423838fba3baa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384670.390676:0:17902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0a131ef/0x7ef423838fba3baa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384670.390684:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0a131ef/0x7ef423838fba3baa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384670.390702:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384670.390704:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384670.390705:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787384670.392573:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384670.392586:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006542928c/0x7ef423838fba3bb1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.392602:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1787384670.392606:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384670.392612:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006542928c/0x7ef423838fba3bb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.392626:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006542928c/0x7ef423838fba3bb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.392635:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006542928c/0x7ef423838fba3bb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.392643:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006542928c/0x7ef423838fba3bb1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.392663:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787384670.392676:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384670.392682:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006542928c/0x7ef423838fba3bb1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.392690:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6141000 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384670.392702:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006542928c/0x7ef423838fba3bb1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.392711:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006542928c/0x7ef423838fba3bb1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.392728:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006542928c/0x7ef423838fba3bb1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.392735:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006542928c/0x7ef423838fba3bb1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.392751:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384670.392753:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384670.392766:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787384670.395949:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787384670.395964:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c307a2c8/0x7ef423838fba3bb8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.395980:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=565s v=(0 0) 00010000:00010000:2.0:1787384670.395985:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384670.395990:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c307a2c8/0x7ef423838fba3bb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.396004:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c307a2c8/0x7ef423838fba3bb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.396014:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c307a2c8/0x7ef423838fba3bb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.396021:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c307a2c8/0x7ef423838fba3bb8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.396060:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787384670.396125:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384670.396139:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c307a2c8/0x7ef423838fba3bb8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384670.396149:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965ba00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:3.0:1787384670.396154:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c307a2c8/0x7ef423838fba3bb8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384670.396164:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c307a2c8/0x7ef423838fba3bb8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384670.396181:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c307a2c8/0x7ef423838fba3bb8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384670.396190:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c307a2c8/0x7ef423838fba3bb8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384670.396208:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384670.396210:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384670.396213:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787384670.396506:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787384670.396513:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007948e30b/0x7ef423838fba3bbf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.396521:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=565s v=(0 0) 00010000:00010000:2.0:1787384670.396525:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384670.396535:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007948e30b/0x7ef423838fba3bbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.396545:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007948e30b/0x7ef423838fba3bbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.396553:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007948e30b/0x7ef423838fba3bbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.396561:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007948e30b/0x7ef423838fba3bbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.396581:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384670.396613:0:17902:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384670.396620:0:17902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007948e30b/0x7ef423838fba3bbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.396628:0:17902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965be00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384670.396632:0:17902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007948e30b/0x7ef423838fba3bbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.396641:0:17902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007948e30b/0x7ef423838fba3bbf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.396655:0:17902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007948e30b/0x7ef423838fba3bbf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.396663:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007948e30b/0x7ef423838fba3bbf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.396679:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384670.396681:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384670.396682:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787384670.396929:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787384670.396935:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a0c6c2a/0x7ef423838fba3bc6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.396943:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=565s v=(0 0) 00010000:00010000:2.0:1787384670.396946:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384670.396950:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a0c6c2a/0x7ef423838fba3bc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.396959:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a0c6c2a/0x7ef423838fba3bc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.396968:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a0c6c2a/0x7ef423838fba3bc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.396987:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a0c6c2a/0x7ef423838fba3bc6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.397004:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787384670.397342:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384670.397350:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba3bcd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.397360:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1787384670.397364:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384670.397368:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba3bcd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.397379:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba3bcd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.397386:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba3bcd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.397392:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384670.397401:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a0c6c2a/0x7ef423838fba3bc6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.397404:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba3bcd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.397418:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965a400 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384670.397424:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a0c6c2a/0x7ef423838fba3bc6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.397437:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384670.397440:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a0c6c2a/0x7ef423838fba3bc6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.397454:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a0c6c2a/0x7ef423838fba3bc6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.397463:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a0c6c2a/0x7ef423838fba3bc6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.397481:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384670.397485:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba3bcd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.397493:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6141e00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384670.397496:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba3bcd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.397504:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba3bcd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.397515:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba3bcd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.397522:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba3bcd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.397546:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384670.397548:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384670.397549:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384670.397688:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787384670.397956:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384670.397962:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006542928c/0x7ef423838fba3bd4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.397972:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1787384670.397975:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384670.397979:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006542928c/0x7ef423838fba3bd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.398112:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006542928c/0x7ef423838fba3bd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.398124:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006542928c/0x7ef423838fba3bd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.398131:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006542928c/0x7ef423838fba3bd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.398147:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384670.398888:0:17902:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384670.399030:0:17902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006542928c/0x7ef423838fba3bd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.399161:0:17902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6141000 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384670.399167:0:17902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006542928c/0x7ef423838fba3bd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.399179:0:17902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006542928c/0x7ef423838fba3bd4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.399197:0:17902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006542928c/0x7ef423838fba3bd4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.399205:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006542928c/0x7ef423838fba3bd4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.399221:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384670.399223:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384670.399225:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787384670.399440:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384670.399447:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0a131ef/0x7ef423838fba3bdb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.399464:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1787384670.399468:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384670.399473:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0a131ef/0x7ef423838fba3bdb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.399484:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0a131ef/0x7ef423838fba3bdb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.399492:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0a131ef/0x7ef423838fba3bdb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.399500:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0a131ef/0x7ef423838fba3bdb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.399517:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787384670.399733:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384670.399739:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009eaaa97/0x7ef423838fba3be2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.399747:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1787384670.399750:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384670.399755:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009eaaa97/0x7ef423838fba3be2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.399764:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009eaaa97/0x7ef423838fba3be2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.399800:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009eaaa97/0x7ef423838fba3be2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.399807:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009eaaa97/0x7ef423838fba3be2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.399824:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787384670.400224:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787384670.400231:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0a131ef/0x7ef423838fba3bdb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.400254:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140000 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384670.400258:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0a131ef/0x7ef423838fba3bdb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.400267:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0a131ef/0x7ef423838fba3bdb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.400282:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0a131ef/0x7ef423838fba3bdb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.400290:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0a131ef/0x7ef423838fba3bdb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.400307:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384670.400311:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009eaaa97/0x7ef423838fba3be2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.400319:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6141800 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384670.400322:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009eaaa97/0x7ef423838fba3be2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.400330:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009eaaa97/0x7ef423838fba3be2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.400340:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009eaaa97/0x7ef423838fba3be2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.400354:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009eaaa97/0x7ef423838fba3be2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.400367:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384670.400369:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384670.400371:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787384670.400495:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384670.400501:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df82f75b/0x7ef423838fba3be9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.400510:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1787384670.400513:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384670.400517:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df82f75b/0x7ef423838fba3be9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.400527:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df82f75b/0x7ef423838fba3be9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.400534:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df82f75b/0x7ef423838fba3be9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.400541:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df82f75b/0x7ef423838fba3be9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.400573:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787384670.401101:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384670.401167:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df82f75b/0x7ef423838fba3be9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.401178:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140a00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:2.0:1787384670.401182:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df82f75b/0x7ef423838fba3be9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.401190:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df82f75b/0x7ef423838fba3be9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.401204:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df82f75b/0x7ef423838fba3be9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.401211:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df82f75b/0x7ef423838fba3be9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.401228:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384670.401232:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384670.401232:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384670.401234:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787384670.401677:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787384670.401693:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d154425d/0x7ef423838fba3bf0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.401705:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=565s v=(0 0) 00010000:00010000:2.0:1787384670.401709:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384670.401714:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d154425d/0x7ef423838fba3bf0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.401725:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d154425d/0x7ef423838fba3bf0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.401733:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d154425d/0x7ef423838fba3bf0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.401741:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d154425d/0x7ef423838fba3bf0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.401763:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384670.402389:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384670.402397:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d154425d/0x7ef423838fba3bf0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.402407:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965a200 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384670.402412:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d154425d/0x7ef423838fba3bf0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.402421:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d154425d/0x7ef423838fba3bf0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.402437:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d154425d/0x7ef423838fba3bf0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.402444:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d154425d/0x7ef423838fba3bf0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.402530:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384670.402532:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384670.402614:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787384670.402935:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787384670.402942:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ca6122b/0x7ef423838fba3bf7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.402953:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=565s v=(0 0) 00010000:00010000:2.0:1787384670.402956:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384670.402961:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ca6122b/0x7ef423838fba3bf7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.402972:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ca6122b/0x7ef423838fba3bf7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.402988:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ca6122b/0x7ef423838fba3bf7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.402995:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ca6122b/0x7ef423838fba3bf7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.403019:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384670.403560:0:17902:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384670.403567:0:17902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ca6122b/0x7ef423838fba3bf7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.403577:0:17902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965bc00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384670.403581:0:17902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ca6122b/0x7ef423838fba3bf7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.403591:0:17902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ca6122b/0x7ef423838fba3bf7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.403604:0:17902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ca6122b/0x7ef423838fba3bf7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.403612:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ca6122b/0x7ef423838fba3bf7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.403630:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384670.403632:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384670.403634:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787384670.403882:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787384670.403889:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c0188bb/0x7ef423838fba3bfe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.403899:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=565s v=(0 0) 00010000:00010000:2.0:1787384670.403903:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384670.403908:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c0188bb/0x7ef423838fba3bfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.403919:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c0188bb/0x7ef423838fba3bfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.403928:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c0188bb/0x7ef423838fba3bfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.403935:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c0188bb/0x7ef423838fba3bfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.403966:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787384670.404502:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787384670.404508:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001497e3dc/0x7ef423838fba3c05 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.404518:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=565s v=(0 0) 00010000:00010000:2.0:1787384670.404522:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384670.404526:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001497e3dc/0x7ef423838fba3c05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.404536:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001497e3dc/0x7ef423838fba3c05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.404617:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001497e3dc/0x7ef423838fba3c05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.404625:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001497e3dc/0x7ef423838fba3c05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.404644:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787384670.404905:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787384670.404912:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c0188bb/0x7ef423838fba3bfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.404921:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965b400 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384670.404925:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c0188bb/0x7ef423838fba3bfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.404943:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c0188bb/0x7ef423838fba3bfe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.404957:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c0188bb/0x7ef423838fba3bfe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.404964:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c0188bb/0x7ef423838fba3bfe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.404981:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384670.404984:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001497e3dc/0x7ef423838fba3c05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.404991:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965ae00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384670.404994:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001497e3dc/0x7ef423838fba3c05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.405002:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001497e3dc/0x7ef423838fba3c05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.405011:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001497e3dc/0x7ef423838fba3c05 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.405018:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001497e3dc/0x7ef423838fba3c05 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.405042:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384670.405045:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384670.405047:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787384670.405155:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787384670.405162:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e074a46d/0x7ef423838fba3c0c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.405170:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=565s v=(0 0) 00010000:00010000:2.0:1787384670.405190:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384670.405195:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e074a46d/0x7ef423838fba3c0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.405205:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e074a46d/0x7ef423838fba3c0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.405214:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e074a46d/0x7ef423838fba3c0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.405221:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e074a46d/0x7ef423838fba3c0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.405239:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384670.405478:0:17902:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384670.405484:0:17902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e074a46d/0x7ef423838fba3c0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.405492:0:17902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965b200 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384670.405496:0:17902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e074a46d/0x7ef423838fba3c0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.405503:0:17902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e074a46d/0x7ef423838fba3c0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.405514:0:17902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e074a46d/0x7ef423838fba3c0c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.405521:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e074a46d/0x7ef423838fba3c0c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.405537:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384670.405540:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384670.405552:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787384670.405877:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787384670.405883:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f18d4b73/0x7ef423838fba3c13 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.405892:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=565s v=(0 0) 00010000:00010000:2.0:1787384670.405895:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384670.405900:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f18d4b73/0x7ef423838fba3c13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.405909:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f18d4b73/0x7ef423838fba3c13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.405917:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f18d4b73/0x7ef423838fba3c13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.405931:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f18d4b73/0x7ef423838fba3c13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.405947:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384670.406259:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384670.406275:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f18d4b73/0x7ef423838fba3c13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.406295:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965b600 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384670.406297:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f18d4b73/0x7ef423838fba3c13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.406304:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f18d4b73/0x7ef423838fba3c13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.406314:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f18d4b73/0x7ef423838fba3c13 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.406321:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f18d4b73/0x7ef423838fba3c13 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.406452:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384670.406454:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384670.406456:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787384670.406536:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384670.406550:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384670.406611:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d907cb4c/0x7ef423838fba3c1a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.406622:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=565s v=(0 0) 00010000:00010000:2.0:1787384670.406626:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384670.406630:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d907cb4c/0x7ef423838fba3c1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.406640:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d907cb4c/0x7ef423838fba3c1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.406648:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d907cb4c/0x7ef423838fba3c1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.406656:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d907cb4c/0x7ef423838fba3c1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.406705:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787384670.407190:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787384670.407196:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f360aac/0x7ef423838fba3c21 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.407210:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=565s v=(0 0) 00010000:00010000:2.0:1787384670.407214:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384670.407218:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f360aac/0x7ef423838fba3c21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.407226:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f360aac/0x7ef423838fba3c21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.407235:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f360aac/0x7ef423838fba3c21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.407242:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f360aac/0x7ef423838fba3c21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.407488:0:17902:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787384670.407495:0:17902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d907cb4c/0x7ef423838fba3c1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.407503:0:17902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2091c00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384670.407507:0:17902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d907cb4c/0x7ef423838fba3c1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.407516:0:17902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d907cb4c/0x7ef423838fba3c1a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.407539:0:17902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d907cb4c/0x7ef423838fba3c1a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.407616:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d907cb4c/0x7ef423838fba3c1a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.407635:0:17902:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384670.407638:0:17902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f360aac/0x7ef423838fba3c21 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.407645:0:17902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2090e00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384670.407649:0:17902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f360aac/0x7ef423838fba3c21 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.407656:0:17902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f360aac/0x7ef423838fba3c21 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.407667:0:17902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f360aac/0x7ef423838fba3c21 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.407676:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384670.407678:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384670.407680:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384670.407762:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787384670.407768:0:18657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f360aac/0x7ef423838fba3c21 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787384670.408942:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384670.408952:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075dd50c5/0x7ef423838fba3c28 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.408966:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1787384670.408970:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384670.408976:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075dd50c5/0x7ef423838fba3c28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.409113:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075dd50c5/0x7ef423838fba3c28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.409125:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075dd50c5/0x7ef423838fba3c28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.409132:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075dd50c5/0x7ef423838fba3c28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.410580:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384670.410591:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075dd50c5/0x7ef423838fba3c28 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.410615:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140e00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384670.410621:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075dd50c5/0x7ef423838fba3c28 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.410631:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075dd50c5/0x7ef423838fba3c28 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.410652:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075dd50c5/0x7ef423838fba3c28 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.410661:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384670.410662:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384670.410664:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384670.410755:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787384670.410763:0:18657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075dd50c5/0x7ef423838fba3c28 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384670.411048:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787384670.411601:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384670.411608:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a639eef/0x7ef423838fba3c2f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.411626:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1787384670.411630:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384670.411636:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a639eef/0x7ef423838fba3c2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.411647:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a639eef/0x7ef423838fba3c2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.411655:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a639eef/0x7ef423838fba3c2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.411661:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a639eef/0x7ef423838fba3c2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.411678:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787384670.413445:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787384670.413454:0:17902:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384670.413457:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae0da09f/0x7ef423838fba3c36 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.413465:0:17902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a639eef/0x7ef423838fba3c2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384670.413475:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=565s v=(0 0) 00010000:00010000:1.0:1787384670.413477:0:17902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6141600 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:3.0:1787384670.413481:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384670.413485:0:17902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a639eef/0x7ef423838fba3c2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384670.413498:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae0da09f/0x7ef423838fba3c36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.413502:0:17902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a639eef/0x7ef423838fba3c2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384670.413518:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae0da09f/0x7ef423838fba3c36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.413526:0:17902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a639eef/0x7ef423838fba3c2f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384670.413528:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae0da09f/0x7ef423838fba3c36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384670.413537:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae0da09f/0x7ef423838fba3c36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.413559:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a639eef/0x7ef423838fba3c2f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384670.413562:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384670.413586:0:17902:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384670.413590:0:17902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae0da09f/0x7ef423838fba3c36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.413599:0:17902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cd000 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384670.413603:0:17902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae0da09f/0x7ef423838fba3c36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.413612:0:17902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae0da09f/0x7ef423838fba3c36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.413625:0:17902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae0da09f/0x7ef423838fba3c36 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.413633:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae0da09f/0x7ef423838fba3c36 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.413647:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384670.413650:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384670.413652:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384670.413931:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384670.414035:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384670.414042:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089728173/0x7ef423838fba3c3d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384670.414061:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=565s v=(0 0) 00010000:00010000:3.0:1787384670.414065:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384670.414069:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089728173/0x7ef423838fba3c3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384670.414078:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089728173/0x7ef423838fba3c3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384670.414085:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089728173/0x7ef423838fba3c3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384670.414103:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089728173/0x7ef423838fba3c3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384670.414128:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787384670.414192:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384670.414198:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089728173/0x7ef423838fba3c3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.414206:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cc600 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384670.414209:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089728173/0x7ef423838fba3c3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.414217:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089728173/0x7ef423838fba3c3d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.414237:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089728173/0x7ef423838fba3c3d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.414244:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089728173/0x7ef423838fba3c3d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.414257:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384670.414259:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384670.414261:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384670.414640:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787384670.414646:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a73db248/0x7ef423838fba3c44 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384670.414657:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=565s v=(0 0) 00010000:00010000:3.0:1787384670.414660:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384670.414664:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a73db248/0x7ef423838fba3c44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384670.414673:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a73db248/0x7ef423838fba3c44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384670.414680:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a73db248/0x7ef423838fba3c44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384670.414689:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a73db248/0x7ef423838fba3c44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384670.417225:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787384670.421638:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384670.421652:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df82f75b/0x7ef423838fba3c4b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.421669:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1787384670.421673:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384670.421679:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df82f75b/0x7ef423838fba3c4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.421698:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df82f75b/0x7ef423838fba3c4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.421708:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df82f75b/0x7ef423838fba3c4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.421715:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df82f75b/0x7ef423838fba3c4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.423156:0:17902:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787384670.423171:0:17902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a73db248/0x7ef423838fba3c44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.423199:0:17902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cc400 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384670.423204:0:17902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a73db248/0x7ef423838fba3c44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.423216:0:17902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a73db248/0x7ef423838fba3c44 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.423238:0:17902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a73db248/0x7ef423838fba3c44 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.423245:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a73db248/0x7ef423838fba3c44 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.423354:0:17902:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384670.423361:0:17902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df82f75b/0x7ef423838fba3c4b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.423370:0:17902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140a00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:2.0:1787384670.423374:0:17902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df82f75b/0x7ef423838fba3c4b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.423396:0:17902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df82f75b/0x7ef423838fba3c4b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.423409:0:17902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df82f75b/0x7ef423838fba3c4b lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384670.423417:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384670.423419:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384670.423421:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384670.428687:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787384670.428703:0:18657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df82f75b/0x7ef423838fba3c4b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.430543:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787384670.433528:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384670.434665:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df82f75b/0x7ef423838fba3c52 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.434688:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1787384670.434692:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384670.434699:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df82f75b/0x7ef423838fba3c52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.434714:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df82f75b/0x7ef423838fba3c52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.434725:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df82f75b/0x7ef423838fba3c52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.434733:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df82f75b/0x7ef423838fba3c52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.434756:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787384670.436184:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384670.436194:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df82f75b/0x7ef423838fba3c52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384670.436214:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140a00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:3.0:1787384670.436219:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df82f75b/0x7ef423838fba3c52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384670.436230:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df82f75b/0x7ef423838fba3c52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384670.436248:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df82f75b/0x7ef423838fba3c52 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384670.436254:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df82f75b/0x7ef423838fba3c52 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384670.436275:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384670.436277:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384670.436279:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787384670.437514:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384670.437525:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075dd50c5/0x7ef423838fba3c59 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.437561:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1787384670.437565:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384670.437571:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075dd50c5/0x7ef423838fba3c59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.437584:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075dd50c5/0x7ef423838fba3c59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.437594:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075dd50c5/0x7ef423838fba3c59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.437602:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075dd50c5/0x7ef423838fba3c59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.437626:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787384670.437883:0:17902:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384670.437889:0:17902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075dd50c5/0x7ef423838fba3c59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384670.437899:0:17902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140e00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:3.0:1787384670.437904:0:17902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075dd50c5/0x7ef423838fba3c59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384670.437914:0:17902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075dd50c5/0x7ef423838fba3c59 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384670.437937:0:17902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075dd50c5/0x7ef423838fba3c59 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384670.437943:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075dd50c5/0x7ef423838fba3c59 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384670.437958:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384670.437960:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384670.437962:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787384670.438089:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384670.438096:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba3c60 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.438105:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1787384670.438109:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384670.438234:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba3c60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.438246:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba3c60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.438343:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba3c60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.438352:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba3c60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384670.438374:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1787384670.438415:0:18657:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:0.0:1787384670.438515:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee28b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17175:x1874208203406720:12345-0@lo:5:osp-pre-0-0.0 Request processed in 88530us (89206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384670.438527:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1787384670.438764:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384670.438772:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba3c60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.438814:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6141e00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384670.438818:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba3c60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.438827:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba3c60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.438851:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba3c60 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.438858:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005175f47b/0x7ef423838fba3c60 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384670.438874:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384670.438876:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384670.438878:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384670.438961:0:17175:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee28bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17175:1874208203406720:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787384670.438977:0:17175:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:3.0:1787384670.439034:0:17175:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e68700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17175:1874208203406848:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787384670.439082:0:17175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384670.439114:0:17175:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3948c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787384670.439159:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203406848 00000100:00100000:1.0:1787384670.439166:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203406848 00000100:00100000:1.0:1787384670.439214:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787384670.439223:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17175:x1874208203406848:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1787384670.439258:0:18658:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:1.0:1787384670.457935:0:18652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:1.0:1787384670.457980:0:18652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787384670.458341:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17175:x1874208203406848:12345-0@lo:5:osp-pre-0-0.0 Request processed in 19116us (19254us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787384670.458353:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787384670.458442:0:17175:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1787384670.458451:0:17175:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e68700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17175:1874208203406848:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787384670.458466:0:17175:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:3.0:1787384670.582991:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787384671.470569:0:19471:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787384671.470573:0:19471:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1787384671.470574:0:19471:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1787384671.470751:0:19471:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff98f8ee0ca000 00000020:01000004:0.0:1787384671.470767:0:19471:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787384671.470840:0:19471:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787384671.470853:0:19471:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff98f8fc2b3380) 00000020:00000080:0.0:1787384671.470881:0:19471:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787384671.516615:0:19471:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1787384671.519598:0:19471:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1787384671.520119:0:19471:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1787384671.520687:0:19471:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1787384671.522126:0:19471:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1787384671.522368:0:19471:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1787384671.522572:0:19471:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:0.0:1787384671.524155:0:19471:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787384671.525647:0:19471:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1787384671.525663:0:19471:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787384671.525675:0:19471:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7ef423838fba3c6e 00000020:01000004:0.0:1787384671.525681:0:19471:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1787384671.525710:0:19471:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.145@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787384671.525714:0:19471:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.145@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787384671.525720:0:19471:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1787384671.525760:0:19471:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1787384671.525765:0:19471:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.145@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787384671.544544:0:19471:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.145@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787384671.544585:0:19471:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.145@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1787384671.544589:0:19471:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787384671.544591:0:19471:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787384671.544592:0:19471:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787384671.544593:0:19471:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787384671.544594:0:19471:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787384671.544595:0:19471:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787384671.544597:0:19471:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787384671.544598:0:19471:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787384671.544600:0:19471:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787384671.544603:0:19471:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1787384671.544605:0:19471:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787384671.544606:0:19471:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787384671.544607:0:19471:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787384671.544609:0:19471:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787384671.544610:0:19471:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787384671.544611:0:19471:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787384671.544612:0:19471:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787384671.544613:0:19471:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787384671.544614:0:19471:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787384671.544643:0:19471:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787384671.544663:0:19471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:19471:1874208203406976:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787384671.544729:0:19471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384671.544872:0:19471:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fd1eba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787384671.544965:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203406976 00000100:00100000:1.0:1787384671.544973:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203406976 00000100:00100000:1.0:1787384671.545082:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787384671.545092:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c370e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+21:19471:x1874208203406976:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787384671.545130:0:17142:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787384671.545133:0:17142:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1787384671.545137:0:17142:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787384671.545600:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c370e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+21:19471:x1874208203406976:12345-0@lo:253:mount.lustre.0 Request processed in 508us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384671.545618:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787384671.545691:0:19471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:19471:1874208203406976:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787384671.545701:0:19471:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787384671.545703:0:19471:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787384671.545704:0:19471:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787384671.545706:0:19471:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787384671.545707:0:19471:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787384671.545708:0:19471:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787384671.545709:0:19471:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787384671.545711:0:19471:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787384671.545712:0:19471:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787384671.545714:0:19471:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787384671.545731:0:19471:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98f8ee0ca000 from lustre-OST0001 10000000:01000000:0.0:1787384671.545755:0:19471:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787384671.545758:0:19471:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787384671.545766:0:19471:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98f8f1813380 local copy 00010000:00010000:0.0:1787384671.545775:0:19471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8c6141a00/0x7ef423838fba38c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba38cb expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384671.545897:0:19471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:19471:1874208203407104:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787384671.545929:0:19471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384671.546099:0:19471:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fd1eb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384671.546174:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203407104 00000100:00100000:2.0:1787384671.546179:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203407104 00000100:00100000:2.0:1787384671.546208:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787384671.546215:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c370f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+21:19471:x1874208203407104:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787384671.546286:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c370f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+21:19471:x1874208203407104:12345-0@lo:501:mount.lustre.0 Request processed in 72us (356us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787384671.546294:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787384671.546384:0:19471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:19471:1874208203407104:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787384671.546397:0:19471:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.145@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787384671.546416:0:19471:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.145@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787384671.546422:0:19471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8c6141a00/0x7ef423838fba38c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba38cb expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384671.546431:0:19471:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8c6141a00/0x7ef423838fba38c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba38cb expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384671.546465:0:19471:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98f8ee0ca000 10000000:01000000:0.0:1787384671.546470:0:19471:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787384671.546474:0:19471:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787384671.546478:0:19471:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787384671.546481:0:19471:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787384671.546484:0:19471:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787384671.546505:0:19471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8c6141e00/0x7ef423838fba3c75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384671.546513:0:19471:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8c6141e00/0x7ef423838fba3c75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384671.546522:0:19471:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8c6141e00/0x7ef423838fba3c75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384671.546534:0:19471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:19471:1874208203407232:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787384671.546559:0:19471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384671.546581:0:19471:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fd1eb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384671.546627:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203407232 00000100:00100000:2.0:1787384671.546631:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203407232 00000100:00100000:2.0:1787384671.546649:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787384671.546655:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+21:19471:x1874208203407232:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787384671.546663:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384671.546675:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c2091600/0x7ef423838fba3c7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba3c75 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384671.546693:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c2091600/0x7ef423838fba3c7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba3c75 expref: 22 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384671.546723:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c2091600/0x7ef423838fba3c7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba3c75 expref: 22 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384671.546732:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2091600, rc 0) 00000100:00100000:2.0:1787384671.546769:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+22:19471:x1874208203407232:12345-0@lo:101:mount.lustre.0 Request processed in 113us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384671.546775:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787384671.546932:0:19471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:19471:1874208203407232:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787384671.546943:0:19471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8c6141e00/0x7ef423838fba3c75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3c7c expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384671.546953:0:19471:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8c6141e00/0x7ef423838fba3c75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba3c7c expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787384671.547757:0:19471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787384671.548447:0:19471:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787384671.551313:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787384671.551370:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787384671.551385:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787384671.551398:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787384671.551411:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787384671.551423:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787384671.551444:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787384671.551448:0:19471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787384671.551555:0:19471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:19471:1874208203407360:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787384671.551620:0:19471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384671.551713:0:19471:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c7fdf180 going to sleep for 11 seconds 00000100:00100000:1.0:1787384671.551768:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203407360 00000100:00100000:1.0:1787384671.551775:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203407360 00000100:00100000:1.0:1787384671.552101:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787384671.552111:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+22:19471:x1874208203407360:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787384671.552286:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+22:19471:x1874208203407360:12345-0@lo:501:mount.lustre.0 Request processed in 175us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384671.552294:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787384671.552414:0:19471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:19471:1874208203407360:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787384671.552527:0:19471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e68700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:19471:1874208203407488:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787384671.552585:0:19471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384671.552618:0:19471:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3948180 going to sleep for 11 seconds 00000100:00100000:2.0:1787384671.552647:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203407488 00000100:00100000:2.0:1787384671.552653:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203407488 00000100:00100000:2.0:1787384671.552687:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787384671.552695:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+22:19471:x1874208203407488:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787384671.553688:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+22:19471:x1874208203407488:12345-0@lo:503:mount.lustre.0 Request processed in 990us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384671.553697:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787384671.553908:0:19471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e68700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:19471:1874208203407488:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787384671.555338:0:19471:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787384671.555456:0:19471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e68700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:19471:1874208203407616:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787384671.555520:0:19471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384671.555562:0:19471:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3948180 going to sleep for 11 seconds 00000100:00100000:1.0:1787384671.555621:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203407616 00000100:00100000:1.0:1787384671.555627:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203407616 00000100:00100000:1.0:1787384671.555675:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787384671.555684:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+22:19471:x1874208203407616:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787384671.557002:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+22:19471:x1874208203407616:12345-0@lo:502:mount.lustre.0 Request processed in 1313us (1476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384671.557022:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787384671.557028:0:19471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e68700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:19471:1874208203407616:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787384671.557282:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1787384671.557318:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1787384671.557333:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1787384671.557346:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1787384671.557359:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1787384671.557372:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787384671.557385:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787384671.557399:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787384671.557412:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1787384671.557442:0:19471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e68700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:19471:1874208203407744:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787384671.557485:0:19471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384671.557522:0:19471:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3948180 going to sleep for 11 seconds 00000100:00100000:2.0:1787384671.557582:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203407744 00000100:00100000:2.0:1787384671.557589:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203407744 00000100:00100000:2.0:1787384671.557636:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787384671.557643:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+22:19471:x1874208203407744:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787384671.557735:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+22:19471:x1874208203407744:12345-0@lo:502:mount.lustre.0 Request processed in 91us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384671.557742:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787384671.557925:0:19471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e68700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:19471:1874208203407744:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787384671.557966:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1787384671.557975:0:19471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1787384671.558600:0:19475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787384671.558608:0:19475:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1787384671.558622:0:19475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384671.558625:0:19475:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787384671.558632:0:19475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787384671.558646:0:19475:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff98f8f968cd40) 00000020:00000080:1.0:1787384671.558671:0:19475:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787384671.558677:0:19475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787384671.558761:0:19475:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f8ee0ca000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787384671.558770:0:19475:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787384671.558999:0:19475:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7ef423838fba3c8a 00010000:00010000:1.0:1787384671.563510:0:19475:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1787384671.564109:0:19475:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1787384671.565917:0:19475:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1787384671.567323:0:19475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787384671.567335:0:19475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384671.567348:0:19475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384671.567401:0:19475:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787384671.567406:0:19475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787384671.567411:0:19475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384671.567413:0:19475:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787384671.567415:0:19475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787384671.567417:0:19475:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787384671.567419:0:19475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384671.567422:0:19475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384671.567423:0:19475:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787384671.567425:0:19475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787384671.567427:0:19475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384671.567428:0:19475:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787384671.567431:0:19475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787384671.567456:0:19475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384671.567459:0:19475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384671.567461:0:19475:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787384671.567463:0:19475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1787384671.567643:0:19471:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1787384671.567672:0:19471:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787384671.567720:0:19471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8c6141e00/0x7ef423838fba3c75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3c7c expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384671.567731:0:19471:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8c6141e00/0x7ef423838fba3c75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3c7c expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384671.567749:0:19471:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98f8ee0ca000 from 1 10000000:01000000:3.0:1787384671.567752:0:19471:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787384671.567802:0:19471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cd400/0x7ef423838fba3c91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384671.567811:0:19471:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8f58cd400/0x7ef423838fba3c91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384671.567822:0:19471:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8f58cd400/0x7ef423838fba3c91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384671.567846:0:19471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e68700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:19471:1874208203407872:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787384671.567909:0:19471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384671.567953:0:19471:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3948180 going to sleep for 11 seconds 00000100:00100000:0.0:1787384671.568108:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203407872 00000100:00100000:0.0:1787384671.568115:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203407872 00000100:00100000:0.0:1787384671.568161:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787384671.568170:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd620c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+22:19471:x1874208203407872:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787384671.568187:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384671.568199:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8c6140a00/0x7ef423838fba3c98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba3c91 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384671.568226:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8c6140a00/0x7ef423838fba3c98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba3c91 expref: 23 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384671.568236:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8c6140a00/0x7ef423838fba3c98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba3c91 expref: 23 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384671.568245:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6140a00, rc 0) 00000100:00100000:0.0:1787384671.568291:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd620c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+23:19471:x1874208203407872:12345-0@lo:101:mount.lustre.0 Request processed in 122us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384671.568299:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787384671.568543:0:19471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e68700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:19471:1874208203407872:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787384671.568558:0:19471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8f58cd400/0x7ef423838fba3c91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3c98 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384671.568568:0:19471:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8f58cd400/0x7ef423838fba3c91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba3c98 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787384671.570547:0:19471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787384671.571875:0:19471:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787384671.572073:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787384671.572098:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787384671.572114:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787384671.572119:0:19471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787384671.572195:0:19471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e68700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:19471:1874208203408000:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787384671.572259:0:19471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384671.572295:0:19471:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c39486c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384671.572402:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203408000 00000100:00100000:2.0:1787384671.572409:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203408000 00000100:00100000:2.0:1787384671.572446:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787384671.572454:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+23:19471:x1874208203408000:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787384671.572558:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+23:19471:x1874208203408000:12345-0@lo:501:mount.lustre.0 Request processed in 104us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384671.572566:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787384671.573280:0:19471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e68700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:19471:1874208203408000:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787384671.573317:0:19471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e68700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:19471:1874208203408128:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787384671.573577:0:19471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384671.573611:0:19471:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c39486c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384671.574037:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203408128 00000100:00100000:0.0:1787384671.574053:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203408128 00000100:00100000:0.0:1787384671.574100:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787384671.574109:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+23:19471:x1874208203408128:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787384671.574208:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+23:19471:x1874208203408128:12345-0@lo:503:mount.lustre.0 Request processed in 100us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384671.574215:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787384671.574346:0:19471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e68700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:19471:1874208203408128:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787384671.575002:0:19471:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787384671.575137:0:19471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e68700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:19471:1874208203408256:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787384671.575184:0:19471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384671.575217:0:19471:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3948180 going to sleep for 11 seconds 00000100:00100000:1.0:1787384671.575343:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203408256 00000100:00100000:1.0:1787384671.575348:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203408256 00000100:00100000:1.0:1787384671.575385:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787384671.575393:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd621c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+23:19471:x1874208203408256:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787384671.575487:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd621c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+23:19471:x1874208203408256:12345-0@lo:502:mount.lustre.0 Request processed in 94us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384671.575495:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787384671.575565:0:19471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e68700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:19471:1874208203408256:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787384671.575727:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787384671.575755:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787384671.575770:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787384671.575863:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787384671.575880:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787384671.575908:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787384671.575923:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787384671.575936:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1787384671.575951:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787384671.575966:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1787384671.575980:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1787384671.576004:0:19471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e68700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:19471:1874208203408384:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787384671.576040:0:19471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384671.576075:0:19471:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3948180 going to sleep for 11 seconds 00000100:00100000:2.0:1787384671.576210:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203408384 00000100:00100000:2.0:1787384671.576215:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203408384 00000100:00100000:2.0:1787384671.576246:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787384671.576255:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd622450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+23:19471:x1874208203408384:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787384671.576349:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd622450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+23:19471:x1874208203408384:12345-0@lo:502:mount.lustre.0 Request processed in 96us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384671.576356:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787384671.576541:0:19471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e68700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:19471:1874208203408384:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787384671.576585:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1787384671.576594:0:19471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1787384671.579084:0:19479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787384671.579095:0:19479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384671.579097:0:19479:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787384671.579104:0:19479:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f8ee0ca000 00000020:00000080:0.0:1787384671.579106:0:19479:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787384671.579113:0:19479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384671.579128:0:19479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384671.579129:0:19479:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787384671.579132:0:19479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787384671.579134:0:19479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384671.579135:0:19479:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787384671.579138:0:19479:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98f8ee0ca000 00000020:00000080:0.0:1787384671.579140:0:19479:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787384671.579201:0:19479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384671.579204:0:19479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384671.579206:0:19479:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787384671.579208:0:19479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787384671.579210:0:19479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384671.579212:0:19479:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787384671.579215:0:19479:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f8ee0ca000 00000020:00000080:0.0:1787384671.579218:0:19479:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787384671.579237:0:19479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384671.579240:0:19479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384671.579241:0:19479:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787384671.579244:0:19479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787384671.579246:0:19479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384671.579247:0:19479:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787384671.579250:0:19479:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98f8ee0ca000 00000020:00000080:0.0:1787384671.579252:0:19479:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787384671.579275:0:19479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384671.579278:0:19479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384671.579279:0:19479:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787384671.579282:0:19479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1787384671.579549:0:19471:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787384671.579575:0:19471:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787384671.579596:0:19471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cd400/0x7ef423838fba3c91 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3c98 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384671.579607:0:19471:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8f58cd400/0x7ef423838fba3c91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3c98 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384671.579653:0:19471:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787384671.579656:0:19471:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98f8ee0ca000 10000000:01000000:3.0:1787384671.579659:0:19471:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98f8ee0ca000 10000000:01000000:3.0:1787384671.579663:0:19471:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787384671.579668:0:19471:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff98f8ee0ca000 from 1 10000000:01000000:3.0:1787384671.579671:0:19471:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787384671.579704:0:19471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cca00/0x7ef423838fba3c9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384671.579713:0:19471:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8f58cca00/0x7ef423838fba3c9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384671.579724:0:19471:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8f58cca00/0x7ef423838fba3c9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384671.579745:0:19471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e68700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:19471:1874208203408512:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787384671.579848:0:19471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384671.579884:0:19471:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c39486c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384671.579971:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203408512 00000100:00100000:0.0:1787384671.579978:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203408512 00000100:00100000:0.0:1787384671.580068:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787384671.580078:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+23:19471:x1874208203408512:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787384671.580090:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384671.580107:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8c6141600/0x7ef423838fba3ca6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba3c9f expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384671.580127:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8c6141600/0x7ef423838fba3ca6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba3c9f expref: 24 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384671.580137:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8c6141600/0x7ef423838fba3ca6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba3c9f expref: 24 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384671.580145:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6141600, rc 0) 00000100:00100000:0.0:1787384671.580190:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+24:19471:x1874208203408512:12345-0@lo:101:mount.lustre.0 Request processed in 114us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384671.580197:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787384671.580269:0:19471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e68700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:19471:1874208203408512:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787384671.580289:0:19471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8f58cca00/0x7ef423838fba3c9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3ca6 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384671.580298:0:19471:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8f58cca00/0x7ef423838fba3c9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba3ca6 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787384671.585463:0:19471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:0.0:1787384671.585769:0:19471:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787384671.587193:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787384671.587232:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787384671.587245:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787384671.587256:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787384671.587268:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787384671.587293:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787384671.587307:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787384671.587320:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787384671.587331:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787384671.587343:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787384671.587354:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787384671.587365:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787384671.587377:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787384671.587389:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787384671.587402:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787384671.587414:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787384671.587425:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787384671.587446:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787384671.587458:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787384671.587469:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787384671.587480:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787384671.587502:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787384671.587515:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787384671.587528:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787384671.587540:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1787384671.587552:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1787384671.587563:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1787384671.587575:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1787384671.587587:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1787384671.587598:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1787384671.587610:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1787384671.587621:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1787384671.587633:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1787384671.587645:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1787384671.587656:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1787384671.587668:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1787384671.587679:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1787384671.587703:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1787384671.587716:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:0.0:1787384671.587728:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:0.0:1787384671.587739:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:0.0:1787384671.587751:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:0.0:1787384671.587763:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:0.0:1787384671.587774:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:0.0:1787384671.587808:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:0.0:1787384671.587820:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:0.0:1787384671.587844:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:0.0:1787384671.587849:0:19471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:0.0:1787384671.587950:0:19471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:19471:1874208203408640:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787384671.588023:0:19471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384671.588080:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203408640 00000100:00100000:0.0:1787384671.588087:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203408640 00000100:00100000:0.0:1787384671.588131:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787384671.588139:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+24:19471:x1874208203408640:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787384671.588243:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+24:19471:x1874208203408640:12345-0@lo:501:mount.lustre.0 Request processed in 104us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384671.588251:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787384671.588291:0:19471:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fd1eba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787384671.588312:0:19471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:19471:1874208203408640:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787384671.588342:0:19471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:19471:1874208203408768:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787384671.588377:0:19471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384671.588391:0:19471:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fd1eba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787384671.588407:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203408768 00000100:00100000:0.0:1787384671.588411:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203408768 00000100:00100000:0.0:1787384671.588432:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787384671.588438:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+24:19471:x1874208203408768:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787384671.588508:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+24:19471:x1874208203408768:12345-0@lo:503:mount.lustre.0 Request processed in 68us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384671.588515:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787384671.588556:0:19471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:19471:1874208203408768:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787384671.588914:0:19471:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787384671.588969:0:19471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:19471:1874208203408896:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787384671.589004:0:19471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384671.589026:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203408896 00000100:00100000:0.0:1787384671.589034:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203408896 00000100:00100000:0.0:1787384671.589072:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787384671.589078:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+24:19471:x1874208203408896:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787384671.589146:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+24:19471:x1874208203408896:12345-0@lo:502:mount.lustre.0 Request processed in 67us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384671.589152:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787384671.589188:0:19471:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fd1eba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787384671.589202:0:19471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:19471:1874208203408896:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787384671.589343:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787384671.589367:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787384671.589382:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787384671.589395:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787384671.589422:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787384671.589437:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787384671.589450:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787384671.589464:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787384671.589478:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787384671.589492:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787384671.589506:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787384671.589518:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787384671.589530:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787384671.589541:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787384671.589555:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787384671.589568:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787384671.589582:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787384671.589596:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787384671.589609:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787384671.589623:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787384671.589644:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787384671.589657:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787384671.589674:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787384671.589687:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787384671.589699:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1787384671.589710:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1787384671.589722:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1787384671.589735:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1787384671.589748:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1787384671.589761:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1787384671.589773:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1787384671.589838:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1787384671.589852:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1787384671.589865:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1787384671.589877:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1787384671.589889:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1787384671.589914:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1787384671.589928:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1787384671.589939:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1787384671.589951:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1787384671.589962:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1787384671.589974:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1787384671.589986:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1787384671.589997:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1787384671.590008:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1787384671.590019:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1787384671.590030:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1787384671.593123:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1787384671.593212:0:19471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:19471:1874208203409024:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787384671.593285:0:19471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384671.593322:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203409024 00000100:00100000:0.0:1787384671.593329:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203409024 00000100:00100000:0.0:1787384671.593381:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787384671.593391:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+24:19471:x1874208203409024:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787384671.593506:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+24:19471:x1874208203409024:12345-0@lo:502:mount.lustre.0 Request processed in 116us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384671.593514:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787384671.593566:0:19471:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c2956780 going to sleep for 11 seconds 00000100:00100000:0.0:1787384671.593587:0:19471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:19471:1874208203409024:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787384671.593734:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1787384671.593756:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1787384671.593775:0:19471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:19471:1874208203409152:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787384671.593860:0:19471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384671.593886:0:19471:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fd1eb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384671.594073:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203409152 00000100:00100000:1.0:1787384671.594078:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203409152 00000100:00100000:1.0:1787384671.594110:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787384671.594117:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+24:19471:x1874208203409152:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787384671.594200:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+24:19471:x1874208203409152:12345-0@lo:502:mount.lustre.0 Request processed in 83us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384671.594215:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787384671.594689:0:19471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:19471:1874208203409152:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787384671.594744:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1787384671.594754:0:19471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1787384671.596262:0:19484:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787384671.596277:0:19484:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff98f8fc2b19c0) 00000020:00000080:0.0:1787384671.596301:0:19484:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1787384671.596467:0:19484:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f8ee0ca000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787384671.596471:0:19484:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f8ee0ca000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787384671.596473:0:19484:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f8ee0ca000 3 00010000:00080000:0.0:1787384671.596502:0:19484:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f7c236d800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.145@tcp at head 00010000:00010000:0.0:1787384671.598075:0:19484:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1787384671.598170:0:19484:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787384671.598208:0:19484:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787384671.598221:0:19484:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x7ef423838fba3cb4 00000100:00080000:0.0:1787384671.598232:0:19484:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787384671.598237:0:19484:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98f7c236d800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:0.0:1787384671.598283:0:19484:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f7c3a82680 x1874208203409280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787384671.598312:0:19484:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787384671.598467:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787384671.598472:0:16239:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787384671.598475:0:16239:0:(import.c:65:import_set_state_nolock()) ffff98f8f9135000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787384671.598479:0:16239:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 565 00000100:00080000:1.0:1787384671.598482:0:16239:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1787384671.598482:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203409408:0@lo:400:kworker.0 00000100:00080000:1.0:1787384671.598485:0:16239:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98f8f9135000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:1.0:1787384671.598497:0:16239:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8ee288000 x1874208203409664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787384671.598526:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787384671.598529:0:16239:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787384671.598530:0:16239:0:(import.c:65:import_set_state_nolock()) ffff98f8f919a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787384671.598533:0:16239:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 565 00000100:00080000:1.0:1787384671.598535:0:16239:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787384671.598538:0:16239:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98f8f919a800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:0.0:1787384671.598543:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384671.598546:0:16239:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8ee289880 x1874208203410176/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787384671.598575:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203410048:0@lo:400:kworker.0 00000100:00100000:1.0:1787384671.598580:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee28aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203409536:0@lo:400:kworker.0 00000100:00100000:0.0:1787384671.598599:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384671.598605:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203409792:0@lo:400:kworker.0 00000100:00100000:1.0:1787384671.598629:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384671.598631:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203409408 00000100:00100000:0.0:1787384671.598637:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203409408 00000100:00100000:1.0:1787384671.598648:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203410432:0@lo:400:kworker.0 00000100:00100000:1.0:1787384671.598666:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384671.598682:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787384671.598683:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787384671.598690:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203409408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384671.598693:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203409920:0@lo:400:kworker.0 00000100:00100000:1.0:1787384671.598712:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384671.598722:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203410560:0@lo:400:kworker.0 00000100:00100000:0.0:1787384671.598735:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203409408:12345-0@lo:400:kworker.0 Request processed in 45us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384671.598738:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384671.598742:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787384671.598754:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203409920 00000100:00100000:0.0:1787384671.598757:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203409920 00000100:00100000:1.0:1787384671.598761:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203409792 00000100:00100000:1.0:1787384671.598764:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203409792 00000100:00100000:0.0:1787384671.598771:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787384671.598775:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203409920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384671.598814:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203410432 00000100:00100000:1.0:1787384671.598816:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203410432 00000100:00100000:1.0:1787384671.598828:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203410560 00000100:00100000:1.0:1787384671.598831:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203410560 00000100:00100000:1.0:1787384671.598844:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787384671.598844:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203409920:12345-0@lo:400:kworker.0 Request processed in 68us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384671.598849:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f9149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203409792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384671.598850:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787384671.598867:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203410048 00000100:00100000:0.0:1787384671.598870:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203410048 00000100:00100000:1.0:1787384671.598877:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f9149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874208203409792:12345-0@lo:400:kworker.0 Request processed in 28us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384671.598883:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787384671.598891:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787384671.598894:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787384671.598896:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203410048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384671.598899:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203410432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384671.598921:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203410432:12345-0@lo:400:kworker.0 Request processed in 22us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384671.598922:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203410048:12345-0@lo:400:kworker.0 Request processed in 25us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384671.598927:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787384671.598935:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787384671.598937:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787384671.598942:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203410560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384671.598957:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384671.598966:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203410560:12345-0@lo:400:kworker.0 Request processed in 24us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384671.598972:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787384671.598975:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee28b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874208203410304:0@lo:400:kworker.0 00000100:00100000:0.0:1787384671.598997:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384671.599018:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203410304 00000100:00100000:0.0:1787384671.599018:0:19186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203409536 00000100:00100000:1.0:1787384671.599021:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203410304 00000100:00100000:0.0:1787384671.599021:0:19186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203409536 00000100:00100000:1.0:1787384671.599055:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787384671.599056:0:19186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787384671.599061:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874208203410304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384671.599062:0:19186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203409536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384671.599093:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874208203410304:12345-0@lo:400:kworker.0 Request processed in 33us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384671.599095:0:19186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203409536:12345-0@lo:400:kworker.0 Request processed in 34us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384671.599099:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787384671.599100:0:19186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787384671.599131:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee28aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203409536:0@lo:400:kworker.0 00000100:00100000:0.0:1787384671.599131:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203410048:0@lo:400:kworker.0 00000100:00100000:0.0:1787384671.599140:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203409408:0@lo:400:kworker.0 00010000:00080000:1.0:1787384671.599142:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8ee28b480 x1874208203410304/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384671.599149:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee28b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874208203410304:0@lo:400:kworker.0 00000100:00100000:0.0:1787384671.599164:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203409920:0@lo:400:kworker.0 00010000:00080000:0.0:1787384671.599176:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8f914b480 x1874208203410560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384671.599184:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203410560:0@lo:400:kworker.0 00010000:00080000:0.0:1787384671.599193:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8ee28ad80 x1874208203409792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384671.599201:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874208203409792:0@lo:400:kworker.0 00010000:00080000:0.0:1787384671.599209:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f8ee28bb80 x1874208203410432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384671.599216:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203410432:0@lo:400:kworker.0 00000100:00100000:2.0:1787384671.601000:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874208203409280:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787384671.601080:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384671.601117:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203409664:0@lo:8:kworker.0 00000100:00100000:2.0:1787384671.601165:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384671.601195:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203410176:0@lo:8:kworker.0 00000100:00100000:2.0:1787384671.601216:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384671.601412:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203409280 00000100:00100000:1.0:1787384671.601419:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203409280 00000100:00100000:1.0:1787384671.601455:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787384671.601462:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1874208203409280:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787384671.601489:0:17152:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 566 last 0 00000020:00000080:1.0:1787384671.601522:0:17152:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x7ef423838fba3cbb 00000004:00100000:1.0:1787384671.601536:0:17152:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787384671.601566:0:17152:0:(import.c:65:import_set_state_nolock()) ffff98f8f569d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787384671.601616:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874208203409280:12345-0@lo:38:llog_process_th.0 Request processed in 153us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384671.601623:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787384671.601661:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f7c3a82680 x1874208203409280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787384681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384671.601670:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787384671.601677:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1787384671.601684:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787384671.601693:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787384671.601696:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f7c236d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787384671.601702:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874208203409280:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787384671.602117:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203409664 00000100:00100000:0.0:1787384671.602122:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203410176 00000100:00100000:3.0:1787384671.602123:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203409664 00000100:00100000:0.0:1787384671.602125:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203410176 00000100:00100000:0.0:1787384671.602159:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787384671.602165:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3650:x1874208203410176:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787384671.602213:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3650:x1874208203410176:12345-0@lo:8:kworker.0 Request processed in 47us (995us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787384671.602218:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787384671.602230:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787384671.602234:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3650:x1874208203409664:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787384671.602263:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3650:x1874208203409664:12345-0@lo:8:kworker.0 Request processed in 27us (1098us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787384671.602269:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787384671.602298:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787384671.602303:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f9135000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787384671.602307:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787384671.602310:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203409664:0@lo:8:kworker.0 00000100:00100000:1.0:1787384671.602320:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787384671.602323:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f919a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787384671.602326:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787384671.602329:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203410176:0@lo:8:kworker.0 00000020:01000004:1.0:1787384671.604269:0:19484:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787384671.604296:0:19484:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff98f7c211b380) 00000020:00000080:1.0:1787384671.604321:0:19484:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1787384671.604494:0:19484:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98f8ee0ca000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787384671.604498:0:19484:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98f8ee0ca000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787384671.604500:0:19484:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98f8ee0ca000 3 00010000:00080000:1.0:1787384671.604529:0:19484:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f7c40d5000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.145@tcp at head 00010000:00010000:3.0:1787384671.608376:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384671.611280:0:19484:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1787384671.611390:0:19484:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1787384671.611449:0:19484:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787384671.611470:0:19484:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x7ef423838fba3cc9 00000100:00080000:1.0:1787384671.611481:0:19484:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787384671.611487:0:19484:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff98f7c40d5000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:1.0:1787384671.611522:0:19484:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f8f914aa00 x1874208203410688/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787384671.611562:0:19484:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1787384671.611752:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3650:1874208203410688:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787384671.611834:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384671.611885:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203410688 00000100:00100000:0.0:1787384671.611891:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203410688 00000100:00100000:0.0:1787384671.611928:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787384671.611935:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3650:x1874208203410688:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787384671.611959:0:18681:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 566 last 0 00000020:00000080:0.0:1787384671.611991:0:18681:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x7ef423838fba3cd0 00000004:00100000:0.0:1787384671.612005:0:18681:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787384671.612035:0:18681:0:(import.c:65:import_set_state_nolock()) ffff98f7c236f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787384671.612093:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874208203410688:12345-0@lo:38:llog_process_th.0 Request processed in 157us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384671.612100:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787384671.612141:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f914aa00 x1874208203410688/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787384681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384671.612155:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787384671.612163:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1787384671.612170:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787384671.612173:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787384671.612176:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f7c40d5000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787384671.612183:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3650:1874208203410688:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1787384671.612919:0:19484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1787384671.613037:0:19471:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787384671.613078:0:19471:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787384671.613103:0:19471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cca00/0x7ef423838fba3c9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3ca6 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384671.613114:0:19471:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8f58cca00/0x7ef423838fba3c9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3ca6 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787384671.615441:0:19471:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787384671.615445:0:19471:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787384671.615447:0:19471:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787384671.615448:0:19471:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787384671.615449:0:19471:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787384671.615451:0:19471:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787384671.615453:0:19471:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787384671.615454:0:19471:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787384671.615455:0:19471:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787384671.615459:0:19471:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1787384671.615462:0:19471:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787384671.615464:0:19471:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787384671.615465:0:19471:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787384671.615466:0:19471:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787384671.615467:0:19471:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787384671.615468:0:19471:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787384671.615469:0:19471:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787384671.615470:0:19471:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787384671.615471:0:19471:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787384671.615499:0:19471:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787384671.615519:0:19471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a80700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:19471:1874208203410816:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787384671.615585:0:19471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384671.615629:0:19471:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fd1eb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384671.616149:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203410816 00000100:00100000:1.0:1787384671.616157:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203410816 00000100:00100000:1.0:1787384671.616211:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787384671.616220:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+24:19471:x1874208203410816:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787384671.616246:0:17142:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787384671.616261:0:17142:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787384671.626342:0:17142:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787384671.626362:0:17142:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787384671.626538:0:17166:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787384671.626543:0:17166:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787384671.626561:0:17166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98f8f58cd200/0x7ef423838fba3cd7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384671.626576:0:17166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f8c6141200/0x7ef423838fba3b87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba3b80 expref: 24 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384671.626581:0:17166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f7c3953000/0x7ef423838fba3b95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba3b8e expref: 24 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384671.626586:0:17166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98f8f58cd200/0x7ef423838fba3cd7 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384671.626618:0:17166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f7c3953000/0x7ef423838fba3b95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba3b8e expref: 24 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384671.626631:0:17166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f7c3953000/0x7ef423838fba3b95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba3b8e expref: 24 pid: 17142 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384671.626644:0:17166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e68700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1874208203410944:0@lo:104: 00000100:00100000:3.0:1787384671.626936:0:17166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787384671.627010:0:17166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f8c6141200/0x7ef423838fba3b87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba3b80 expref: 24 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384671.627021:0:17166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f8c6141200/0x7ef423838fba3b87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba3b80 expref: 24 pid: 17143 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384671.627031:0:17166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e6aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1874208203411072:0@lo:104: 00000100:00100000:2.0:1787384671.627037:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203410944 00000100:00100000:2.0:1787384671.627061:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203410944 00000100:00100000:3.0:1787384671.627069:0:17166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384671.627089:0:17166:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c3948840 going to sleep for 11 seconds 00000100:00100000:2.0:1787384671.627103:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203411072 00000100:00100000:2.0:1787384671.627108:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203411072 00000100:00100000:2.0:1787384671.627125:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787384671.627133:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:57899b24-a33b-4177-9883-79b5fe35053f+4:17166:x1874208203410944:12345-0@lo:104: 00010000:00010000:2.0:1787384671.627146:0:17134:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f902158200/0x7ef423838fba3b8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba3b95 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384671.627222:0:17134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787384671.627230:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:57899b24-a33b-4177-9883-79b5fe35053f+4:17166:x1874208203410944:12345-0@lo:104: Request processed in 97us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384671.627237:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787384671.627249:0:17166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e68700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1874208203410944:0@lo:104: 00000100:00100000:2.0:1787384671.627259:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787384671.627266:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:57899b24-a33b-4177-9883-79b5fe35053f+3:17166:x1874208203411072:12345-0@lo:104: 00010000:00010000:2.0:1787384671.627274:0:17134:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f7c3953200/0x7ef423838fba3b80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba3b87 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384671.627323:0:17134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787384671.627328:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:57899b24-a33b-4177-9883-79b5fe35053f+3:17166:x1874208203411072:12345-0@lo:104: Request processed in 63us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384671.627334:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1787384671.627348:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787384671.627353:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f902158200/0x7ef423838fba3b8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba3b95 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384671.627365:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f902158200 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384671.627371:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f902158200/0x7ef423838fba3b8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba3b95 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384671.627377:0:17166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e6aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1874208203411072:0@lo:104: 00010000:00010000:2.0:1787384671.627381:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f902158200/0x7ef423838fba3b8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba3b95 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384671.627381:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384671.627389:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f7c3953200/0x7ef423838fba3b80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba3b87 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384671.627392:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f902158200/0x7ef423838fba3b8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba3b95 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384671.627401:0:17166:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98f8f58cd200/0x7ef423838fba3cd7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384671.627403:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787384671.627414:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3953200 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:0.0:1787384671.627418:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f7c3953200/0x7ef423838fba3b80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba3b87 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384671.627426:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f7c3953200/0x7ef423838fba3b80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba3b87 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787384671.627433:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f7c3953200/0x7ef423838fba3b80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba3b87 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384671.627437:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f902158200/0x7ef423838fba3b8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba3b95 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384671.627440:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787384671.627450:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787384671.627475:0:17139:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f7c3953200/0x7ef423838fba3b80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba3b87 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384671.627480:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f902158200/0x7ef423838fba3b8e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba3b95 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384671.627487:0:17139:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787384671.627493:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f902158200/0x7ef423838fba3b8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba3b95 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384671.627499:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f7c3953200/0x7ef423838fba3b80 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba3b87 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384671.627516:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f7c3953200/0x7ef423838fba3b80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba3b87 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384671.627525:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384671.627528:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384671.627531:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384671.627535:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384671.627538:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384671.627542:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384671.627554:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57899b24-a33b-4177-9883-79b5fe35053f:3652:1874208203411328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787384671.627590:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384671.627613:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787384671.627620:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57899b24-a33b-4177-9883-79b5fe35053f:3652:1874208203411200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384671.627627:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203411328 00000100:00100000:0.0:1787384671.627633:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203411328 00000100:00100000:2.0:1787384671.627640:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787384671.627655:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f8c6141200/0x7ef423838fba3b87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba3b80 expref: 25 pid: 17143 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384671.627670:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203411200 00000100:00100000:2.0:1787384671.627675:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203411200 00000100:00100000:0.0:1787384671.627685:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1787384671.627691:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f7c3953000/0x7ef423838fba3b95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba3b8e expref: 26 pid: 17142 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384671.627703:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57899b24-a33b-4177-9883-79b5fe35053f+26:3652:x1874208203411328:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787384671.627710:0:17137:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:0.0:1787384671.627715:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787384671.627719:0:17137:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1787384671.627724:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f8c6141200/0x7ef423838fba3b87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba3b80 expref: 26 pid: 17143 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384671.627736:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f8c6141200/0x7ef423838fba3b87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba3b80 expref: 26 pid: 17143 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384671.627748:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8c6141200/0x7ef423838fba3b87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba3b80 expref: 26 pid: 17143 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384671.627760:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384671.627857:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787384671.627864:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57899b24-a33b-4177-9883-79b5fe35053f+25:3652:x1874208203411200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787384671.627872:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787384671.627872:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57899b24-a33b-4177-9883-79b5fe35053f+25:3652:x1874208203411328:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (288us total) trans 0 rc 0/0 00010000:00010000:2.0:1787384671.627880:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f7c3953000/0x7ef423838fba3b95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba3b8e expref: 25 pid: 17142 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384671.627885:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1787384671.627898:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f7c3953000/0x7ef423838fba3b95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba3b8e expref: 25 pid: 17142 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384671.627910:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f7c3953000/0x7ef423838fba3b95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba3b8e expref: 24 pid: 17142 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384671.627922:0:17137:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98f8f58cd200/0x7ef423838fba3cd7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384671.627925:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57899b24-a33b-4177-9883-79b5fe35053f:3652:1874208203411328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384671.629940:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+23:19471:x1874208203410816:12345-0@lo:253:mount.lustre.0 Request processed in 13713us (14346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384671.629952:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00010000:2.0:1787384671.630103:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f58cd200/0x7ef423838fba3cd7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787384671.630120:0:17137:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013318751s 00010000:00010000:2.0:1787384671.630125:0:17137:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f8f58cd200/0x7ef423838fba3cd7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384671.630132:0:17137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f8f58cd200/0x7ef423838fba3cd7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384671.630138:0:17137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98f8f58cd200/0x7ef423838fba3cd7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384671.630144:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98f8f58cd200/0x7ef423838fba3cd7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384671.630150:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cd200 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:2.0:1787384671.630154:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98f8f58cd200/0x7ef423838fba3cd7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384671.630163:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98f8f58cd200/0x7ef423838fba3cd7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384671.630268:0:19471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a80700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57899b24-a33b-4177-9883-79b5fe35053f:19471:1874208203410816:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787384671.630283:0:19471:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787384671.630286:0:19471:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787384671.630288:0:19471:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787384671.630289:0:19471:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787384671.630290:0:19471:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787384671.630291:0:19471:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787384671.630292:0:19471:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787384671.630293:0:19471:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787384671.630295:0:19471:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787384671.630296:0:19471:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787384671.630310:0:19471:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1787384671.630874:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98f8f58cd200/0x7ef423838fba3cd7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384671.630886:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384671.631096:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57899b24-a33b-4177-9883-79b5fe35053f+22:3652:x1874208203411200:12345-0@lo:103:ldlm_bl.0 Request processed in 3231us (3454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384671.631105:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787384671.631161:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57899b24-a33b-4177-9883-79b5fe35053f:3652:1874208203411200:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787384671.631288:0:17166:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98f8f58cd200/0x7ef423838fba3cd7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384671.631298:0:17166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98f8f58cd200/0x7ef423838fba3cd7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384671.631306:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f58cd200/0x7ef423838fba3cd7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1787384671.645979:0:19471:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787384671.654205:0:19471:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787384671.654215:0:19471:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787384671.654260:0:19471:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787384671.654305:0:19471:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.145@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787384671.654323:0:19471:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1787384671.654351:0:19471:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1787384671.658749:0:19471:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787384671.660441:0:19471:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787384671.686869:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203411456:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787384671.687014:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384671.688696:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203411456 00000100:00100000:1.0:1787384671.688707:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203411456 00000100:00100000:1.0:1787384671.688766:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787384671.689011:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203411456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787384671.689039:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787384671.689116:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203411456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 341us (2102us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384671.689133:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787384671.689543:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203411456:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787384672.183193:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203411584:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787384672.183261:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384672.183312:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787384672.183320:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f914aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203411712:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787384672.183348:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384672.183378:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203411584 00000100:00100000:1.0:1787384672.183381:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203411712 00000100:00100000:3.0:1787384672.183387:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203411584 00000100:00100000:1.0:1787384672.183387:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203411712 00000100:00100000:1.0:1787384672.183531:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787384672.183541:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203411712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787384672.183573:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787384672.183626:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203411712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384672.183632:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787384672.183703:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f914aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203411712:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787384672.184116:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787384672.184128:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203411584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787384672.184157:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787384672.184653:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203411584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 526us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384672.184662:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787384672.184714:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203411584:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787384672.633900:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787384672.741107:0:19539:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787384672.741644:0:19539:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:1.0:1787384673.080435:0:17904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1787384673.210707:0:17146:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787384673.210714:0:17146:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98f8f7d8f800 from 10 10000000:01000000:1.0:1787384673.210719:0:17146:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787384673.210822:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3952400/0x7ef423838fba3cde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384673.210833:0:17146:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f7c3952400/0x7ef423838fba3cde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384673.210844:0:17146:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f7c3952400/0x7ef423838fba3cde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384673.210905:0:17146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203411840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787384673.210976:0:17146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384673.211025:0:17146:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fd1eb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384673.211120:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203411840 00000100:00100000:0.0:1787384673.211127:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203411840 00000100:00100000:0.0:1787384673.211186:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787384673.211195:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+22:17146:x1874208203411840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787384673.211208:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384673.211222:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8c6140e00/0x7ef423838fba3ce5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba3cde expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384673.211245:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8c6140e00/0x7ef423838fba3ce5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba3cde expref: 23 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384673.211255:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8c6140e00/0x7ef423838fba3ce5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba3cde expref: 23 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384673.211265:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8c6140e00, rc 0) 00000100:00100000:0.0:1787384673.211311:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+23:17146:x1874208203411840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384673.211318:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787384673.211438:0:17146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203411840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787384673.211452:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f7c3952400/0x7ef423838fba3cde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3ce5 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384673.211460:0:17146:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f7c3952400/0x7ef423838fba3cde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba3ce5 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384673.211506:0:17146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203411968:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787384673.211533:0:17146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384673.211557:0:17146:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fd1eb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384673.211603:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203411968 00000100:00100000:0.0:1787384673.211607:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203411968 00000100:00100000:0.0:1787384673.211634:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787384673.211640:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd592c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+23:17146:x1874208203411968:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787384673.211651:0:17142:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787384673.211666:0:17142:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787384673.211669:0:17142:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1787384673.211740:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd592c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+23:17146:x1874208203411968:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 99us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384673.211747:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787384673.211816:0:17146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203411968:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787384673.211884:0:17146:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787384673.211890:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3952400/0x7ef423838fba3cde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3ce5 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384673.211898:0:17146:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f7c3952400/0x7ef423838fba3cde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3ce5 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384673.211905:0:17146:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787384673.211907:0:17146:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff98f8f7d47800 from 10 10000000:01000000:2.0:1787384673.211909:0:17146:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787384673.211924:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c2091800/0x7ef423838fba3cec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384673.211931:0:17146:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f7c2091800/0x7ef423838fba3cec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384673.211938:0:17146:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f7c2091800/0x7ef423838fba3cec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384673.211950:0:17146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35da680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203412096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787384673.211974:0:17146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384673.212001:0:17146:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c6361840 going to sleep for 11 seconds 00000100:00100000:1.0:1787384673.212051:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203412096 00000100:00100000:1.0:1787384673.212055:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203412096 00000100:00100000:1.0:1787384673.212083:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787384673.212089:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+23:17146:x1874208203412096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787384673.212096:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384673.212104:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c3953000/0x7ef423838fba3cf3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba3cec expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384673.212117:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c3953000/0x7ef423838fba3cf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba3cec expref: 24 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384673.212125:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c3953000/0x7ef423838fba3cf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba3cec expref: 24 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384673.212142:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3953000, rc 0) 00000100:00100000:1.0:1787384673.212166:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+24:17146:x1874208203412096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384673.212172:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787384673.212232:0:17146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35da680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203412096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787384673.212241:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f7c2091800/0x7ef423838fba3cec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3cf3 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384673.212253:0:17146:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f7c2091800/0x7ef423838fba3cec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba3cf3 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384673.212285:0:17146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35da680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203412224:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787384673.212307:0:17146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384673.212325:0:17146:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c6361840 going to sleep for 11 seconds 00000100:00100000:0.0:1787384673.212368:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203412224 00000100:00100000:0.0:1787384673.212372:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203412224 00000100:00100000:0.0:1787384673.212397:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787384673.212403:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+24:17146:x1874208203412224:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787384673.212412:0:17143:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787384673.212422:0:17143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787384673.212425:0:17143:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1787384673.212477:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+24:17146:x1874208203412224:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 73us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384673.212483:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787384673.212506:0:17146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35da680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203412224:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787384673.212539:0:17146:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787384673.212543:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c2091800/0x7ef423838fba3cec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3cf3 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384673.212551:0:17146:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f7c2091800/0x7ef423838fba3cec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3cf3 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384673.657407:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384674.679055:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384675.703311:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384675.770367:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787384675.770390:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203412352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787384675.770481:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384675.770761:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203412352 00000100:00100000:1.0:1787384675.770770:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203412352 00000100:00080000:2.0:1787384675.770827:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787384675.770871:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787384675.776423:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203412352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787384675.776464:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787384675.776555:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203412352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (6075us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384675.776565:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787384675.776688:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203412352:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787384676.727358:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787384676.791423:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787384676.791430:0:16239:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787384676.791434:0:16239:0:(import.c:65:import_set_state_nolock()) ffff98f8f9135000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787384676.791447:0:16239:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98f8f9135000 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:3.0:1787384676.791469:0:16239:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f7c40dc700 x1874208203412864/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787384676.791502:0:16239:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787384676.791505:0:16239:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787384676.791506:0:16239:0:(import.c:65:import_set_state_nolock()) ffff98f8f919a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787384676.791511:0:16239:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff98f8f919a800 using connection 192.168.203.145@tcp/0@lo 00000100:00100000:3.0:1787384676.791520:0:16239:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f7c40de300 x1874208203413376/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787384676.791571:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203412608:0@lo:400:kworker.0 00000100:00100000:3.0:1787384676.791678:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384676.791726:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203413248:0@lo:400:kworker.0 00000100:00100000:3.0:1787384676.791750:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384676.791766:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874208203413888:0@lo:400:kworker.0 00000100:00100000:3.0:1787384676.791832:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384676.791856:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787384676.791871:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f91d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57899b24-a33b-4177-9883-79b5fe35053f:3654:1874208203412480:0@lo:400:kworker.0 00000100:00100000:3.0:1787384676.791897:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384676.791919:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203413120:0@lo:400:kworker.0 00000100:00100000:3.0:1787384676.791937:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384676.791951:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874208203413760:0@lo:400:kworker.0 00000100:00100000:3.0:1787384676.791970:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384676.791993:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203412736:0@lo:400:kworker.0 00000100:00100000:3.0:1787384676.792027:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384676.792043:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203413504:0@lo:400:kworker.0 00000100:00100000:3.0:1787384676.792061:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384676.792075:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203414016:0@lo:400:kworker.0 00000100:00100000:3.0:1787384676.792109:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384676.792125:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787384676.792130:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203412992:0@lo:400:kworker.0 00000100:00100000:3.0:1787384676.792925:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384676.792976:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203413632:0@lo:400:kworker.0 00000100:00100000:3.0:1787384676.793004:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384676.793045:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203412864:0@lo:8:kworker.0 00000100:00100000:3.0:1787384676.793068:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384676.793089:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203413376:0@lo:8:kworker.0 00000100:00100000:3.0:1787384676.793106:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384676.793205:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203412608 00000100:00100000:3.0:1787384676.793213:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203412608 00000100:00100000:3.0:1787384676.793251:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203413120 00000100:00100000:3.0:1787384676.793253:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203413120 00000100:00100000:3.0:1787384676.793278:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787384676.793285:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203412608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384676.793341:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203412608:12345-0@lo:400:kworker.0 Request processed in 55us (1662us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384676.793348:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787384676.793365:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787384676.793371:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203413120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384676.793396:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203413120:12345-0@lo:400:kworker.0 Request processed in 26us (1458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384676.793401:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787384676.793418:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203413248 00000100:00100000:3.0:1787384676.793422:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203413248 00000100:00100000:3.0:1787384676.793448:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203412736 00000100:00100000:3.0:1787384676.793452:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203412736 00000100:00100000:3.0:1787384676.793461:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203412864 00000100:00100000:3.0:1787384676.793463:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203412864 00000100:00100000:3.0:1787384676.793472:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203413376 00000100:00100000:3.0:1787384676.793474:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203413376 00000100:00100000:3.0:1787384676.793482:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787384676.793488:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203413248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384676.793516:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203413248:12345-0@lo:400:kworker.0 Request processed in 28us (1765us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384676.793522:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787384676.793531:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787384676.793537:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203412736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384676.793564:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203412736:12345-0@lo:400:kworker.0 Request processed in 28us (1537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384676.793570:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787384676.793589:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787384676.793593:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd758380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3650:x1874208203412864:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787384676.793619:0:18656:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 571 last 0 00000020:00000080:3.0:1787384676.793645:0:18656:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7ef423838fba3cfa 00002000:00100000:3.0:1787384676.793658:0:18656:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff98f7c3a3e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113671 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787384676.793662:0:18656:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1787384676.793664:0:18656:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787384676.793843:0:18656:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787384676.793866:0:18656:0:(import.c:65:import_set_state_nolock()) ffff98f7c3a39800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787384676.793902:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd758380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1874208203412864:12345-0@lo:8:kworker.0 Request processed in 307us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384676.793909:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787384676.793921:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787384676.793925:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd75bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3650:x1874208203413376:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787384676.793939:0:18656:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 571 last 0 00000020:00000080:3.0:1787384676.793953:0:18656:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7ef423838fba3d01 00002000:00100000:3.0:1787384676.793959:0:18656:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff98f7c3a3d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113671 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1787384676.793962:0:18656:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1787384676.793963:0:18656:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787384676.793985:0:18656:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1787384676.793997:0:18656:0:(import.c:65:import_set_state_nolock()) ffff98f7c3a3a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787384676.794037:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd75bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1874208203413376:12345-0@lo:8:kworker.0 Request processed in 110us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384676.794043:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787384676.794062:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203413888 00000100:00100000:3.0:1787384676.794066:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203413888 00000100:00100000:3.0:1787384676.794096:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203413760 00000100:00100000:3.0:1787384676.794100:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203413760 00000100:00100000:3.0:1787384676.794111:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203413504 00000100:00100000:3.0:1787384676.794114:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203413504 00000100:00100000:3.0:1787384676.794123:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203414016 00000100:00100000:3.0:1787384676.794125:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203414016 00000100:00100000:1.0:1787384676.796438:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203414144:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787384676.796502:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384676.798259:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203414144 00000100:00100000:0.0:1787384676.798271:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203414144 00000100:00100000:0.0:1787384676.798327:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787384676.798336:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203414144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787384676.798367:0:18660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787384676.798434:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203414144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (1930us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384676.798440:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787384676.799482:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203412992 00000100:00100000:3.0:1787384676.799489:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203412992 00000100:00100000:3.0:1787384676.799507:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203413632 00000100:00100000:3.0:1787384676.799509:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203413632 00000100:00100000:3.0:1787384676.799529:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787384676.799538:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874208203413888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384676.799591:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874208203413888:12345-0@lo:400:kworker.0 Request processed in 54us (7758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384676.799598:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787384676.799613:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787384676.799620:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874208203413760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384676.799648:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874208203413760:12345-0@lo:400:kworker.0 Request processed in 29us (7677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384676.799653:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787384676.799664:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787384676.799670:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203413504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384676.799697:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203413504:12345-0@lo:400:kworker.0 Request processed in 27us (7634us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384676.799702:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787384676.799713:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787384676.799718:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874208203414016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384676.799744:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874208203414016:12345-0@lo:400:kworker.0 Request processed in 26us (7634us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384676.799757:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787384676.799769:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787384676.799774:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd758e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203412992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384676.799823:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd758e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203412992:12345-0@lo:400:kworker.0 Request processed in 49us (6898us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384676.799828:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787384676.799840:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787384676.799846:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd759c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203413632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384676.799872:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd759c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203413632:12345-0@lo:400:kworker.0 Request processed in 27us (6866us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384676.799877:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787384676.799899:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203412480 00000100:00100000:3.0:1787384676.799903:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203412480 00000100:00100000:3.0:1787384676.799936:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787384676.800079:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203414144:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787384676.803258:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+24:3654:x1874208203412480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384676.803339:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+24:3654:x1874208203412480:12345-0@lo:400:kworker.0 Request processed in 97us (11441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384676.803348:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:3.0:1787384676.803425:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787384676.803430:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787384676.803433:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787384676.803495:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c40dc700 x1874208203412864/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787384701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787384676.803513:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787384676.803522:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787384676.803527:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787384676.803536:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f9135000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787384676.803551:0:3650:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787384676.803557:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874208203412864:0@lo:8:kworker.0 00010000:00080000:3.0:1787384676.803575:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c40de300 x1874208203413376/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787384701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787384676.803586:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1787384676.803591:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787384676.803594:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787384676.803596:0:3650:0:(import.c:65:import_set_state_nolock()) ffff98f8f919a800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787384676.803605:0:3650:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787384676.803609:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874208203413376:0@lo:8:kworker.0 00000004:00080000:3.0:1787384676.803662:0:17177:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1787384676.803680:0:17177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd75b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17177:1874208203414400:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787384676.803709:0:17177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384676.803726:0:17177:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c6361a80 going to sleep for 11 seconds 00000004:00080000:3.0:1787384676.803740:0:17176:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787384676.803840:0:17176:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 571884060498ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787384676.803846:0:17176:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1787384676.803878:0:17894:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1787384676.803891:0:17894:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd758000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17894:1874208203414656:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1787384676.803912:0:17894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384676.803925:0:17894:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c6361480 going to sleep for 11 seconds 00000004:00080000:3.0:1787384676.803935:0:17893:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787384676.803972:0:17893:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 571884193229ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787384676.803976:0:17893:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1787384676.803994:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd75b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203414272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787384676.806758:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384676.806815:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384676.806827:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd75ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203414528:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787384676.806849:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384676.809090:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203414400 00000100:00100000:2.0:1787384676.809102:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203414400 00000100:00100000:2.0:1787384676.809156:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203414656 00000100:00100000:2.0:1787384676.809160:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203414656 00000100:00100000:2.0:1787384676.809186:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787384676.809194:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd75aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17177:x1874208203414400:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787384676.809448:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203414272 00000100:00100000:3.0:1787384676.809453:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203414272 00000100:00100000:3.0:1787384676.809471:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203414528 00000100:00100000:3.0:1787384676.809473:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203414528 00000100:00100000:3.0:1787384676.809486:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787384676.809492:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd759500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3653:x1874208203414272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787384676.809510:0:18660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00010000:00080000:2.0:1787384676.809523:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c40dfb80 x1874208203412992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384676.809536:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203412992:0@lo:400:kworker.0 00010000:00080000:2.0:1787384676.809549:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c40dc000 x1874208203413632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384676.809557:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203413632:0@lo:400:kworker.0 00000100:00100000:2.0:1787384676.809567:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203412736:0@lo:400:kworker.0 00000100:00100000:3.0:1787384676.809568:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd759500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3653:x1874208203414272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (2817us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384676.809574:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787384676.809577:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c40de680 x1874208203413504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384676.809584:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203413504:0@lo:400:kworker.0 00000100:00100000:3.0:1787384676.809590:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787384676.809596:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd75a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3653:x1874208203414528:12345-0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1787384676.809607:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c40df480 x1874208203414016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384676.809614:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203414016:0@lo:400:kworker.0 00002000:00000024:3.0:1787384676.809615:0:18660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787384676.809637:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd75a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3653:x1874208203414528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (2787us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384676.809643:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787384676.809650:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f91d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57899b24-a33b-4177-9883-79b5fe35053f:3654:1874208203412480:0@lo:400:kworker.0 00000100:00100000:2.0:1787384676.809662:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203413120:0@lo:400:kworker.0 00010000:00080000:2.0:1787384676.809673:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c40dd880 x1874208203413760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384676.809681:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787384676.809681:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874208203413760:0@lo:400:kworker.0 00000100:00100000:3.0:1787384676.809688:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd759180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17894:x1874208203414656:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1787384676.809691:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203412608:0@lo:400:kworker.0 00000100:00080000:3.0:1787384676.809726:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787384676.809746:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8fd75ad80 x1874208203414528/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384692 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384676.809761:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd75ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203414528:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787384676.809772:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203413248:0@lo:400:kworker.0 00010000:00080000:3.0:1787384676.809795:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8fd75b100 x1874208203414272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384692 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1787384676.809800:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c40dc380 x1874208203413888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384676.809807:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd75b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203414272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787384676.809936:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874208203413888:0@lo:400:kworker.0 00002000:00080000:2.0:1787384676.811283:0:18657:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1787384676.811290:0:18657:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1787384676.811295:0:18657:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00002000:00080000:3.0:1787384676.815897:0:18658:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1787384676.815908:0:18658:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1787384676.816045:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd759180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17894:x1874208203414656:12345-0@lo:7:osp-pre-1-1.0 Request processed in 6353us (12128us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384676.816056:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:3.0:1787384676.816108:0:17883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00010000:00080000:3.0:1787384676.816159:0:17894:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8fd758000 x1874208203414656/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787384692 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384676.816172:0:17894:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd758000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17894:1874208203414656:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1787384676.816184:0:17894:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1787384676.816234:0:17894:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd758000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17894:1874208203414784:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1787384676.816264:0:17894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384676.816289:0:17894:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d956cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787384676.816303:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203414784 00000100:00100000:3.0:1787384676.816309:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203414784 00000100:00100000:3.0:1787384676.816346:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787384676.816354:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd75b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17894:x1874208203414784:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1787384676.816377:0:18656:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1787384676.816406:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd75b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17894:x1874208203414784:12345-0@lo:5:osp-pre-1-1.0 Request processed in 53us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384676.816413:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1787384676.816440:0:17894:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8fd758000 x1874208203414784/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787384692 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384676.816463:0:17894:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd758000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17894:1874208203414784:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1787384676.816471:0:17894:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1787384676.816497:0:17894:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd758000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17894:1874208203414912:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1787384676.816519:0:17894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384676.816532:0:17894:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d956cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787384676.816542:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203414912 00000100:00100000:3.0:1787384676.816545:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203414912 00000100:00100000:3.0:1787384676.816566:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787384676.816572:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd75ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17894:x1874208203414912:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1787384676.816596:0:18658:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00000004:00080000:3.0:1787384676.816729:0:17130:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:2.0:1787384676.819623:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787384676.819635:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ae16e8e/0x7ef423838fba3d08 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384676.819652:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=571s v=(0 0) 00010000:00010000:2.0:1787384676.819657:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384676.819668:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ae16e8e/0x7ef423838fba3d08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384676.819685:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ae16e8e/0x7ef423838fba3d08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384676.819696:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ae16e8e/0x7ef423838fba3d08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384676.820110:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ae16e8e/0x7ef423838fba3d08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384676.820304:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787384676.820315:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384676.820320:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ae16e8e/0x7ef423838fba3d08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384676.820328:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2091e00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:2.0:1787384676.820333:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ae16e8e/0x7ef423838fba3d08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384676.820342:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ae16e8e/0x7ef423838fba3d08 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384676.820357:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ae16e8e/0x7ef423838fba3d08 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384676.820374:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ae16e8e/0x7ef423838fba3d08 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384676.820391:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384676.820392:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384676.820394:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787384676.827190:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384676.827204:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016504a0a/0x7ef423838fba3d0f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.827222:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=571s v=(0 0) 00010000:00010000:0.0:1787384676.827226:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384676.827232:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016504a0a/0x7ef423838fba3d0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.827246:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016504a0a/0x7ef423838fba3d0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.827256:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016504a0a/0x7ef423838fba3d0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.827264:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016504a0a/0x7ef423838fba3d0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.827283:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787384676.827298:0:17902:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384676.827304:0:17902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016504a0a/0x7ef423838fba3d0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.827324:0:17902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6141200 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384676.827330:0:17902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016504a0a/0x7ef423838fba3d0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.827338:0:17902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016504a0a/0x7ef423838fba3d0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.827354:0:17902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016504a0a/0x7ef423838fba3d0f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.827363:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016504a0a/0x7ef423838fba3d0f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.827378:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384676.827380:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384676.827381:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787384676.833387:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787384676.833401:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cfdaf37/0x7ef423838fba3d16 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.833417:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=571s v=(0 0) 00010000:00010000:1.0:1787384676.833421:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384676.833427:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cfdaf37/0x7ef423838fba3d16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.833454:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cfdaf37/0x7ef423838fba3d16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.833465:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cfdaf37/0x7ef423838fba3d16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.833473:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cfdaf37/0x7ef423838fba3d16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.833494:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384676.833506:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384676.833511:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cfdaf37/0x7ef423838fba3d16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.833520:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3952c00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384676.833524:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cfdaf37/0x7ef423838fba3d16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.833534:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cfdaf37/0x7ef423838fba3d16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.833551:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cfdaf37/0x7ef423838fba3d16 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.833558:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cfdaf37/0x7ef423838fba3d16 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.833581:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384676.833583:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384676.833584:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787384676.835361:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787384676.835373:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000502a05d1/0x7ef423838fba3d1d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.835388:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=571s v=(0 0) 00010000:00010000:1.0:1787384676.835392:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384676.835398:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000502a05d1/0x7ef423838fba3d1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.835411:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000502a05d1/0x7ef423838fba3d1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.835419:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000502a05d1/0x7ef423838fba3d1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.835426:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000502a05d1/0x7ef423838fba3d1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.835446:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384676.835456:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384676.835461:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000502a05d1/0x7ef423838fba3d1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.835482:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3953800 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384676.835486:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000502a05d1/0x7ef423838fba3d1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.835494:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000502a05d1/0x7ef423838fba3d1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.835509:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000502a05d1/0x7ef423838fba3d1d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.835514:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000502a05d1/0x7ef423838fba3d1d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.835529:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384676.835531:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384676.835532:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787384676.837338:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787384676.837350:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060c5a1fc/0x7ef423838fba3d24 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.837366:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=571s v=(0 0) 00010000:00010000:1.0:1787384676.837370:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384676.837376:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060c5a1fc/0x7ef423838fba3d24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.837388:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060c5a1fc/0x7ef423838fba3d24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.837405:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060c5a1fc/0x7ef423838fba3d24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.837413:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060c5a1fc/0x7ef423838fba3d24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.837439:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787384676.837958:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787384676.837964:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea8f2926/0x7ef423838fba3d2b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.837974:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=571s v=(0 0) 00010000:00010000:1.0:1787384676.837978:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384676.837982:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea8f2926/0x7ef423838fba3d2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.837991:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea8f2926/0x7ef423838fba3d2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.837999:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea8f2926/0x7ef423838fba3d2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.838016:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea8f2926/0x7ef423838fba3d2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.838042:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787384676.838051:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787384676.838056:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060c5a1fc/0x7ef423838fba3d24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.838063:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3952e00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384676.838067:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060c5a1fc/0x7ef423838fba3d24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.838075:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060c5a1fc/0x7ef423838fba3d24 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.838096:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060c5a1fc/0x7ef423838fba3d24 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.838104:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060c5a1fc/0x7ef423838fba3d24 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.838120:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384676.838123:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea8f2926/0x7ef423838fba3d2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.838180:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3952600 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384676.838185:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea8f2926/0x7ef423838fba3d2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.838204:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea8f2926/0x7ef423838fba3d2b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.838215:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea8f2926/0x7ef423838fba3d2b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.838221:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea8f2926/0x7ef423838fba3d2b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.838234:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384676.838236:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384676.838238:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384676.840128:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787384676.841054:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384676.841064:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009eaaa97/0x7ef423838fba3d32 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.841080:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=571s v=(0 0) 00010000:00010000:0.0:1787384676.841085:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384676.841091:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009eaaa97/0x7ef423838fba3d32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.841115:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009eaaa97/0x7ef423838fba3d32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.841124:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009eaaa97/0x7ef423838fba3d32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.841132:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009eaaa97/0x7ef423838fba3d32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.841145:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384676.841366:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384676.841373:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009eaaa97/0x7ef423838fba3d32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.841381:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6141800 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384676.841386:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009eaaa97/0x7ef423838fba3d32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.841396:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009eaaa97/0x7ef423838fba3d32 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.841412:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009eaaa97/0x7ef423838fba3d32 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.841429:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009eaaa97/0x7ef423838fba3d32 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.841448:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384676.841449:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384676.841451:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787384676.841666:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384676.841672:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0a131ef/0x7ef423838fba3d39 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.841681:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=571s v=(0 0) 00010000:00010000:0.0:1787384676.841684:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384676.841688:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0a131ef/0x7ef423838fba3d39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.841696:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0a131ef/0x7ef423838fba3d39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.841703:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0a131ef/0x7ef423838fba3d39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.841722:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0a131ef/0x7ef423838fba3d39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.841737:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787384676.841746:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384676.841750:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0a131ef/0x7ef423838fba3d39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.841756:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6140000 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384676.841759:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0a131ef/0x7ef423838fba3d39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.841766:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0a131ef/0x7ef423838fba3d39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.841798:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0a131ef/0x7ef423838fba3d39 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.841805:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0a131ef/0x7ef423838fba3d39 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.841819:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384676.841820:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384676.841822:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787384676.842244:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384676.842257:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006542928c/0x7ef423838fba3d40 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.842266:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=571s v=(0 0) 00010000:00010000:0.0:1787384676.842270:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384676.842274:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006542928c/0x7ef423838fba3d40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.842283:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006542928c/0x7ef423838fba3d40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.842291:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006542928c/0x7ef423838fba3d40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.842299:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006542928c/0x7ef423838fba3d40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.842313:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787384676.842320:0:17902:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384676.842324:0:17902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006542928c/0x7ef423838fba3d40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.842331:0:17902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8c6141000 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384676.842334:0:17902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006542928c/0x7ef423838fba3d40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.842341:0:17902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006542928c/0x7ef423838fba3d40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.842357:0:17902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006542928c/0x7ef423838fba3d40 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.842365:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006542928c/0x7ef423838fba3d40 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.842378:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384676.842380:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384676.842382:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787384676.842623:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384676.842629:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056c07d64/0x7ef423838fba3d47 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.842637:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=571s v=(0 0) 00010000:00010000:0.0:1787384676.842639:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384676.842643:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056c07d64/0x7ef423838fba3d47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.842651:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056c07d64/0x7ef423838fba3d47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.842659:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056c07d64/0x7ef423838fba3d47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.842666:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056c07d64/0x7ef423838fba3d47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.842705:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787384676.842986:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384676.842992:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ddfdfe0/0x7ef423838fba3d4e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.843000:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=571s v=(0 0) 00010000:00010000:0.0:1787384676.843003:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384676.843016:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ddfdfe0/0x7ef423838fba3d4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.843026:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ddfdfe0/0x7ef423838fba3d4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.843034:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ddfdfe0/0x7ef423838fba3d4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.843042:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ddfdfe0/0x7ef423838fba3d4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.843054:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787384676.843060:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787384676.843064:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056c07d64/0x7ef423838fba3d47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.843071:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b04400 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384676.843081:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056c07d64/0x7ef423838fba3d47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.843089:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056c07d64/0x7ef423838fba3d47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.843100:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056c07d64/0x7ef423838fba3d47 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.843108:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056c07d64/0x7ef423838fba3d47 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.843121:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384676.843124:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ddfdfe0/0x7ef423838fba3d4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384676.843584:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384676.843605:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b05800 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384676.843611:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ddfdfe0/0x7ef423838fba3d4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.843620:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ddfdfe0/0x7ef423838fba3d4e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.843633:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ddfdfe0/0x7ef423838fba3d4e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.843640:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ddfdfe0/0x7ef423838fba3d4e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.843660:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384676.843661:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384676.843663:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787384676.844507:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384676.844514:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f8a8ba5/0x7ef423838fba3d55 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.844526:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=571s v=(0 0) 00010000:00010000:0.0:1787384676.844530:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384676.844536:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f8a8ba5/0x7ef423838fba3d55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.844547:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f8a8ba5/0x7ef423838fba3d55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.844555:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f8a8ba5/0x7ef423838fba3d55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.844563:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f8a8ba5/0x7ef423838fba3d55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.844584:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384676.844974:0:17902:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384676.844981:0:17902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f8a8ba5/0x7ef423838fba3d55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.844989:0:17902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b04200 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384676.844993:0:17902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f8a8ba5/0x7ef423838fba3d55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.845001:0:17902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f8a8ba5/0x7ef423838fba3d55 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.845025:0:17902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f8a8ba5/0x7ef423838fba3d55 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.845032:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f8a8ba5/0x7ef423838fba3d55 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.845049:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384676.845051:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384676.845053:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787384676.845422:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787384676.845428:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007505a175/0x7ef423838fba3d5c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.845438:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=571s v=(0 0) 00010000:00010000:1.0:1787384676.845442:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384676.845446:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007505a175/0x7ef423838fba3d5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.845457:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007505a175/0x7ef423838fba3d5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.845465:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007505a175/0x7ef423838fba3d5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.845473:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007505a175/0x7ef423838fba3d5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.845488:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787384676.845725:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384676.845731:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007505a175/0x7ef423838fba3d5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.845749:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3952200 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384676.845752:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007505a175/0x7ef423838fba3d5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.845759:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007505a175/0x7ef423838fba3d5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.845770:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007505a175/0x7ef423838fba3d5c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.845797:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007505a175/0x7ef423838fba3d5c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.845823:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384676.845824:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384676.845826:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787384676.846441:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384676.846447:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002abde9a4/0x7ef423838fba3d63 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.846458:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=571s v=(0 0) 00010000:00010000:0.0:1787384676.846461:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384676.846466:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002abde9a4/0x7ef423838fba3d63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.846476:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002abde9a4/0x7ef423838fba3d63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.846489:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002abde9a4/0x7ef423838fba3d63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.846496:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002abde9a4/0x7ef423838fba3d63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.846510:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384676.846720:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384676.846725:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002abde9a4/0x7ef423838fba3d63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.846733:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b05200 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384676.846738:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002abde9a4/0x7ef423838fba3d63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.846756:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002abde9a4/0x7ef423838fba3d63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.846768:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002abde9a4/0x7ef423838fba3d63 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.846795:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002abde9a4/0x7ef423838fba3d63 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.846818:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384676.846820:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384676.846822:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787384676.847400:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787384676.847407:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de0967c3/0x7ef423838fba3d6a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.847417:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=571s v=(0 0) 00010000:00010000:1.0:1787384676.847421:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384676.847425:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de0967c3/0x7ef423838fba3d6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.847435:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de0967c3/0x7ef423838fba3d6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.847443:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de0967c3/0x7ef423838fba3d6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.847456:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de0967c3/0x7ef423838fba3d6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.847472:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787384676.847700:0:17902:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384676.847706:0:17902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de0967c3/0x7ef423838fba3d6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.847714:0:17902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3953200 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384676.847718:0:17902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de0967c3/0x7ef423838fba3d6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.847728:0:17902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de0967c3/0x7ef423838fba3d6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.847741:0:17902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de0967c3/0x7ef423838fba3d6a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.847749:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de0967c3/0x7ef423838fba3d6a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.847764:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384676.847771:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384676.847773:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787384676.848138:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384676.848145:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b49dcce7/0x7ef423838fba3d71 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.848154:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=571s v=(0 0) 00010000:00010000:0.0:1787384676.848157:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384676.848161:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b49dcce7/0x7ef423838fba3d71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.848171:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b49dcce7/0x7ef423838fba3d71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.848179:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b49dcce7/0x7ef423838fba3d71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.848185:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b49dcce7/0x7ef423838fba3d71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.848201:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787384676.848550:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384676.848558:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d2bdf4f/0x7ef423838fba3d78 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.848567:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=571s v=(0 0) 00010000:00010000:0.0:1787384676.848569:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384676.848573:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d2bdf4f/0x7ef423838fba3d78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.848589:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d2bdf4f/0x7ef423838fba3d78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.848596:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d2bdf4f/0x7ef423838fba3d78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.848603:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d2bdf4f/0x7ef423838fba3d78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.848616:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787384676.849062:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384676.849067:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c26e7ac/0x7ef423838fba3d7f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.849077:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=571s v=(0 0) 00010000:00010000:0.0:1787384676.849080:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384676.849084:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c26e7ac/0x7ef423838fba3d7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.849093:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c26e7ac/0x7ef423838fba3d7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.849101:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c26e7ac/0x7ef423838fba3d7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.849120:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c26e7ac/0x7ef423838fba3d7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.849144:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787384676.849154:0:17902:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787384676.849160:0:17902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b49dcce7/0x7ef423838fba3d71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.849167:0:17902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b04a00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384676.849171:0:17902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b49dcce7/0x7ef423838fba3d71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.849180:0:17902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b49dcce7/0x7ef423838fba3d71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.849194:0:17902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b49dcce7/0x7ef423838fba3d71 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.849201:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b49dcce7/0x7ef423838fba3d71 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.849218:0:17902:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787384676.849221:0:17902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d2bdf4f/0x7ef423838fba3d78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.849238:0:17902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b04600 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384676.849241:0:17902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d2bdf4f/0x7ef423838fba3d78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.849248:0:17902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d2bdf4f/0x7ef423838fba3d78 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.849259:0:17902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d2bdf4f/0x7ef423838fba3d78 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.849266:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d2bdf4f/0x7ef423838fba3d78 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.849278:0:17902:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384676.849281:0:17902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c26e7ac/0x7ef423838fba3d7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.849287:0:17902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b05c00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384676.849290:0:17902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c26e7ac/0x7ef423838fba3d7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.849297:0:17902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c26e7ac/0x7ef423838fba3d7f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.849307:0:17902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c26e7ac/0x7ef423838fba3d7f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.849319:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c26e7ac/0x7ef423838fba3d7f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.849332:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384676.849334:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384676.849335:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787384676.849621:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384676.849627:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003396b4d4/0x7ef423838fba3d86 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.849635:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=571s v=(0 0) 00010000:00010000:0.0:1787384676.849638:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384676.849643:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003396b4d4/0x7ef423838fba3d86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.849651:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003396b4d4/0x7ef423838fba3d86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.849658:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003396b4d4/0x7ef423838fba3d86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.849665:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003396b4d4/0x7ef423838fba3d86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.849677:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787384676.849683:0:17902:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384676.849691:0:17902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003396b4d4/0x7ef423838fba3d86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.849698:0:17902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b04e00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384676.849701:0:17902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003396b4d4/0x7ef423838fba3d86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.849709:0:17902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003396b4d4/0x7ef423838fba3d86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.849721:0:17902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003396b4d4/0x7ef423838fba3d86 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.849728:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003396b4d4/0x7ef423838fba3d86 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.849740:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384676.849741:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384676.849743:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384676.849948:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384676.849954:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787384676.851071:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787384676.851079:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088a373cd/0x7ef423838fba3d8d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.851091:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=571s v=(0 0) 00010000:00010000:0.0:1787384676.851096:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384676.851101:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088a373cd/0x7ef423838fba3d8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.851124:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088a373cd/0x7ef423838fba3d8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.851144:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088a373cd/0x7ef423838fba3d8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.851152:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088a373cd/0x7ef423838fba3d8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.851167:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787384676.851176:0:17902:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384676.851181:0:17902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088a373cd/0x7ef423838fba3d8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.851188:0:17902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b04800 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384676.851192:0:17902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088a373cd/0x7ef423838fba3d8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.851201:0:17902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088a373cd/0x7ef423838fba3d8d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.851213:0:17902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088a373cd/0x7ef423838fba3d8d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.851221:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088a373cd/0x7ef423838fba3d8d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.851241:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384676.851243:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384676.851244:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787384676.865645:0:19472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1787384676.865682:0:19472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1787384676.865688:0:19472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787384676.868123:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd75ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17894:x1874208203414912:12345-0@lo:5:osp-pre-1-1.0 Request processed in 51542us (51594us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787384676.868147:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787384676.868212:0:17894:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787384676.868219:0:17894:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd758000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17894:1874208203414912:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1787384676.868234:0:17894:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1787384676.868293:0:17894:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a82680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17894:1874208203415040:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1787384676.868327:0:17894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384676.868347:0:17894:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f9755a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787384676.868372:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203415040 00000100:00100000:0.0:1787384676.868378:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203415040 00000100:00100000:0.0:1787384676.868412:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787384676.868419:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17894:x1874208203415040:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1787384676.868457:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17894:x1874208203415040:12345-0@lo:900:osp-pre-1-1.0 Request processed in 39us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384676.868463:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787384676.868492:0:17894:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c3a82680 x1874208203415040/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787384692 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384676.868504:0:17894:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a82680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17894:1874208203415040:0@lo:900:osp-pre-1-1.0 00002000:00010000:1.0:1787384676.870358:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787384676.870373:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea8f2926/0x7ef423838fba3d94 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.870389:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=571s v=(0 0) 00010000:00010000:1.0:1787384676.870394:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384676.870400:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea8f2926/0x7ef423838fba3d94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.870416:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea8f2926/0x7ef423838fba3d94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.870426:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea8f2926/0x7ef423838fba3d94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.870433:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea8f2926/0x7ef423838fba3d94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.870447:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787384676.871213:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384676.871221:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea8f2926/0x7ef423838fba3d94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384676.871230:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3952600 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:3.0:1787384676.871235:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea8f2926/0x7ef423838fba3d94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384676.871245:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea8f2926/0x7ef423838fba3d94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384676.871280:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea8f2926/0x7ef423838fba3d94 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384676.871287:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea8f2926/0x7ef423838fba3d94 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384676.871307:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384676.871309:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384676.871311:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787384676.872290:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787384676.872304:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060c5a1fc/0x7ef423838fba3d9b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.872317:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=571s v=(0 0) 00010000:00010000:1.0:1787384676.872321:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384676.872327:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060c5a1fc/0x7ef423838fba3d9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.872337:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060c5a1fc/0x7ef423838fba3d9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.872344:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060c5a1fc/0x7ef423838fba3d9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.872350:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060c5a1fc/0x7ef423838fba3d9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.872370:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787384676.872695:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384676.872702:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060c5a1fc/0x7ef423838fba3d9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.872717:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3952e00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384676.872720:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060c5a1fc/0x7ef423838fba3d9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.872729:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060c5a1fc/0x7ef423838fba3d9b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.872741:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060c5a1fc/0x7ef423838fba3d9b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.872747:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060c5a1fc/0x7ef423838fba3d9b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.872763:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384676.872764:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384676.872765:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787384676.873081:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787384676.873088:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000502a05d1/0x7ef423838fba3da2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.873098:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=571s v=(0 0) 00010000:00010000:1.0:1787384676.873102:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384676.873106:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000502a05d1/0x7ef423838fba3da2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.873115:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000502a05d1/0x7ef423838fba3da2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.873129:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000502a05d1/0x7ef423838fba3da2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.873149:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000502a05d1/0x7ef423838fba3da2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.873171:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787384676.873338:0:17902:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384676.873344:0:17902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000502a05d1/0x7ef423838fba3da2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.873352:0:17902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3953800 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384676.873355:0:17902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000502a05d1/0x7ef423838fba3da2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.873362:0:17902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000502a05d1/0x7ef423838fba3da2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.873380:0:17902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000502a05d1/0x7ef423838fba3da2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.873386:0:17902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000502a05d1/0x7ef423838fba3da2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.873401:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384676.873403:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384676.873404:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787384676.873628:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787384676.873634:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cfdaf37/0x7ef423838fba3da9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.873643:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=571s v=(0 0) 00010000:00010000:1.0:1787384676.873646:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384676.873650:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cfdaf37/0x7ef423838fba3da9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.873659:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cfdaf37/0x7ef423838fba3da9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.873667:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cfdaf37/0x7ef423838fba3da9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.873673:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cfdaf37/0x7ef423838fba3da9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.873707:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787384676.874029:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787384676.874035:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae5db808/0x7ef423838fba3db0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.874043:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=571s v=(0 0) 00010000:00010000:1.0:1787384676.874046:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384676.874050:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae5db808/0x7ef423838fba3db0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.874060:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae5db808/0x7ef423838fba3db0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.874068:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae5db808/0x7ef423838fba3db0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.874074:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae5db808/0x7ef423838fba3db0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.874085:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787384676.874439:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787384676.874445:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f18d4b73/0x7ef423838fba3db7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.874453:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=571s v=(0 0) 00010000:00010000:1.0:1787384676.874462:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384676.874467:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f18d4b73/0x7ef423838fba3db7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.874476:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f18d4b73/0x7ef423838fba3db7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.874484:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f18d4b73/0x7ef423838fba3db7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.874491:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f18d4b73/0x7ef423838fba3db7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.874502:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787384676.874796:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787384676.874802:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e074a46d/0x7ef423838fba3dbe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.874821:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=571s v=(0 0) 00010000:00010000:1.0:1787384676.874824:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384676.874828:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e074a46d/0x7ef423838fba3dbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.874838:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e074a46d/0x7ef423838fba3dbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.874847:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e074a46d/0x7ef423838fba3dbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.874861:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e074a46d/0x7ef423838fba3dbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.874869:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1787384676.875244:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787384676.875251:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001497e3dc/0x7ef423838fba3dc5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.875260:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=571s v=(0 0) 00010000:00010000:1.0:1787384676.875263:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384676.875267:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001497e3dc/0x7ef423838fba3dc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.875276:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001497e3dc/0x7ef423838fba3dc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.875284:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001497e3dc/0x7ef423838fba3dc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.875292:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001497e3dc/0x7ef423838fba3dc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384676.875302:0:18657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00080000:1.0:1787384676.875333:0:18657:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:1.0:1787384676.875438:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd75aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17177:x1874208203414400:12345-0@lo:5:osp-pre-1-0.0 Request processed in 66241us (71724us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384676.875456:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787384676.875514:0:17177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd75b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17177:1874208203414400:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787384676.875529:0:17177:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1787384676.875582:0:17177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17177:1874208203415168:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787384676.875618:0:17177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384676.875641:0:17177:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f5769000 going to sleep for 11 seconds 00000100:00100000:1.0:1787384676.875663:0:19186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203415168 00000100:00100000:1.0:1787384676.875670:0:19186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203415168 00000100:00100000:1.0:1787384676.875712:0:19186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787384676.875722:0:19186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17177:x1874208203415168:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787384676.875758:0:19186:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:0.0:1787384676.877261:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787384676.877272:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cfdaf37/0x7ef423838fba3da9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.877286:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3952c00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384676.877290:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cfdaf37/0x7ef423838fba3da9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.877299:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cfdaf37/0x7ef423838fba3da9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.877315:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cfdaf37/0x7ef423838fba3da9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.877322:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cfdaf37/0x7ef423838fba3da9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.877359:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787384676.877363:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae5db808/0x7ef423838fba3db0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.877369:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3953e00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384676.877372:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae5db808/0x7ef423838fba3db0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.877378:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae5db808/0x7ef423838fba3db0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.877388:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae5db808/0x7ef423838fba3db0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.877393:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae5db808/0x7ef423838fba3db0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.877405:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787384676.877408:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f18d4b73/0x7ef423838fba3db7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.877413:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965b600 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384676.877416:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f18d4b73/0x7ef423838fba3db7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.877431:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f18d4b73/0x7ef423838fba3db7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.877441:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f18d4b73/0x7ef423838fba3db7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.877447:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f18d4b73/0x7ef423838fba3db7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.877460:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787384676.877463:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e074a46d/0x7ef423838fba3dbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.877469:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965b200 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384676.877472:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e074a46d/0x7ef423838fba3dbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.877478:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e074a46d/0x7ef423838fba3dbe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.877486:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e074a46d/0x7ef423838fba3dbe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.877494:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e074a46d/0x7ef423838fba3dbe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.877517:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384676.877520:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001497e3dc/0x7ef423838fba3dc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.877526:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965ae00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:0.0:1787384676.877528:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001497e3dc/0x7ef423838fba3dc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.877535:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001497e3dc/0x7ef423838fba3dc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.877545:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001497e3dc/0x7ef423838fba3dc5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.877551:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001497e3dc/0x7ef423838fba3dc5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384676.877563:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384676.877564:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384676.877566:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384676.877572:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384676.877578:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384676.881676:0:19186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17177:x1874208203415168:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5949us (6050us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787384676.881689:0:19186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787384676.881968:0:17177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17177:1874208203415168:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787384676.881983:0:17177:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000100:00100000:3.0:1787384677.312991:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203415296:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787384677.313076:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384677.313174:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203415296 00000100:00100000:3.0:1787384677.313181:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203415296 00000100:00100000:3.0:1787384677.313222:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787384677.313231:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd759f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203415296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787384677.313264:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787384677.313305:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd759f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203415296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384677.313312:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787384677.313543:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203415296:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787384677.317203:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787384677.317225:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd75b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203415424:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787384677.317429:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384677.317562:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203415424 00000100:00100000:3.0:1787384677.317569:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203415424 00000100:00100000:3.0:1787384677.317618:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787384677.317627:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd75a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203415424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787384677.317663:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787384677.317708:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd75a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203415424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384677.317715:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787384677.317768:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd75b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203415424:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787384677.752763:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787384678.199737:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1787384678.310892:0:19829:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg345-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787384678.776123:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787384679.214618:0:19881:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787384679.215187:0:19881:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787384679.801161:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787384680.296907:0:19931:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787384680.297196:0:19931:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787384680.644546:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384680.646194:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182357632 00000100:00100000:1.0:1787384680.646208:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182357632 00000100:00100000:1.0:1787384680.646309:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 114 00000100:00100000:1.0:1787384680.646319:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd590850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2412:x1874208182357632:12345-192.168.203.45@tcp:250:mount.lustre.0 00010000:00080000:1.0:1787384680.646349:0:17144:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from b965c805-ceb8-4757-b53e-03d6d45231a8@192.168.203.45@tcp t0 exp 0000000000000000 cur 575 last 0 00000020:00000080:1.0:1787384680.646377:0:17144:0:(genops.c:1406:class_connect()) connect: client b965c805-ceb8-4757-b53e-03d6d45231a8, cookie 0x7ef423838fba3dcc 00000100:00080000:1.0:1787384680.646507:0:17144:0:(import.c:65:import_set_state_nolock()) ffff98f7c222c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787384680.646589:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd590850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b965c805-ceb8-4757-b53e-03d6d45231a8+5:2412:x1874208182357632:12345-192.168.203.45@tcp:250:mount.lustre.0 Request processed in 271us (2053us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384680.646597:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 114 00000100:00100000:1.0:1787384680.655223:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384680.655368:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182357760 00000100:00100000:3.0:1787384680.655377:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182357760 00000100:00100000:3.0:1787384680.655484:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 115 00000100:00100000:3.0:1787384680.655494:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b965c805-ceb8-4757-b53e-03d6d45231a8+5:14912:x1874208182357760:12345-192.168.203.45@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787384680.655511:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384680.655529:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8f58cc200/0x7ef423838fba3dd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3ae3 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384680.655560:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f58cc200/0x7ef423838fba3dd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3ae3 expref: 6 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384680.655572:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8f58cc200/0x7ef423838fba3dd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3ae3 expref: 6 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384680.655582:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cc200, rc 0) 00000100:00100000:3.0:1787384680.655644:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b965c805-ceb8-4757-b53e-03d6d45231a8+6:14912:x1874208182357760:12345-192.168.203.45@tcp:101:mount.lustre.0 Request processed in 152us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384680.655666:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 115 00000100:00100000:0.0:1787384680.668475:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384680.668570:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182357888 00000100:00100000:1.0:1787384680.668582:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182357888 00000100:00100000:1.0:1787384680.668641:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 116 00000100:00100000:1.0:1787384680.668652:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b965c805-ceb8-4757-b53e-03d6d45231a8+6:14912:x1874208182357888:12345-192.168.203.45@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787384680.668774:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b965c805-ceb8-4757-b53e-03d6d45231a8+6:14912:x1874208182357888:12345-192.168.203.45@tcp:501:mount.lustre.0 Request processed in 123us (307us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787384680.668819:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 116 00000100:00100000:2.0:1787384680.678943:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384680.679034:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182358016 00000100:00100000:3.0:1787384680.679044:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182358016 00000100:00100000:3.0:1787384680.679101:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 117 00000100:00100000:3.0:1787384680.679120:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b965c805-ceb8-4757-b53e-03d6d45231a8+6:14912:x1874208182358016:12345-192.168.203.45@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787384680.679136:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384680.679155:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8f58cd200/0x7ef423838fba3dda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3aea expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384680.679183:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f58cd200/0x7ef423838fba3dda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3aea expref: 7 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384680.679195:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8f58cd200/0x7ef423838fba3dda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3aea expref: 7 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384680.679204:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cd200, rc 0) 00000100:00100000:3.0:1787384680.679262:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b965c805-ceb8-4757-b53e-03d6d45231a8+7:14912:x1874208182358016:12345-192.168.203.45@tcp:101:mount.lustre.0 Request processed in 152us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384680.679270:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 117 00000100:00100000:2.0:1787384680.686143:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384680.686318:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182358144 00000100:00100000:0.0:1787384680.686328:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182358144 00000100:00100000:0.0:1787384680.686382:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 118 00000100:00100000:0.0:1787384680.686392:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd593c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b965c805-ceb8-4757-b53e-03d6d45231a8+7:14912:x1874208182358144:12345-192.168.203.45@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787384680.686553:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd593c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b965c805-ceb8-4757-b53e-03d6d45231a8+8:14912:x1874208182358144:12345-192.168.203.45@tcp:501:mount.lustre.0 Request processed in 161us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384680.686561:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 118 00000100:00100000:0.0:1787384680.690387:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384680.691823:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182358272 00000100:00100000:1.0:1787384680.691840:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182358272 00000100:00100000:1.0:1787384680.691925:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 119 00000100:00100000:1.0:1787384680.691937:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b965c805-ceb8-4757-b53e-03d6d45231a8+8:14912:x1874208182358272:12345-192.168.203.45@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787384680.692149:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b965c805-ceb8-4757-b53e-03d6d45231a8+8:14912:x1874208182358272:12345-192.168.203.45@tcp:503:mount.lustre.0 Request processed in 214us (1769us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384680.692158:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 119 00000100:00100000:2.0:1787384680.706734:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384680.707125:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182358400 00000100:00100000:3.0:1787384680.707139:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182358400 00000100:00100000:3.0:1787384680.707205:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 120 00000100:00100000:3.0:1787384680.707215:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd592050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b965c805-ceb8-4757-b53e-03d6d45231a8+8:14931:x1874208182358400:12345-192.168.203.45@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787384680.707413:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd592050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b965c805-ceb8-4757-b53e-03d6d45231a8+8:14931:x1874208182358400:12345-192.168.203.45@tcp:502:llog_process_th.0 Request processed in 198us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384680.707421:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 120 00000100:00100000:2.0:1787384680.761445:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384680.761536:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182358528 00000100:00100000:0.0:1787384680.761546:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182358528 00000100:00100000:0.0:1787384680.761596:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 121 00000100:00100000:0.0:1787384680.761605:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b965c805-ceb8-4757-b53e-03d6d45231a8+8:14931:x1874208182358528:12345-192.168.203.45@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787384680.761751:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b965c805-ceb8-4757-b53e-03d6d45231a8+8:14931:x1874208182358528:12345-192.168.203.45@tcp:502:llog_process_th.0 Request processed in 146us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384680.761759:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 121 00000100:00100000:0.0:1787384680.765262:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384680.767593:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182358656 00000100:00100000:1.0:1787384680.767613:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182358656 00000100:00100000:1.0:1787384680.767691:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 122 00000100:00100000:1.0:1787384680.767702:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b965c805-ceb8-4757-b53e-03d6d45231a8+8:14931:x1874208182358656:12345-192.168.203.45@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787384680.767946:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b965c805-ceb8-4757-b53e-03d6d45231a8+8:14931:x1874208182358656:12345-192.168.203.45@tcp:502:llog_process_th.0 Request processed in 244us (2691us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384680.767954:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 122 00000100:00100000:2.0:1787384680.782030:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384680.783855:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182358784 00000100:00100000:3.0:1787384680.783877:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182358784 00000100:00100000:3.0:1787384680.784057:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 123 00000100:00100000:3.0:1787384680.784071:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b965c805-ceb8-4757-b53e-03d6d45231a8+8:14912:x1874208182358784:12345-192.168.203.45@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787384680.784095:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384680.784120:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8f58cde00/0x7ef423838fba3de1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3b1b expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384680.784302:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f58cde00/0x7ef423838fba3de1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3b1b expref: 9 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384680.784316:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8f58cde00/0x7ef423838fba3de1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3b1b expref: 9 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384680.784326:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cde00, rc 0) 00000100:00100000:3.0:1787384680.784687:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b965c805-ceb8-4757-b53e-03d6d45231a8+9:14912:x1874208182358784:12345-192.168.203.45@tcp:101:mount.lustre.0 Request processed in 618us (2669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384680.784705:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 123 00000100:00100000:2.0:1787384680.793967:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384680.794096:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182358912 00000100:00100000:0.0:1787384680.794108:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182358912 00000100:00100000:0.0:1787384680.794488:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 124 00000100:00100000:0.0:1787384680.794501:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4038850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b965c805-ceb8-4757-b53e-03d6d45231a8+9:14912:x1874208182358912:12345-192.168.203.45@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787384680.794537:0:17143:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787384680.794572:0:17143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787384680.794577:0:17143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787384680.794580:0:17143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787384680.794589:0:17143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787384680.794592:0:17143:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1787384680.798348:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4038850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b965c805-ceb8-4757-b53e-03d6d45231a8+9:14912:x1874208182358912:12345-192.168.203.45@tcp:256:mount.lustre.0 Request processed in 3830us (4550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384680.798370:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 124 00000100:00100000:2.0:1787384680.819737:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384680.819839:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182359040 00000100:00100000:3.0:1787384680.819851:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182359040 00000100:00100000:3.0:1787384680.819924:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 125 00000100:00100000:3.0:1787384680.819934:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c403b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b965c805-ceb8-4757-b53e-03d6d45231a8+9:14912:x1874208182359040:12345-192.168.203.45@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787384680.819957:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384680.820012:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8f58cc800/0x7ef423838fba3de8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3b22 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384680.820069:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f58cc800/0x7ef423838fba3de8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3b22 expref: 10 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384680.820082:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8f58cc800/0x7ef423838fba3de8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3b22 expref: 10 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384680.820094:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cc800, rc 0) 00000100:00100000:3.0:1787384680.820172:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c403b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b965c805-ceb8-4757-b53e-03d6d45231a8+10:14912:x1874208182359040:12345-192.168.203.45@tcp:101:mount.lustre.0 Request processed in 239us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384680.820180:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 125 00010000:00010000:1.0:1787384680.823029:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384680.824602:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384680.826478:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182359168 00000100:00100000:3.0:1787384680.826501:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182359168 00000100:00100000:3.0:1787384680.826617:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 126 00000100:00100000:3.0:1787384680.826630:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4039050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b965c805-ceb8-4757-b53e-03d6d45231a8+10:14912:x1874208182359168:12345-192.168.203.45@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787384680.827250:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4039050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b965c805-ceb8-4757-b53e-03d6d45231a8+10:14912:x1874208182359168:12345-192.168.203.45@tcp:501:mount.lustre.0 Request processed in 620us (2658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384680.827260:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 126 00000100:00100000:2.0:1787384680.834809:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384680.834943:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182359296 00000100:00100000:1.0:1787384680.834956:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182359296 00000100:00100000:1.0:1787384680.835032:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 127 00000100:00100000:1.0:1787384680.835060:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4038c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b965c805-ceb8-4757-b53e-03d6d45231a8+10:14912:x1874208182359296:12345-192.168.203.45@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787384680.835244:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4038c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b965c805-ceb8-4757-b53e-03d6d45231a8+10:14912:x1874208182359296:12345-192.168.203.45@tcp:503:mount.lustre.0 Request processed in 185us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384680.835253:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 127 00000100:00100000:0.0:1787384680.845380:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384680.846042:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182359424 00000100:00100000:2.0:1787384680.846059:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182359424 00000100:00100000:2.0:1787384680.846149:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 128 00000100:00100000:2.0:1787384680.846160:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c434c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b965c805-ceb8-4757-b53e-03d6d45231a8+10:14938:x1874208182359424:12345-192.168.203.45@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787384680.846385:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c434c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b965c805-ceb8-4757-b53e-03d6d45231a8+10:14938:x1874208182359424:12345-192.168.203.45@tcp:502:llog_process_th.0 Request processed in 226us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384680.846395:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 128 00000100:00100000:2.0:1787384680.864256:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384680.864428:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182359552 00000100:00100000:3.0:1787384680.864441:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182359552 00000100:00100000:3.0:1787384680.864507:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 129 00000100:00100000:3.0:1787384680.864527:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b965c805-ceb8-4757-b53e-03d6d45231a8+10:14938:x1874208182359552:12345-192.168.203.45@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787384680.864736:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b965c805-ceb8-4757-b53e-03d6d45231a8+10:14938:x1874208182359552:12345-192.168.203.45@tcp:502:llog_process_th.0 Request processed in 219us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384680.864745:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 129 00000100:00100000:0.0:1787384680.879965:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384680.880308:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384680.889043:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203415552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787384680.889160:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384680.889397:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203415552 00000100:00100000:0.0:1787384680.889407:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203415552 00000100:00100000:0.0:1787384680.889500:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787384680.889511:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203415552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787384680.889562:0:18660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787384680.889619:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203415552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384680.889627:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787384680.890155:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182359680 00000100:00100000:1.0:1787384680.890162:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182359680 00000100:00080000:2.0:1787384680.890392:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787384680.890446:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203415552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787384680.890667:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182359936 00000100:00100000:0.0:1787384680.890672:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182359936 00000100:00100000:0.0:1787384680.890694:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 7 00000100:00100000:0.0:1787384680.890702:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2412:x1874208182359680:12345-192.168.203.45@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787384680.890729:0:17151:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 8741dc33-c445-439b-a6e3-d8ded553bb00@192.168.203.45@tcp t0 exp 0000000000000000 cur 575 last 0 00000020:00000080:0.0:1787384680.890811:0:17151:0:(genops.c:1406:class_connect()) connect: client 8741dc33-c445-439b-a6e3-d8ded553bb00, cookie 0x7ef423838fba3def 00000004:00100000:0.0:1787384680.890845:0:17151:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00100000:1.0:1787384680.891131:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 8 00000100:00100000:1.0:1787384680.891137:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee28bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2412:x1874208182359936:12345-192.168.203.45@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787384680.891158:0:17150:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 8741dc33-c445-439b-a6e3-d8ded553bb00@192.168.203.45@tcp t0 exp 0000000000000000 cur 575 last 0 00000020:00000080:1.0:1787384680.891196:0:17150:0:(genops.c:1406:class_connect()) connect: client 8741dc33-c445-439b-a6e3-d8ded553bb00, cookie 0x7ef423838fba3df6 00000004:00100000:1.0:1787384680.891211:0:17150:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:1.0:1787384680.891455:0:17150:0:(import.c:65:import_set_state_nolock()) ffff98f7c2228000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787384680.891688:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee28bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+6:2412:x1874208182359936:12345-192.168.203.45@tcp:38:mount.lustre.0 Request processed in 547us (11378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384680.891696:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 8 00000100:00100000:3.0:1787384680.897290:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384680.897922:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182360064 00000100:00100000:1.0:1787384680.897936:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182360064 00000100:00100000:1.0:1787384680.898061:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 9 00000100:00100000:1.0:1787384680.898074:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd75b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+6:0:x1874208182360064:12345-192.168.203.45@tcp:41:mount.lustre.0 00000100:00080000:2.0:1787384680.898250:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:1.0:1787384680.898400:0:17152:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787384680.898558:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd75b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+6:0:x1874208182360064:12345-192.168.203.45@tcp:41:mount.lustre.0 Request processed in 485us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384680.898568:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 9 00000100:00080000:0.0:1787384680.899598:0:17151:0:(import.c:65:import_set_state_nolock()) ffff98f7c236c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787384680.899670:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+6:2412:x1874208182359680:12345-192.168.203.45@tcp:38:mount.lustre.0 Request processed in 8966us (19720us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384680.899680:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 7 00000100:00100000:2.0:1787384680.910913:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384680.911018:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182360192 00000100:00100000:3.0:1787384680.911033:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182360192 00000100:00100000:3.0:1787384680.911138:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 10 00000100:00100000:3.0:1787384680.911150:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+6:14912:x1874208182360192:12345-192.168.203.45@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787384680.911205:0:18681:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787384680.911329:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+6:14912:x1874208182360192:12345-192.168.203.45@tcp:41:mount.lustre.0 Request processed in 182us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384680.911338:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 10 00000100:00080000:0.0:1787384680.911636:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384680.912877:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384680.915755:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182359808 00000100:00100000:1.0:1787384680.915772:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182359808 00000100:00100000:1.0:1787384680.915856:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 11 00000100:00100000:1.0:1787384680.915867:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+6:0:x1874208182359808:12345-192.168.203.45@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787384680.915907:0:17152:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787384680.915993:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+6:0:x1874208182359808:12345-192.168.203.45@tcp:41:mount.lustre.0 Request processed in 127us (3124us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384680.916001:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 11 00000100:00100000:3.0:1787384680.916639:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384680.917616:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182360320 00000100:00100000:0.0:1787384680.917633:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182360320 00000100:00100000:0.0:1787384680.917741:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 12 00000100:00100000:0.0:1787384680.917754:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+6:14912:x1874208182360320:12345-192.168.203.45@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787384680.917906:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+6:14912:x1874208182360320:12345-192.168.203.45@tcp:40:mount.lustre.0 Request processed in 155us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384680.917914:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 12 00000100:00100000:3.0:1787384680.924640:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384680.924680:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384680.924718:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384680.924869:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182360704 00000100:00100000:1.0:1787384680.924879:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182360704 00000100:00100000:1.0:1787384680.924947:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 3 00000100:00100000:1.0:1787384680.924960:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd758700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8741dc33-c445-439b-a6e3-d8ded553bb00+6:14912:x1874208182360704:12345-192.168.203.45@tcp:900:mount.lustre.0 00000100:00100000:0.0:1787384680.924985:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182360448 00000100:00100000:0.0:1787384680.925000:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182360448 00000100:00100000:0.0:1787384680.925057:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182360576 00000100:00100000:1.0:1787384680.925058:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd758700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8741dc33-c445-439b-a6e3-d8ded553bb00+6:14912:x1874208182360704:12345-192.168.203.45@tcp:900:mount.lustre.0 Request processed in 99us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384680.925064:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182360576 00000100:00100000:1.0:1787384680.925073:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 3 00000100:00100000:0.0:1787384680.925110:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 19 00000100:00100000:0.0:1787384680.925124:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd759880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2412:x1874208182360448:12345-192.168.203.45@tcp:8:mount.lustre.0 00000100:00100000:2.0:1787384680.925130:0:19186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 20 00000100:00100000:2.0:1787384680.925137:0:19186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd75b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2412:x1874208182360576:12345-192.168.203.45@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787384680.925164:0:19186:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 8741dc33-c445-439b-a6e3-d8ded553bb00@192.168.203.45@tcp t0 exp 0000000000000000 cur 576 last 0 00010000:00080000:0.0:1787384680.925164:0:18658:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 8741dc33-c445-439b-a6e3-d8ded553bb00@192.168.203.45@tcp t0 exp 0000000000000000 cur 576 last 0 00000020:00000080:2.0:1787384680.925206:0:19186:0:(genops.c:1406:class_connect()) connect: client 8741dc33-c445-439b-a6e3-d8ded553bb00, cookie 0x7ef423838fba3e04 00000020:00000080:0.0:1787384680.925206:0:18658:0:(genops.c:1406:class_connect()) connect: client 8741dc33-c445-439b-a6e3-d8ded553bb00, cookie 0x7ef423838fba3dfd 00002000:00100000:2.0:1787384680.925220:0:19186:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8741dc33-c445-439b-a6e3-d8ded553bb00/ffff98f8f87a1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113671 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787384680.925243:0:19186:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00100000:0.0:1787384680.925406:0:18658:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8741dc33-c445-439b-a6e3-d8ded553bb00/ffff98f7c236c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113671 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787384680.925414:0:18658:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:2.0:1787384680.925568:0:19186:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00002000:00080000:0.0:1787384680.925568:0:18658:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787384680.925609:0:19186:0:(import.c:65:import_set_state_nolock()) ffff98f7c4321800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1787384680.936650:0:18658:0:(import.c:65:import_set_state_nolock()) ffff98f7c2369000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787384680.936744:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd759880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+6:2412:x1874208182360448:12345-192.168.203.45@tcp:8:mount.lustre.0 Request processed in 11618us (12111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384680.936756:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 19 00000100:00100000:1.0:1787384680.938212:0:19186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd75b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+6:2412:x1874208182360576:12345-192.168.203.45@tcp:8:mount.lustre.0 Request processed in 13065us (13483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384680.938225:0:19186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 20 00000100:00100000:2.0:1787384680.944648:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384680.944755:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182360832 00000100:00100000:3.0:1787384680.944765:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182360832 00000100:00100000:3.0:1787384680.944961:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 0 00000100:00100000:3.0:1787384680.944972:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+6:14912:x1874208182360832:12345-192.168.203.45@tcp:33:mount.lustre.0 00000004:00080000:1.0:1787384680.950575:0:17153:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5507us 00000004:00200000:3.0:1787384680.976045:0:17153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787384680.976177:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+6:14912:x1874208182360832:12345-192.168.203.45@tcp:33:mount.lustre.0 Request processed in 31203us (31534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384680.976188:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 0 00000100:00100000:3.0:1787384681.296575:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384681.298915:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182360960 00000100:00100000:1.0:1787384681.298937:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182360960 00000100:00100000:1.0:1787384681.299049:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 13 00000100:00100000:1.0:1787384681.299063:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd758000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+6:14961:x1874208182360960:12345-192.168.203.45@tcp:101:mkdir.0 00010000:00010000:1.0:1787384681.299113:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384681.301639:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba3e0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3b53 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384681.301879:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba3e12 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384681.301894:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba3e12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384681.301909:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba3e12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384681.302213:0:17152:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787384681.302219:0:17152:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787384681.302254:0:17152:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba3e12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384681.302285:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba3e0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3b53 expref: 8 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384681.302306:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba3e12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3b53 expref: 7 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384681.302315:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f8edc2f300) 00010000:00010000:1.0:1787384681.302318:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787384681.302321:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965bc00, rc 0) 00000100:00100000:1.0:1787384681.303887:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd758000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+7:14961:x1874208182360960:12345-192.168.203.45@tcp:101:mkdir.0 Request processed in 4819us (7317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384681.303906:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 13 00010000:00010000:0.0:1787384681.850170:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384681.911551:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203415680:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787384681.911627:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384681.912264:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203415680 00000100:00100000:3.0:1787384681.912280:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203415680 00000100:00100000:3.0:1787384681.912353:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787384681.912370:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203415680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787384681.912397:0:18660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00080000:0.0:1787384681.912553:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787384681.912565:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee28aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203415936:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787384681.912598:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384681.912630:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787384681.912641:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee28b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203415808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384681.912668:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384681.912715:0:18659:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1787384681.912730:0:18659:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1787384681.912887:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203415936 00000100:00100000:0.0:1787384681.912896:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203415936 00000100:00100000:0.0:1787384681.912920:0:18659:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1787384681.912929:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203415808 00000100:00100000:0.0:1787384681.913438:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203415808 00000100:00080000:0.0:1787384681.913471:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787384681.913568:0:19944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787384681.913577:0:19944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee28a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203415936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787384681.913598:0:19944:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787384681.913657:0:19944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee28a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203415936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384681.913664:0:19944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787384681.913713:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee28aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203415936:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787384681.913738:0:19944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787384681.913750:0:19944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1874208203415808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787384681.913759:0:19944:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787384681.913825:0:19944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1874208203415808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384681.913831:0:19944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787384681.913875:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee28b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203415808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384681.913916:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee144380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57899b24-a33b-4177-9883-79b5fe35053f:3653:1874208203416064:0@lo:400:kworker.0 00000100:00100000:0.0:1787384681.914159:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384681.914205:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203416064 00000100:00100000:0.0:1787384681.914211:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203416064 00000100:00100000:0.0:1787384681.914241:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787384681.914247:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+24:3653:x1874208203416064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384681.914280:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+24:3653:x1874208203416064:12345-0@lo:400:kworker.0 Request processed in 33us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384681.914294:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787384681.914326:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee144380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57899b24-a33b-4177-9883-79b5fe35053f:3653:1874208203416064:0@lo:400:kworker.0 00000100:00100000:3.0:1787384681.918615:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203415680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6237us (6977us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384681.918636:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787384681.919050:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee146300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203416576:0@lo:400:kworker.0 00000100:00100000:3.0:1787384681.919134:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384681.919165:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203417088:0@lo:400:kworker.0 00000100:00100000:3.0:1787384681.919196:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384681.919227:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787384681.919263:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee145f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203416192:0@lo:400:kworker.0 00000100:00100000:3.0:1787384681.919285:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384681.919308:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee147100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874208203416704:0@lo:400:kworker.0 00000100:00100000:3.0:1787384681.919331:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384681.919354:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874208203417216:0@lo:400:kworker.0 00000100:00100000:3.0:1787384681.919380:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384681.919417:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203416576 00000100:00100000:3.0:1787384681.919429:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203416576 00000100:00100000:3.0:1787384681.919468:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203416192 00000100:00100000:3.0:1787384681.919471:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203416192 00000100:00100000:3.0:1787384681.919493:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787384681.919501:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203416576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384681.919563:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203416576:12345-0@lo:400:kworker.0 Request processed in 62us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384681.919570:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787384681.919590:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787384681.919597:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203416192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384681.919632:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203416192:12345-0@lo:400:kworker.0 Request processed in 36us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384681.919660:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787384681.919684:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203417088 00000100:00100000:3.0:1787384681.919688:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203417088 00000100:00100000:3.0:1787384681.919729:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203416704 00000100:00100000:3.0:1787384681.919732:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203416704 00000100:00100000:3.0:1787384681.919750:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203417216 00000100:00100000:3.0:1787384681.919753:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203417216 00000100:00100000:3.0:1787384681.919767:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787384681.919812:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874208203417088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384681.919849:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874208203417088:12345-0@lo:400:kworker.0 Request processed in 70us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384681.919862:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787384681.919875:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787384681.919882:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874208203416704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384681.919907:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874208203416704:12345-0@lo:400:kworker.0 Request processed in 26us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384681.919913:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787384681.919923:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787384681.920155:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874208203417216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384681.920185:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874208203417216:12345-0@lo:400:kworker.0 Request processed in 256us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384681.920190:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1787384681.920223:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787384681.920227:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787384681.920280:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee145f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203416192:0@lo:400:kworker.0 00000100:00100000:3.0:1787384681.920293:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee147100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874208203416704:0@lo:400:kworker.0 00010000:00080000:3.0:1787384681.920322:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee145500 x1874208203417216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384681.920333:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874208203417216:0@lo:400:kworker.0 00000100:00100000:3.0:1787384681.920350:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee146300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203416576:0@lo:400:kworker.0 00000100:00100000:3.0:1787384681.920360:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203417088:0@lo:400:kworker.0 00000100:00100000:3.0:1787384681.920428:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee144000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874208203416448:0@lo:400:kworker.0 00000100:00100000:3.0:1787384681.920466:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384681.920485:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee145880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874208203416960:0@lo:400:kworker.0 00000100:00100000:3.0:1787384681.920511:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384681.920543:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203416448 00000100:00100000:3.0:1787384681.920546:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203416448 00000100:00100000:3.0:1787384681.920572:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203416960 00000100:00100000:3.0:1787384681.920575:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203416960 00000100:00100000:3.0:1787384681.920598:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787384681.920604:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874208203416448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384681.920645:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874208203416448:12345-0@lo:400:kworker.0 Request processed in 41us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384681.920651:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787384681.920671:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787384681.920677:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874208203416960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384681.920711:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874208203416960:12345-0@lo:400:kworker.0 Request processed in 34us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384681.920716:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1787384681.920738:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787384681.920768:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee144000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874208203416448:0@lo:400:kworker.0 00010000:00080000:3.0:1787384681.920805:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee145880 x1874208203416960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384681.920820:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee145880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874208203416960:0@lo:400:kworker.0 00000100:00100000:1.0:1787384681.921519:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee146a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203416320:0@lo:400:kworker.0 00000100:00100000:1.0:1787384681.921571:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384681.921609:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee144a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203416832:0@lo:400:kworker.0 00000100:00100000:1.0:1787384681.921638:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384681.921676:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203416832 00000100:00100000:1.0:1787384681.921680:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203416832 00000100:00100000:1.0:1787384681.921722:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787384681.921736:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee146d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203416832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384681.921827:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee146d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203416832:12345-0@lo:400:kworker.0 Request processed in 92us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384681.921834:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1787384681.921852:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384681.921882:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee144a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203416832:0@lo:400:kworker.0 00000100:00100000:0.0:1787384681.921981:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203416320 00000100:00100000:0.0:1787384681.921985:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203416320 00000100:00100000:0.0:1787384681.922025:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787384681.922033:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203416320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384681.922092:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203416320:12345-0@lo:400:kworker.0 Request processed in 61us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384681.922287:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee146a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203416320:0@lo:400:kworker.0 00000100:00100000:0.0:1787384681.922641:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787384681.923242:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203415680:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787384682.429438:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787384682.429465:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203417344:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787384682.429538:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384682.429593:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203417344 00000100:00100000:0.0:1787384682.429601:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203417344 00000100:00100000:0.0:1787384682.429647:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787384682.429656:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee28b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203417344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787384682.429690:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787384682.429731:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee28b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203417344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384682.429738:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787384682.429812:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203417344:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787384682.431334:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c35db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203417472:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787384682.431385:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384682.431478:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203417472 00000100:00100000:3.0:1787384682.431484:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203417472 00000100:00100000:3.0:1787384682.431527:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787384682.431535:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee28aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203417472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787384682.431583:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787384682.431631:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee28aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203417472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384682.431637:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787384682.431717:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c35db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203417472:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787384682.875286:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787384682.943497:0:19472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8741dc33-c445-439b-a6e3-d8ded553bb00 00000001:00080000:3.0:1787384682.943512:0:19472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000040:00080000:3.0:1787384683.320170:0:17904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787384683.895021:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384683.927440:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384683.927737:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182361088 00000100:00100000:3.0:1787384683.927748:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182361088 00000100:00100000:3.0:1787384683.927851:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 14 00000100:00100000:3.0:1787384683.927861:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+7:15013:x1874208182361088:12345-192.168.203.45@tcp:41:lfs.0 00000004:00000024:3.0:1787384683.927912:0:17151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787384683.928020:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+7:15013:x1874208182361088:12345-192.168.203.45@tcp:41:lfs.0 Request processed in 160us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384683.928028:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 14 00000100:00080000:1.0:1787384683.928168:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384683.939244:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384683.939730:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182361216 00000100:00100000:1.0:1787384683.939739:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182361216 00000100:00100000:1.0:1787384683.939858:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 15 00000100:00100000:1.0:1787384683.939869:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+6:15013:x1874208182361216:12345-192.168.203.45@tcp:41:lfs.0 00000004:00000024:1.0:1787384683.939908:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787384683.940007:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+6:15013:x1874208182361216:12345-192.168.203.45@tcp:41:lfs.0 Request processed in 139us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384683.940016:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 15 00000100:00080000:3.0:1787384683.940330:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787384683.943832:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384683.944038:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182361344 00000100:00100000:0.0:1787384683.944058:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182361344 00000100:00100000:0.0:1787384683.944140:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 11 00000100:00100000:0.0:1787384683.944150:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8741dc33-c445-439b-a6e3-d8ded553bb00+6:15013:x1874208182361344:12345-192.168.203.45@tcp:13:lfs.0 00002000:00000024:0.0:1787384683.944181:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787384683.944289:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8741dc33-c445-439b-a6e3-d8ded553bb00+6:15013:x1874208182361344:12345-192.168.203.45@tcp:13:lfs.0 Request processed in 140us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384683.944297:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 11 00000100:00080000:3.0:1787384683.944406:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787384683.947881:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384683.948072:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182361472 00000100:00100000:3.0:1787384683.948108:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182361472 00000100:00100000:3.0:1787384683.948182:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 12 00000100:00100000:3.0:1787384683.948193:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee28ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8741dc33-c445-439b-a6e3-d8ded553bb00+5:15013:x1874208182361472:12345-192.168.203.45@tcp:13:lfs.0 00002000:00000024:3.0:1787384683.948224:0:18660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787384683.948300:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee28ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8741dc33-c445-439b-a6e3-d8ded553bb00+5:15013:x1874208182361472:12345-192.168.203.45@tcp:13:lfs.0 Request processed in 109us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384683.948308:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 12 00000100:00080000:1.0:1787384683.948376:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787384684.248062:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384684.248251:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182361600 00000100:00100000:3.0:1787384684.248261:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182361600 00000100:00100000:3.0:1787384684.248322:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 131 00000100:00100000:3.0:1787384684.248332:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b965c805-ceb8-4757-b53e-03d6d45231a8+10:15044:x1874208182361600:12345-192.168.203.45@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787384684.248347:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384684.248374:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8f58ccc00/0x7ef423838fba3e19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3b5a expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384684.248400:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f58ccc00/0x7ef423838fba3e19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3b5a expref: 11 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384684.248412:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8f58ccc00/0x7ef423838fba3e19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3b5a expref: 11 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384684.248421:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58ccc00, rc 0) 00000100:00100000:3.0:1787384684.248480:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b965c805-ceb8-4757-b53e-03d6d45231a8+11:15044:x1874208182361600:12345-192.168.203.45@tcp:101:mount.lustre.0 Request processed in 148us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384684.248487:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 131 00000100:00100000:2.0:1787384684.278301:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384684.278392:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182361728 00000100:00100000:0.0:1787384684.278402:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182361728 00000100:00100000:0.0:1787384684.278488:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 132 00000100:00100000:0.0:1787384684.278497:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b965c805-ceb8-4757-b53e-03d6d45231a8+11:15044:x1874208182361728:12345-192.168.203.45@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787384684.278661:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b965c805-ceb8-4757-b53e-03d6d45231a8+11:15044:x1874208182361728:12345-192.168.203.45@tcp:501:mount.lustre.0 Request processed in 164us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384684.278669:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 132 00000100:00100000:1.0:1787384684.287322:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384684.287480:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182361856 00000100:00100000:0.0:1787384684.287489:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182361856 00000100:00100000:0.0:1787384684.287577:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 133 00000100:00100000:0.0:1787384684.287587:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b965c805-ceb8-4757-b53e-03d6d45231a8+11:15044:x1874208182361856:12345-192.168.203.45@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787384684.287713:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b965c805-ceb8-4757-b53e-03d6d45231a8+11:15044:x1874208182361856:12345-192.168.203.45@tcp:503:mount.lustre.0 Request processed in 127us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384684.287720:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 133 00000100:00100000:2.0:1787384684.305439:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384684.305526:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182361984 00000100:00100000:0.0:1787384684.305536:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182361984 00000100:00100000:0.0:1787384684.305587:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 134 00000100:00100000:0.0:1787384684.305596:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b965c805-ceb8-4757-b53e-03d6d45231a8+11:15053:x1874208182361984:12345-192.168.203.45@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787384684.306873:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b965c805-ceb8-4757-b53e-03d6d45231a8+11:15053:x1874208182361984:12345-192.168.203.45@tcp:502:llog_process_th.0 Request processed in 1261us (1427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384684.306885:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 134 00000100:00100000:2.0:1787384684.342334:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384684.342824:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182362112 00000100:00100000:0.0:1787384684.342834:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182362112 00000100:00100000:0.0:1787384684.342888:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 135 00000100:00100000:0.0:1787384684.342897:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b965c805-ceb8-4757-b53e-03d6d45231a8+11:15053:x1874208182362112:12345-192.168.203.45@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787384684.343109:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b965c805-ceb8-4757-b53e-03d6d45231a8+11:15053:x1874208182362112:12345-192.168.203.45@tcp:502:llog_process_th.0 Request processed in 148us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384684.343118:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 135 00000100:00100000:1.0:1787384684.350334:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384684.351409:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182362240 00000100:00100000:0.0:1787384684.351422:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182362240 00000100:00100000:0.0:1787384684.351744:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 136 00000100:00100000:0.0:1787384684.351755:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b965c805-ceb8-4757-b53e-03d6d45231a8+11:15053:x1874208182362240:12345-192.168.203.45@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787384684.351952:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b965c805-ceb8-4757-b53e-03d6d45231a8+11:15053:x1874208182362240:12345-192.168.203.45@tcp:502:llog_process_th.0 Request processed in 198us (1627us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384684.351969:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 136 00000100:00100000:2.0:1787384684.355402:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384684.355536:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182362368 00000100:00100000:3.0:1787384684.355546:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182362368 00000100:00100000:3.0:1787384684.355660:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 137 00000100:00100000:3.0:1787384684.355682:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b965c805-ceb8-4757-b53e-03d6d45231a8+11:15044:x1874208182362368:12345-192.168.203.45@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787384684.355698:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384684.355715:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8f58cd800/0x7ef423838fba3e20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3b8b expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384684.355739:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f58cd800/0x7ef423838fba3e20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3b8b expref: 12 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384684.355749:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8f58cd800/0x7ef423838fba3e20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3b8b expref: 12 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384684.355758:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cd800, rc 0) 00000100:00100000:3.0:1787384684.355845:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b965c805-ceb8-4757-b53e-03d6d45231a8+12:15044:x1874208182362368:12345-192.168.203.45@tcp:101:mount.lustre.0 Request processed in 165us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384684.355853:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 137 00000100:00100000:2.0:1787384684.365322:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384684.365734:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182362496 00000100:00100000:0.0:1787384684.365746:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182362496 00000100:00100000:0.0:1787384684.365831:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 138 00000100:00100000:0.0:1787384684.365842:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b965c805-ceb8-4757-b53e-03d6d45231a8+12:15044:x1874208182362496:12345-192.168.203.45@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787384684.365874:0:17143:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787384684.365898:0:17143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787384684.365902:0:17143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787384684.365905:0:17143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787384684.365914:0:17143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787384684.365916:0:17143:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1787384684.367917:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b965c805-ceb8-4757-b53e-03d6d45231a8+12:15044:x1874208182362496:12345-192.168.203.45@tcp:256:mount.lustre.0 Request processed in 2067us (2595us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384684.367930:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 138 00000100:00100000:2.0:1787384684.370856:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384684.371670:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182362624 00000100:00100000:3.0:1787384684.371681:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182362624 00000100:00100000:3.0:1787384684.371741:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 139 00000100:00100000:3.0:1787384684.371751:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b965c805-ceb8-4757-b53e-03d6d45231a8+12:15044:x1874208182362624:12345-192.168.203.45@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787384684.371770:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384684.371812:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8f58cc000/0x7ef423838fba3e27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3b92 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384684.371838:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f58cc000/0x7ef423838fba3e27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3b92 expref: 13 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384684.371864:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8f58cc000/0x7ef423838fba3e27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3b92 expref: 13 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384684.371885:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cc000, rc 0) 00000100:00100000:3.0:1787384684.372484:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b965c805-ceb8-4757-b53e-03d6d45231a8+13:15044:x1874208182362624:12345-192.168.203.45@tcp:101:mount.lustre.0 Request processed in 731us (1634us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384684.372492:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 139 00000100:00100000:2.0:1787384684.376310:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384684.376407:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182362752 00000100:00100000:3.0:1787384684.376417:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182362752 00000100:00100000:3.0:1787384684.376547:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 140 00000100:00100000:3.0:1787384684.376567:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b965c805-ceb8-4757-b53e-03d6d45231a8+13:15044:x1874208182362752:12345-192.168.203.45@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787384684.376747:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b965c805-ceb8-4757-b53e-03d6d45231a8+13:15044:x1874208182362752:12345-192.168.203.45@tcp:501:mount.lustre.0 Request processed in 189us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384684.376756:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 140 00000100:00100000:0.0:1787384684.379381:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384684.379483:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182362880 00000100:00100000:3.0:1787384684.379492:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182362880 00000100:00100000:3.0:1787384684.379861:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 141 00000100:00100000:3.0:1787384684.379882:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b965c805-ceb8-4757-b53e-03d6d45231a8+13:15044:x1874208182362880:12345-192.168.203.45@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787384684.380042:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b965c805-ceb8-4757-b53e-03d6d45231a8+13:15044:x1874208182362880:12345-192.168.203.45@tcp:503:mount.lustre.0 Request processed in 171us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384684.380051:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 141 00000100:00100000:2.0:1787384684.383840:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384684.383985:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182363008 00000100:00100000:3.0:1787384684.383995:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182363008 00000100:00100000:3.0:1787384684.384100:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 142 00000100:00100000:3.0:1787384684.384112:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b965c805-ceb8-4757-b53e-03d6d45231a8+13:15057:x1874208182363008:12345-192.168.203.45@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787384684.384273:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b965c805-ceb8-4757-b53e-03d6d45231a8+13:15057:x1874208182363008:12345-192.168.203.45@tcp:502:llog_process_th.0 Request processed in 161us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384684.384281:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 142 00000100:00100000:2.0:1787384684.391134:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384684.391310:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182363136 00000100:00100000:3.0:1787384684.391321:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182363136 00000100:00100000:3.0:1787384684.391377:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 143 00000100:00100000:3.0:1787384684.391387:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b965c805-ceb8-4757-b53e-03d6d45231a8+13:15057:x1874208182363136:12345-192.168.203.45@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787384684.391538:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b965c805-ceb8-4757-b53e-03d6d45231a8+13:15057:x1874208182363136:12345-192.168.203.45@tcp:502:llog_process_th.0 Request processed in 152us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384684.391547:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 143 00000100:00100000:0.0:1787384684.404718:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384684.404944:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384684.409590:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182363264 00000100:00100000:2.0:1787384684.409604:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182363264 00000100:00100000:3.0:1787384684.412266:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182363520 00000100:00100000:3.0:1787384684.412279:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182363520 00000100:00100000:3.0:1787384684.412402:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 16 00000100:00100000:3.0:1787384684.412411:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c3a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2412:x1874208182363264:12345-192.168.203.45@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787384684.412442:0:17151:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from bd0e9f41-df2c-4a7c-aa79-798e7ec4de38@192.168.203.45@tcp t0 exp 0000000000000000 cur 579 last 0 00000100:00100000:2.0:1787384684.412478:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 17 00000020:00000080:3.0:1787384684.412479:0:17151:0:(genops.c:1406:class_connect()) connect: client bd0e9f41-df2c-4a7c-aa79-798e7ec4de38, cookie 0x7ef423838fba3e2e 00000100:00100000:2.0:1787384684.412484:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2412:x1874208182363520:12345-192.168.203.45@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787384684.412501:0:18681:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from bd0e9f41-df2c-4a7c-aa79-798e7ec4de38@192.168.203.45@tcp t0 exp 0000000000000000 cur 579 last 0 00000004:00100000:3.0:1787384684.412503:0:17151:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000020:00000080:2.0:1787384684.412525:0:18681:0:(genops.c:1406:class_connect()) connect: client bd0e9f41-df2c-4a7c-aa79-798e7ec4de38, cookie 0x7ef423838fba3e35 00000004:00100000:2.0:1787384684.412599:0:18681:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:2.0:1787384684.412738:0:18681:0:(import.c:65:import_set_state_nolock()) ffff98f8d01e1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787384684.413003:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+6:2412:x1874208182363520:12345-192.168.203.45@tcp:38:mount.lustre.0 Request processed in 516us (8091us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384684.413012:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 17 00000100:00080000:3.0:1787384684.413623:0:17151:0:(import.c:65:import_set_state_nolock()) ffff98f8fde27000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787384684.413677:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c3a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+6:2412:x1874208182363264:12345-192.168.203.45@tcp:38:mount.lustre.0 Request processed in 1265us (8968us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384684.413684:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 16 00000100:00100000:2.0:1787384684.420806:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384684.420902:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384684.421547:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384684.422359:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182363648 00000100:00100000:0.0:1787384684.422370:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182363648 00000100:00100000:0.0:1787384684.422454:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182363776 00000100:00100000:0.0:1787384684.422458:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182363776 00000100:00100000:0.0:1787384684.422486:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 18 00000100:00100000:0.0:1787384684.422496:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+6:0:x1874208182363648:12345-192.168.203.45@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787384684.422527:0:18681:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00080000:1.0:1787384684.422673:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787384684.422677:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787384684.422694:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 19 00000100:00100000:1.0:1787384684.422704:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+6:15044:x1874208182363776:12345-192.168.203.45@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787384684.422719:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787384684.422775:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+6:15044:x1874208182363776:12345-192.168.203.45@tcp:41:mount.lustre.0 Request processed in 73us (1872us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384684.422800:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 19 00000100:00100000:1.0:1787384684.424654:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+6:0:x1874208182363648:12345-192.168.203.45@tcp:41:mount.lustre.0 Request processed in 2152us (3875us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384684.424665:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 18 00000100:00100000:0.0:1787384684.426348:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182363392 00000100:00100000:0.0:1787384684.426361:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182363392 00000100:00100000:0.0:1787384684.426422:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 20 00000100:00100000:0.0:1787384684.426431:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+6:0:x1874208182363392:12345-192.168.203.45@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787384684.426458:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787384684.426533:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+6:0:x1874208182363392:12345-192.168.203.45@tcp:41:mount.lustre.0 Request processed in 102us (4987us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384684.426541:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 20 00000100:00100000:0.0:1787384684.429829:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384684.429909:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182363904 00000100:00100000:1.0:1787384684.429919:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182363904 00000100:00100000:1.0:1787384684.429986:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 21 00000100:00100000:1.0:1787384684.429996:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+6:15044:x1874208182363904:12345-192.168.203.45@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787384684.430289:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+6:15044:x1874208182363904:12345-192.168.203.45@tcp:40:mount.lustre.0 Request processed in 92us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384684.430299:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 21 00000100:00100000:2.0:1787384684.437332:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384684.439493:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384684.439642:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384684.439713:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182364288 00000100:00100000:0.0:1787384684.439723:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182364288 00000100:00100000:0.0:1787384684.439771:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 4 00000100:00100000:0.0:1787384684.439797:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f91d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+6:15044:x1874208182364288:12345-192.168.203.45@tcp:900:mount.lustre.0 00000100:00100000:0.0:1787384684.439877:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f91d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+6:15044:x1874208182364288:12345-192.168.203.45@tcp:900:mount.lustre.0 Request processed in 98us (2553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384684.439901:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 4 00000100:00100000:2.0:1787384684.444316:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182364032 00000100:00100000:2.0:1787384684.444330:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182364032 00000100:00100000:2.0:1787384684.444424:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182364160 00000100:00100000:2.0:1787384684.444439:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182364160 00000100:00100000:1.0:1787384684.445346:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 21 00000100:00100000:3.0:1787384684.446200:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384684.447992:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2412:x1874208182364032:12345-192.168.203.45@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787384684.448042:0:18657:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from bd0e9f41-df2c-4a7c-aa79-798e7ec4de38@192.168.203.45@tcp t0 exp 0000000000000000 cur 579 last 0 00000100:00100000:3.0:1787384684.449294:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182364416 00000100:00100000:3.0:1787384684.449307:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182364416 00000100:00100000:3.0:1787384684.449375:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 1 00000100:00100000:3.0:1787384684.449399:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+6:15044:x1874208182364416:12345-192.168.203.45@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787384684.449479:0:17154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787384684.449578:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+6:15044:x1874208182364416:12345-192.168.203.45@tcp:33:mount.lustre.0 Request processed in 181us (3387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384684.449586:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 1 00000020:00000080:1.0:1787384684.450603:0:18657:0:(genops.c:1406:class_connect()) connect: client bd0e9f41-df2c-4a7c-aa79-798e7ec4de38, cookie 0x7ef423838fba3e3c 00002000:00100000:1.0:1787384684.450630:0:18657:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bd0e9f41-df2c-4a7c-aa79-798e7ec4de38/ffff98f7c222a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113671 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787384684.450644:0:18657:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:1.0:1787384684.450728:0:18657:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787384684.450763:0:18657:0:(import.c:65:import_set_state_nolock()) ffff98f7c222a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787384684.450832:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+6:2412:x1874208182364032:12345-192.168.203.45@tcp:8:mount.lustre.0 Request processed in 2852us (11345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384684.450841:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 21 00000100:00100000:1.0:1787384684.450867:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 22 00000100:00100000:1.0:1787384684.450874:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2412:x1874208182364160:12345-192.168.203.45@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787384684.450902:0:18657:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from bd0e9f41-df2c-4a7c-aa79-798e7ec4de38@192.168.203.45@tcp t0 exp 0000000000000000 cur 579 last 0 00000020:00000080:1.0:1787384684.450919:0:18657:0:(genops.c:1406:class_connect()) connect: client bd0e9f41-df2c-4a7c-aa79-798e7ec4de38, cookie 0x7ef423838fba3e43 00002000:00100000:1.0:1787384684.450925:0:18657:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bd0e9f41-df2c-4a7c-aa79-798e7ec4de38/ffff98f7c40d0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113671 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787384684.450931:0:18657:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:1.0:1787384684.450984:0:18657:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787384684.451001:0:18657:0:(import.c:65:import_set_state_nolock()) ffff98f7c40d4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787384684.451025:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+6:2412:x1874208182364160:12345-192.168.203.45@tcp:8:mount.lustre.0 Request processed in 150us (11383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384684.451031:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 22 00000100:00100000:3.0:1787384684.691891:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384684.692010:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182364544 00000100:00100000:0.0:1787384684.692019:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182364544 00000100:00100000:0.0:1787384684.692081:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 22 00000100:00100000:0.0:1787384684.692099:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+6:15080:x1874208182364544:12345-192.168.203.45@tcp:101:mkdir.0 00010000:00010000:0.0:1787384684.692435:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384684.692460:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05e00/0x7ef423838fba3e4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3bc3 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384684.692526:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba3e51 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384684.692540:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba3e51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384684.692553:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba3e51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384684.692601:0:17150:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787384684.692604:0:17150:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787384684.692624:0:17150:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba3e51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384684.692649:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05e00/0x7ef423838fba3e4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3bc3 expref: 8 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384684.692667:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba3e51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3bc3 expref: 7 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384684.692696:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f8edc2f300) 00010000:00010000:0.0:1787384684.692699:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787384684.692703:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3b05a00, rc 0) 00000100:00100000:0.0:1787384684.692768:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+7:15080:x1874208182364544:12345-192.168.203.45@tcp:101:mkdir.0 Request processed in 671us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384684.692838:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 22 00010000:00010000:0.0:1787384684.919074:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384685.943865:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384686.014537:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203417600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787384686.014627:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384686.014728:0:19944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203417600 00000100:00100000:0.0:1787384686.014737:0:19944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203417600 00000100:00100000:0.0:1787384686.014834:0:19944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787384686.014844:0:19944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203417600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787384686.015090:0:19944:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787384686.015146:0:19944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203417600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 303us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384686.015154:0:19944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1787384686.015179:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787384686.015225:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203417600:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787384686.967490:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384687.031152:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203417728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787384687.031220:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384687.031310:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203417728 00000100:00100000:0.0:1787384687.031318:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203417728 00000100:00100000:0.0:1787384687.031377:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787384687.031387:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203417728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787384687.031414:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787384687.031457:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203417728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384687.031472:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1787384687.031550:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787384687.031577:0:3654:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1787384687.031598:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203417728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384687.031788:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203417984:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787384687.031814:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384687.031885:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203417856:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787384687.031912:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384687.031950:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203417984 00000100:00100000:1.0:1787384687.031955:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203417984 00000100:00100000:1.0:1787384687.031983:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203417856 00000100:00100000:1.0:1787384687.031987:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203417856 00000100:00100000:1.0:1787384687.032002:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787384687.032008:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203417984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787384687.032019:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787384687.046177:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c40dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57899b24-a33b-4177-9883-79b5fe35053f:3653:1874208203418112:0@lo:400:kworker.0 00000100:00100000:2.0:1787384687.046253:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384687.046298:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787384687.046305:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4307800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203418240:0@lo:400:kworker.0 00000100:00100000:2.0:1787384687.046334:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384687.046366:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203418112 00000100:00100000:2.0:1787384687.046372:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203418112 00000100:00100000:2.0:1787384687.046420:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787384687.046428:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c5dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+24:3653:x1874208203418112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384687.046480:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c5dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+24:3653:x1874208203418112:12345-0@lo:400:kworker.0 Request processed in 52us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384687.046488:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787384687.046518:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203418240 00000100:00100000:2.0:1787384687.046521:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203418240 00000100:00100000:2.0:1787384687.046551:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787384687.046557:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203418240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384687.046589:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203418240:12345-0@lo:400:kworker.0 Request processed in 32us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384687.046595:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787384687.046628:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4307800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203418240:0@lo:400:kworker.0 00000100:00100000:2.0:1787384687.046637:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c40dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57899b24-a33b-4177-9883-79b5fe35053f:3653:1874208203418112:0@lo:400:kworker.0 00000100:00100000:2.0:1787384687.046673:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4306a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203418368:0@lo:400:kworker.0 00000100:00100000:2.0:1787384687.046699:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384687.046758:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203418368 00000100:00100000:2.0:1787384687.046774:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203418368 00000100:00100000:2.0:1787384687.046833:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787384687.046839:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c40dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203418368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384687.046874:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c40dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203418368:12345-0@lo:400:kworker.0 Request processed in 35us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384687.046879:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787384687.046903:0:19944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787384687.046910:0:19944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203417856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787384687.046953:0:19944:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787384687.046989:0:19944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203417856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (15076us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384687.046995:0:19944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1787384687.047016:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787384687.047022:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787384687.047039:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4306a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203418368:0@lo:400:kworker.0 00000100:00100000:2.0:1787384687.047058:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203417856:0@lo:13:osp-pre-1-1.0 00000001:00100000:2.0:1787384687.059379:0:18652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bd0e9f41-df2c-4a7c-aa79-798e7ec4de38 00000001:00100000:2.0:1787384687.059392:0:18652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8741dc33-c445-439b-a6e3-d8ded553bb00 00000100:00100000:1.0:1787384687.059585:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203417984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 27571us (27764us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384687.059598:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787384687.060605:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787384687.060624:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203418496:0@lo:400:kworker.0 00000100:00100000:3.0:1787384687.060686:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384687.060724:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203418496 00000100:00100000:3.0:1787384687.060731:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203418496 00000100:00100000:3.0:1787384687.060775:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787384687.060797:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203418496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384687.060844:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203418496:12345-0@lo:400:kworker.0 Request processed in 49us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384687.060849:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787384687.065263:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203418496:0@lo:400:kworker.0 00000100:00100000:3.0:1787384687.065374:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4307480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203418880:0@lo:400:kworker.0 00000100:00100000:3.0:1787384687.065430:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384687.065484:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787384687.065491:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4305180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874208203419008:0@lo:400:kworker.0 00000100:00100000:3.0:1787384687.065511:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384687.065532:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203417984:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787384687.065538:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203418880 00000100:00100000:3.0:1787384687.065544:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203418880 00000100:00100000:0.0:1787384687.065554:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203419008 00000100:00100000:0.0:1787384687.065556:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203419008 00000100:00100000:2.0:1787384687.065703:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4304700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874208203418752:0@lo:400:kworker.0 00000100:00100000:2.0:1787384687.065735:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384687.079521:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203418624:0@lo:400:kworker.0 00000100:00100000:2.0:1787384687.079585:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384687.079634:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203418624 00000100:00100000:2.0:1787384687.079641:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203418624 00000100:00100000:2.0:1787384687.079683:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787384687.079691:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f914aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203418624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384687.079762:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f914aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203418624:12345-0@lo:400:kworker.0 Request processed in 71us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384687.079769:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787384687.079835:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203418624:0@lo:400:kworker.0 00000100:00080000:2.0:1787384687.079891:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787384687.079897:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384687.079949:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203419136:0@lo:400:kworker.0 00000100:00100000:2.0:1787384687.079976:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384687.082105:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203418752 00000100:00100000:3.0:1787384687.082119:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203418752 00000100:00100000:3.0:1787384687.082184:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787384687.082193:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203418880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384687.082279:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203418880:12345-0@lo:400:kworker.0 Request processed in 87us (16848us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384687.082286:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787384687.082335:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4307480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203418880:0@lo:400:kworker.0 00000100:00100000:3.0:1787384687.082363:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787384687.082372:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874208203419008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384687.082407:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874208203419008:12345-0@lo:400:kworker.0 Request processed in 38us (16894us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384687.082412:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787384687.082426:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787384687.082431:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874208203418752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384687.082455:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874208203418752:12345-0@lo:400:kworker.0 Request processed in 25us (16719us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384687.082460:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1787384687.082483:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4305180 x1874208203419008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384687.082493:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4305180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874208203419008:0@lo:400:kworker.0 00000100:00100000:3.0:1787384687.082571:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4305180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874208203419264:0@lo:400:kworker.0 00000001:00100000:3.0:1787384687.083323:0:17883:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of bd0e9f41-df2c-4a7c-aa79-798e7ec4de38 00000001:00100000:3.0:1787384687.083332:0:17883:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8741dc33-c445-439b-a6e3-d8ded553bb00 00000100:00100000:0.0:1787384687.093458:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384687.093530:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203419136 00000100:00100000:0.0:1787384687.093531:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203419264 00000100:00100000:0.0:1787384687.093539:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203419264 00000100:00100000:1.0:1787384687.093540:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203419136 00000100:00100000:1.0:1787384687.093604:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787384687.093614:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874208203419136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384687.093696:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874208203419136:12345-0@lo:400:kworker.0 Request processed in 84us (13718us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384687.093704:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787384687.093800:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874208203419136:0@lo:400:kworker.0 00000100:00100000:2.0:1787384687.093846:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4304700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874208203418752:0@lo:400:kworker.0 00000100:00100000:2.0:1787384687.095297:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787384687.095314:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874208203419264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384687.095391:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874208203419264:12345-0@lo:400:kworker.0 Request processed in 84us (1941us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384687.095397:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1787384687.095436:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f7c4305180 x1874208203419264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384687.095450:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4305180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874208203419264:0@lo:400:kworker.0 00000001:00100000:3.0:1787384687.097719:0:17130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bd0e9f41-df2c-4a7c-aa79-798e7ec4de38 00000001:00100000:3.0:1787384687.097735:0:17130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8741dc33-c445-439b-a6e3-d8ded553bb00 00000100:00080000:1.0:1787384687.106027:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787384687.106038:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787384687.543644:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4307480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203419392:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787384687.543738:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384687.543991:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203419392 00000100:00100000:1.0:1787384687.544001:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203419392 00000100:00100000:1.0:1787384687.544070:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787384687.544079:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203419392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787384687.544128:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787384687.544184:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203419392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384687.544209:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787384687.545249:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4304a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203419520:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787384687.545309:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384687.545404:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203419520 00000100:00100000:2.0:1787384687.545413:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203419520 00000100:00100000:2.0:1787384687.545477:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787384687.545490:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203419520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787384687.545539:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787384687.545591:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203419520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384687.545613:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787384687.545770:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4304a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203419520:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787384687.547961:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4307480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203419392:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787384687.997119:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787384688.439884:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:0.0:1787384688.467669:0:20030:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787384689.017542:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384689.517749:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384689.517819:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182364672 00000100:00100000:3.0:1787384689.517826:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384689.517830:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182364672 00000100:00100000:3.0:1787384689.517877:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384689.517901:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182364928 00000100:00100000:3.0:1787384689.517907:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384689.517909:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182364928 00000100:00100000:3.0:1787384689.517951:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384689.517974:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384689.517998:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384689.518019:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384689.518065:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 145 00000100:00100000:1.0:1787384689.518076:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c370c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b965c805-ceb8-4757-b53e-03d6d45231a8+13:2413:x1874208182364672:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384689.518139:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c370c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b965c805-ceb8-4757-b53e-03d6d45231a8+13:2413:x1874208182364672:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 65us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384689.518147:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 145 00000100:00080000:1.0:1787384689.518175:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787384689.518775:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182365184 00000100:00100000:0.0:1787384689.518801:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182365184 00000100:00100000:0.0:1787384689.518841:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182365696 00000100:00100000:0.0:1787384689.518844:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182365696 00000100:00100000:0.0:1787384689.518855:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182365056 00000100:00100000:0.0:1787384689.518857:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182365056 00000100:00100000:0.0:1787384689.518871:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 7 00000100:00100000:0.0:1787384689.518878:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4305500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+5:2413:x1874208182365184:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384689.518915:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4305500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+5:2413:x1874208182365184:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 37us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384689.518936:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 7 00000100:00100000:0.0:1787384689.518956:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 8 00000100:00100000:0.0:1787384689.518963:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+6:2413:x1874208182365696:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384689.518997:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+6:2413:x1874208182365696:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 35us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384689.519003:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 8 00000100:00100000:0.0:1787384689.519014:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 9 00000100:00100000:0.0:1787384689.519020:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4307100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+5:2413:x1874208182365056:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384689.519038:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4307100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+5:2413:x1874208182365056:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 19us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384689.519055:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 9 00000100:00100000:2.0:1787384689.520660:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182365440 00000100:00100000:2.0:1787384689.520671:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182365440 00000100:00100000:2.0:1787384689.520717:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182364800 00000100:00100000:2.0:1787384689.520719:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182364800 00000100:00100000:2.0:1787384689.520738:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 45 00000100:00100000:2.0:1787384689.520747:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+5:2413:x1874208182364928:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384689.520816:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+5:2413:x1874208182364928:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 70us (2991us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384689.520824:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 45 00000100:00100000:2.0:1787384689.520840:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 46 00000100:00100000:2.0:1787384689.520846:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+5:2413:x1874208182365440:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384689.520867:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+5:2413:x1874208182365440:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 21us (2962us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384689.520873:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 46 00000100:00100000:2.0:1787384689.520883:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 47 00000100:00100000:2.0:1787384689.520888:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+6:2413:x1874208182364800:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384689.520906:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+6:2413:x1874208182364800:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 18us (2932us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384689.520912:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 47 00000100:00080000:2.0:1787384689.520997:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787384689.521011:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787384689.521014:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787384689.521016:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787384689.525069:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384689.526315:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182365568 00000100:00100000:1.0:1787384689.526326:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182365568 00000100:00100000:0.0:1787384689.526343:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182365312 00000100:00100000:0.0:1787384689.526350:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182365312 00000100:00100000:1.0:1787384689.526399:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 10 00000100:00100000:1.0:1787384689.526410:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4307480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+5:2413:x1874208182365568:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384689.526552:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4307480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+5:2413:x1874208182365568:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 144us (1492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384689.526699:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 10 00000100:00080000:1.0:1787384689.526824:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787384689.528504:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787384689.531848:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 48 00000100:00100000:0.0:1787384689.531873:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+6:2413:x1874208182365312:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384689.531973:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+6:2413:x1874208182365312:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 113us (13953us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384689.531981:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 48 00010000:00010000:0.0:1787384690.039131:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787384690.110592:0:19472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bd0e9f41-df2c-4a7c-aa79-798e7ec4de38 00010000:00010000:1.0:1787384691.079437:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384691.127328:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203419648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787384691.127433:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384691.127667:0:19944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203419648 00000100:00100000:0.0:1787384691.127679:0:19944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203419648 00000100:00100000:0.0:1787384691.127817:0:19944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787384691.127837:0:19944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203419648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787384691.127878:0:19944:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787384691.127944:0:19944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203419648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384691.127952:0:19944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787384691.128022:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203419648:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787384691.128565:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787384692.098583:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384692.158481:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee146680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57899b24-a33b-4177-9883-79b5fe35053f:3651:1874208203419904:0@lo:400:kworker.0 00000100:00100000:1.0:1787384692.158555:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384692.158600:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee144000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203420416:0@lo:400:kworker.0 00000100:00100000:1.0:1787384692.158626:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384692.158658:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee147100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203420928:0@lo:400:kworker.0 00000100:00100000:1.0:1787384692.158681:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384692.158698:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7f04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203421440:0@lo:400:kworker.0 00000100:00100000:1.0:1787384692.158723:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384692.158745:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787384692.158750:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee145c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203420032:0@lo:400:kworker.0 00000100:00100000:1.0:1787384692.158775:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384692.159007:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee147800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203419776:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787384692.159043:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384692.159065:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee145880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203420288:0@lo:400:kworker.0 00000100:00100000:0.0:1787384692.159090:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384692.159108:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203420800:0@lo:400:kworker.0 00000100:00100000:0.0:1787384692.159128:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384692.159145:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874208203421312:0@lo:400:kworker.0 00000100:00100000:0.0:1787384692.159169:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384692.159190:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787384692.159196:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee144700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203420160:0@lo:400:kworker.0 00000100:00100000:0.0:1787384692.159218:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384692.159339:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203420544:0@lo:400:kworker.0 00000100:00100000:1.0:1787384692.159362:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384692.159380:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee145f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203421056:0@lo:400:kworker.0 00000100:00100000:1.0:1787384692.159399:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384692.159441:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203419776 00000100:00100000:1.0:1787384692.159448:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203419776 00000100:00100000:1.0:1787384692.159500:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787384692.159508:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203419776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787384692.159531:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787384692.159566:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203419776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384692.159573:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787384692.159597:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203420032 00000100:00100000:1.0:1787384692.159600:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203420032 00000100:00100000:1.0:1787384692.159616:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203420544 00000100:00100000:1.0:1787384692.159618:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203420544 00000100:00100000:1.0:1787384692.159629:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787384692.159635:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203420032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384692.159672:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203420032:12345-0@lo:400:kworker.0 Request processed in 36us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384692.159687:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787384692.160066:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee146300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203420672:0@lo:400:kworker.0 00000100:00100000:0.0:1787384692.160092:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384692.160109:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee144380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874208203421184:0@lo:400:kworker.0 00000100:00100000:0.0:1787384692.160130:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384692.160162:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee147800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203419776:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787384692.160200:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203420416 00000100:00100000:0.0:1787384692.160204:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203420416 00000100:00100000:0.0:1787384692.160305:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203420928 00000100:00100000:0.0:1787384692.160310:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203420928 00000100:00100000:0.0:1787384692.160323:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203421440 00000100:00100000:0.0:1787384692.160326:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203421440 00000100:00100000:0.0:1787384692.160339:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203421312 00000100:00100000:0.0:1787384692.160342:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203421312 00000100:00100000:0.0:1787384692.160352:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203421056 00000100:00100000:0.0:1787384692.160355:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203421056 00000100:00100000:0.0:1787384692.160378:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203421184 00000100:00100000:0.0:1787384692.160381:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203421184 00000100:00100000:0.0:1787384692.160395:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787384692.160401:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203420416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384692.160437:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203420416:12345-0@lo:400:kworker.0 Request processed in 36us (1809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384692.160443:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787384692.160456:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787384692.160462:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203420928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384692.160489:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203420928:12345-0@lo:400:kworker.0 Request processed in 27us (1807us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384692.160495:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787384692.160506:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787384692.160511:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874208203421440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384692.160536:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874208203421440:12345-0@lo:400:kworker.0 Request processed in 25us (1813us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384692.160541:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787384692.160552:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787384692.160557:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874208203421312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384692.160587:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874208203421312:12345-0@lo:400:kworker.0 Request processed in 30us (1417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384692.160592:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787384692.160601:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787384692.160606:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203421056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384692.160627:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203421056:12345-0@lo:400:kworker.0 Request processed in 21us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384692.160638:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787384692.160649:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787384692.160654:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874208203421184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384692.160679:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874208203421184:12345-0@lo:400:kworker.0 Request processed in 25us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384692.160684:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787384692.160709:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203420288 00000100:00100000:0.0:1787384692.160713:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203420288 00000100:00100000:0.0:1787384692.160730:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203420800 00000100:00100000:0.0:1787384692.160733:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203420800 00000100:00100000:0.0:1787384692.160744:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203420160 00000100:00100000:0.0:1787384692.160746:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203420160 00000100:00100000:0.0:1787384692.160754:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203420672 00000100:00100000:0.0:1787384692.160756:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203420672 00000100:00100000:0.0:1787384692.160765:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787384692.160770:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203420288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384692.163880:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787384692.163959:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203420544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384692.164051:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203420544:12345-0@lo:400:kworker.0 Request processed in 157us (4687us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384692.164059:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1787384692.164092:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787384692.164098:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787384692.164101:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787384692.164104:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787384692.164118:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787384692.164128:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203420800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384692.164162:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203420800:12345-0@lo:400:kworker.0 Request processed in 37us (5033us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384692.164167:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787384692.164182:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787384692.164188:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203420160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384692.164213:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203420160:12345-0@lo:400:kworker.0 Request processed in 25us (4994us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384692.164338:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203420288:12345-0@lo:400:kworker.0 Request processed in 3565us (5245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384692.164611:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787384692.164646:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787384692.164664:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787384692.164673:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203420672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384692.164707:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203420672:12345-0@lo:400:kworker.0 Request processed in 37us (4613us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384692.164713:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787384692.164759:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee144700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203420160:0@lo:400:kworker.0 00000100:00100000:0.0:1787384692.164773:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee146300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203420672:0@lo:400:kworker.0 00000100:00100000:1.0:1787384692.168319:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee145c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203420032:0@lo:400:kworker.0 00000100:00100000:1.0:1787384692.168338:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203420544:0@lo:400:kworker.0 00000100:00100000:1.0:1787384692.168350:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee145f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203421056:0@lo:400:kworker.0 00000100:00100000:1.0:1787384692.168361:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee144000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203420416:0@lo:400:kworker.0 00000100:00100000:1.0:1787384692.168394:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee147100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203420928:0@lo:400:kworker.0 00010000:00080000:1.0:1787384692.168409:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7f04a80 x1874208203421440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384692.168420:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7f04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203421440:0@lo:400:kworker.0 00010000:00080000:0.0:1787384692.168585:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8ee144380 x1874208203421184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384692.168598:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee144380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874208203421184:0@lo:400:kworker.0 00000100:00100000:0.0:1787384692.168614:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee145880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203420288:0@lo:400:kworker.0 00000100:00100000:0.0:1787384692.168624:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203420800:0@lo:400:kworker.0 00000100:00100000:0.0:1787384692.168634:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874208203421312:0@lo:400:kworker.0 00000100:00100000:2.0:1787384692.171334:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203419904 00000100:00100000:2.0:1787384692.171344:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203419904 00000100:00100000:2.0:1787384692.171399:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787384692.171407:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c370dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+24:3651:x1874208203419904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384692.171479:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c370dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+24:3651:x1874208203419904:12345-0@lo:400:kworker.0 Request processed in 72us (12923us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384692.171486:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787384692.171620:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203421568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787384692.171652:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384692.171693:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203421696:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787384692.171714:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384692.171744:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203421568 00000100:00100000:2.0:1787384692.171748:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203421568 00000100:00100000:2.0:1787384692.171771:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203421696 00000100:00100000:2.0:1787384692.171774:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203421696 00000100:00100000:2.0:1787384692.171807:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787384692.171814:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203421568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787384692.171847:0:18660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787384692.171886:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203421568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384692.171892:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787384692.172103:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787384692.172111:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203421696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787384692.172134:0:18660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787384692.172167:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203421696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384692.172173:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787384692.172214:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203421568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787384692.172254:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203421696:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787384692.172278:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee146680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57899b24-a33b-4177-9883-79b5fe35053f:3651:1874208203419904:0@lo:400:kworker.0 00000100:00100000:1.0:1787384692.664703:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4304700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203421952:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787384692.664792:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384692.664963:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c4305180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203421824:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787384692.665005:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384692.665158:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203421952 00000100:00100000:1.0:1787384692.665169:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203421952 00000100:00100000:1.0:1787384692.665205:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203421824 00000100:00100000:1.0:1787384692.665208:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203421824 00000100:00100000:1.0:1787384692.665223:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787384692.665232:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203421952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787384692.665264:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787384692.665310:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203421952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384692.665318:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787384692.665334:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787384692.665339:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203421824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787384692.665355:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787384692.665389:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203421824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 49us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384692.665394:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787384692.665434:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4304700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203421952:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787384692.665555:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c4305180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203421824:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787384693.112381:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787384693.453137:0:20178:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffdaa0ee8b0 00000020:00000080:3.0:1787384693.453153:0:20178:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:3.0:1787384693.453158:0:20178:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:3.0:1787384693.453164:0:20178:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdaa0f0b40 20000000:00000080:3.0:1787384693.453171:0:20178:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98f8f0fdf000 uarg=0000000000000000 20000000:01000000:3.0:1787384693.453214:0:20178:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787384693.453220:0:20178:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787384693.453224:0:20178:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787384693.453997:0:20179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1787384693.454194:0:20178:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787384693.458936:0:20178:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787384693.458966:0:20178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98f8d965a200/0x7ef423838fba3e58 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384693.458985:0:20178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f902158c00/0x7ef423838fba3aed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba3ae6 expref: 23 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384693.458994:0:20178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f8c6140600/0x7ef423838fba3afb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba3af4 expref: 23 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384693.459002:0:20178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f8c6141c00/0x7ef423838fba3b3a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba3b33 expref: 23 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384693.459009:0:20178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f8c6140a00/0x7ef423838fba3c98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba3c91 expref: 23 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384693.459077:0:20178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f8f58cc800/0x7ef423838fba3de8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3b22 expref: 12 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384693.459087:0:20178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98f8f58cc000/0x7ef423838fba3e27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3b92 expref: 12 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384693.459095:0:20178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98f8d965a200/0x7ef423838fba3e58 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384693.459134:0:20178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f8f58cc000/0x7ef423838fba3e27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3b92 expref: 12 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384693.459152:0:20178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f8f58cc000/0x7ef423838fba3e27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3b92 expref: 12 pid: 17142 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384693.459168:0:20178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7f05880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20178:1874208203422080:192.168.203.45@tcp:104: 00010000:00010000:1.0:1787384693.459313:0:20178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f8f58cc800/0x7ef423838fba3de8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3b22 expref: 12 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384693.459322:0:20178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f8f58cc800/0x7ef423838fba3de8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3b22 expref: 12 pid: 17142 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384693.459330:0:20178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7f04380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20178:1874208203422208:192.168.203.45@tcp:104: 00010000:00010000:1.0:1787384693.459356:0:20178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f8c6140a00/0x7ef423838fba3c98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba3c91 expref: 23 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384693.459364:0:20178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f8c6140a00/0x7ef423838fba3c98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba3c91 expref: 23 pid: 17144 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384693.459373:0:20178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7f07480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20178:1874208203422336:0@lo:104: 00000100:00100000:1.0:1787384693.459407:0:20178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787384693.459489:0:20178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f8c6141c00/0x7ef423838fba3b3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba3b33 expref: 23 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384693.459497:0:20178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f8c6141c00/0x7ef423838fba3b3a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba3b33 expref: 23 pid: 17143 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384693.459506:0:20178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7f06680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20178:1874208203422464:0@lo:104: 00000100:00100000:1.0:1787384693.459524:0:20178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787384693.460653:0:20178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f8c6140600/0x7ef423838fba3afb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba3af4 expref: 23 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384693.460668:0:20178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f8c6140600/0x7ef423838fba3afb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba3af4 expref: 23 pid: 17144 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384693.460678:0:20178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7f07800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20178:1874208203422592:0@lo:104: 00000100:00100000:1.0:1787384693.460719:0:20178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384693.461026:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203422336 00000100:00100000:2.0:1787384693.461034:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203422336 00000100:00100000:2.0:1787384693.461075:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203422464 00000100:00100000:2.0:1787384693.461078:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203422464 00000100:00100000:2.0:1787384693.461092:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787384693.461099:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57899b24-a33b-4177-9883-79b5fe35053f+4:20178:x1874208203422336:12345-0@lo:104: 00010000:00010000:2.0:1787384693.461111:0:17133:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f8f58cd400/0x7ef423838fba3c91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba3c98 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384693.461197:0:17133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787384693.461204:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57899b24-a33b-4177-9883-79b5fe35053f+4:20178:x1874208203422336:12345-0@lo:104: Request processed in 105us (1796us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384693.461211:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787384693.461228:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787384693.461234:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57899b24-a33b-4177-9883-79b5fe35053f+3:20178:x1874208203422464:12345-0@lo:104: 00010000:00010000:2.0:1787384693.461248:0:17133:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f7c3952800/0x7ef423838fba3b33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba3b3a expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384693.461399:0:20178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98f902158c00/0x7ef423838fba3aed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ef423838fba3ae6 expref: 23 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384693.461409:0:20178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98f902158c00/0x7ef423838fba3aed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ef423838fba3ae6 expref: 23 pid: 17144 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384693.461419:0:20178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7f06300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20178:1874208203422720:0@lo:104: 00000100:00100000:1.0:1787384693.461441:0:20178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384693.461450:0:20178:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c6113900 going to sleep for 11 seconds 00000100:00100000:1.0:1787384693.461467:0:20178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7f07480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20178:1874208203422336:0@lo:104: 00000100:00100000:1.0:1787384693.461475:0:20178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7f06680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20178:1874208203422464:0@lo:104: 00010000:00010000:0.0:1787384693.461510:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787384693.461518:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f8f58cd400/0x7ef423838fba3c91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba3c98 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384693.461525:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cd400 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:0.0:1787384693.461529:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f8f58cd400/0x7ef423838fba3c91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba3c98 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384693.461537:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f8f58cd400/0x7ef423838fba3c91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba3c98 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787384693.461544:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f8f58cd400/0x7ef423838fba3c91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba3c98 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384693.461550:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787384693.461583:0:17139:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f8f58cd400/0x7ef423838fba3c91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba3c98 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384693.461589:0:17139:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787384693.461610:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f8f58cd400/0x7ef423838fba3c91 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba3c98 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384693.461622:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f8f58cd400/0x7ef423838fba3c91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba3c98 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384693.461634:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384693.461637:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f7c3952800/0x7ef423838fba3b33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba3b3a expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384693.461642:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3952800 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:0.0:1787384693.461645:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f7c3952800/0x7ef423838fba3b33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba3b3a expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384693.461652:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f7c3952800/0x7ef423838fba3b33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba3b3a expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787384693.461658:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f7c3952800/0x7ef423838fba3b33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba3b3a expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384693.461663:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787384693.461675:0:17139:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f7c3952800/0x7ef423838fba3b33 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba3b3a expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384693.461680:0:17139:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787384693.461693:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f7c3952800/0x7ef423838fba3b33 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba3b3a expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384693.461699:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f7c3952800/0x7ef423838fba3b33 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba3b3a expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384693.461708:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384693.461714:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384693.461716:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384693.461723:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787384693.461733:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57899b24-a33b-4177-9883-79b5fe35053f:3651:1874208203422848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384693.461760:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384693.461816:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57899b24-a33b-4177-9883-79b5fe35053f:3653:1874208203422976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384693.461836:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384693.461868:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203422848 00000100:00100000:0.0:1787384693.461872:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203422848 00010000:00010000:0.0:1787384693.461888:0:17136:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f8c6140a00/0x7ef423838fba3c98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba3c91 expref: 24 pid: 17144 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384693.461922:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203422976 00000100:00100000:0.0:1787384693.461925:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203422976 00010000:00010000:0.0:1787384693.461936:0:17136:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f8c6141c00/0x7ef423838fba3b3a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba3b33 expref: 25 pid: 17143 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384693.461953:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787384693.461959:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57899b24-a33b-4177-9883-79b5fe35053f+25:3651:x1874208203422848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787384693.461968:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384693.461973:0:17136:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f8c6140a00/0x7ef423838fba3c98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba3c91 expref: 25 pid: 17144 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384693.461983:0:17136:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f8c6140a00/0x7ef423838fba3c98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba3c91 expref: 25 pid: 17144 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384693.461995:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8c6140a00/0x7ef423838fba3c98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba3c91 expref: 25 pid: 17144 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384693.462007:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384693.462049:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57899b24-a33b-4177-9883-79b5fe35053f+24:3651:x1874208203422848:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384693.462056:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787384693.462069:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787384693.462074:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57899b24-a33b-4177-9883-79b5fe35053f+23:3653:x1874208203422976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787384693.462081:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384693.462085:0:17136:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f8c6141c00/0x7ef423838fba3b3a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba3b33 expref: 23 pid: 17143 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384693.462093:0:17136:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f8c6141c00/0x7ef423838fba3b3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba3b33 expref: 23 pid: 17143 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384693.462103:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8c6141c00/0x7ef423838fba3b3a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba3b33 expref: 23 pid: 17143 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384693.462111:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384693.462132:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57899b24-a33b-4177-9883-79b5fe35053f+22:3653:x1874208203422976:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384693.462138:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787384693.462164:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57899b24-a33b-4177-9883-79b5fe35053f:3653:1874208203422976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384693.462184:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57899b24-a33b-4177-9883-79b5fe35053f:3651:1874208203422848:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787384693.462445:0:17133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1787384693.462453:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57899b24-a33b-4177-9883-79b5fe35053f+3:20178:x1874208203422464:12345-0@lo:104: Request processed in 1219us (2927us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384693.462460:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787384693.462472:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203422592 00000100:00100000:2.0:1787384693.462475:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203422592 00000100:00100000:2.0:1787384693.462489:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203422720 00000100:00100000:2.0:1787384693.462492:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203422720 00000100:00100000:2.0:1787384693.462503:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787384693.462508:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57899b24-a33b-4177-9883-79b5fe35053f+4:20178:x1874208203422592:12345-0@lo:104: 00010000:00010000:2.0:1787384693.462517:0:17133:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f902159e00/0x7ef423838fba3af4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba3afb expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384693.462565:0:17133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787384693.462569:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57899b24-a33b-4177-9883-79b5fe35053f+4:20178:x1874208203422592:12345-0@lo:104: Request processed in 62us (1851us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384693.462575:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787384693.462586:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787384693.462591:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57899b24-a33b-4177-9883-79b5fe35053f+3:20178:x1874208203422720:12345-0@lo:104: 00010000:00010000:2.0:1787384693.462598:0:17133:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba3ae6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba3aed expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384693.462624:0:17133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787384693.462628:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57899b24-a33b-4177-9883-79b5fe35053f+3:20178:x1874208203422720:12345-0@lo:104: Request processed in 38us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384693.462643:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1787384693.462667:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787384693.462672:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f902159e00/0x7ef423838fba3af4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba3afb expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384693.462678:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f902159e00 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384693.462682:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f902159e00/0x7ef423838fba3af4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba3afb expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384693.462689:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f902159e00/0x7ef423838fba3af4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba3afb expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384693.462696:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f902159e00/0x7ef423838fba3af4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba3afb expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384693.462702:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787384693.462722:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f902159e00/0x7ef423838fba3af4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba3afb expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384693.462727:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787384693.462739:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f902159e00/0x7ef423838fba3af4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba3afb expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384693.462746:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f902159e00/0x7ef423838fba3af4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba3afb expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384693.462755:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384693.462757:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba3ae6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ef423838fba3aed expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384693.462772:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f902158600 already unused, calling callback (ffffffffc12b6c20) 10000000:00010000:2.0:1787384693.462800:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba3ae6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ef423838fba3aed expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384693.462912:0:20178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7f07800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20178:1874208203422592:0@lo:104: 00000100:00100000:1.0:1787384693.462921:0:20178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7f06300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20178:1874208203422720:0@lo:104: 00010000:00010000:2.0:1787384693.462954:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba3ae6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ef423838fba3aed expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384693.462961:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba3ae6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ef423838fba3aed expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384693.462967:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787384693.462980:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba3ae6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba3aed expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384693.462986:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787384693.463029:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57899b24-a33b-4177-9883-79b5fe35053f:3651:1874208203423232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384693.463057:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787384693.463155:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384693.463164:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203423232 00000100:00100000:0.0:1787384693.463167:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203423232 00010000:00010000:0.0:1787384693.463185:0:17136:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f902158c00/0x7ef423838fba3aed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba3ae6 expref: 22 pid: 17144 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384693.463205:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787384693.463217:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57899b24-a33b-4177-9883-79b5fe35053f+22:3651:x1874208203423232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787384693.463226:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384693.463231:0:17136:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f902158c00/0x7ef423838fba3aed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba3ae6 expref: 22 pid: 17144 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384693.463239:0:17136:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f902158c00/0x7ef423838fba3aed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba3ae6 expref: 22 pid: 17144 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384693.463249:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f902158c00/0x7ef423838fba3aed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba3ae6 expref: 22 pid: 17144 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384693.463260:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787384693.463296:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba3ae6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba3aed expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384693.463303:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.145@tcp lock: ffff98f902158600/0x7ef423838fba3ae6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ef423838fba3aed expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384693.463315:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384693.463316:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384693.463318:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384693.463327:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57899b24-a33b-4177-9883-79b5fe35053f:3654:1874208203423104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787384693.463350:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384693.463379:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203423104 00000100:00100000:2.0:1787384693.463383:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203423104 00010000:00010000:2.0:1787384693.463395:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f8c6140600/0x7ef423838fba3afb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba3af4 expref: 22 pid: 17144 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384693.463414:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787384693.463420:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57899b24-a33b-4177-9883-79b5fe35053f+22:3654:x1874208203423104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787384693.463427:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384693.463431:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f8c6140600/0x7ef423838fba3afb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ef423838fba3af4 expref: 22 pid: 17144 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384693.463438:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f8c6140600/0x7ef423838fba3afb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ef423838fba3af4 expref: 22 pid: 17144 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384693.463447:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8c6140600/0x7ef423838fba3afb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ef423838fba3af4 expref: 22 pid: 17144 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384693.463455:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384693.463477:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57899b24-a33b-4177-9883-79b5fe35053f+21:3654:x1874208203423104:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384693.463483:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787384693.463505:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57899b24-a33b-4177-9883-79b5fe35053f:3654:1874208203423104:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787384693.463540:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384693.463768:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57899b24-a33b-4177-9883-79b5fe35053f+20:3651:x1874208203423232:12345-0@lo:103:ldlm_bl.0 Request processed in 551us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384693.463937:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787384693.464002:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57899b24-a33b-4177-9883-79b5fe35053f:3651:1874208203423232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384693.466227:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384693.466264:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384693.466377:0:20178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7f05880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20178:1874208203422080:192.168.203.45@tcp:104: 00000100:00100000:0.0:1787384693.466388:0:20178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7f04380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20178:1874208203422208:192.168.203.45@tcp:104: 00010000:00010000:0.0:1787384693.466419:0:20178:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98f8d965a200/0x7ef423838fba3e58 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384693.466490:0:19489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182365824 00000100:00100000:3.0:1787384693.466508:0:19489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182365824 00010000:00010000:3.0:1787384693.466538:0:19489:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f8f58cc000/0x7ef423838fba3e27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3b92 expref: 13 pid: 17142 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384693.466594:0:19489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182365952 00000100:00100000:3.0:1787384693.466597:0:19489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182365952 00010000:00010000:3.0:1787384693.466609:0:19489:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98f8f58cc800/0x7ef423838fba3de8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3b22 expref: 14 pid: 17142 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384693.466639:0:19489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 13 00000100:00100000:3.0:1787384693.466648:0:19489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d8520c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b965c805-ceb8-4757-b53e-03d6d45231a8+14:2416:x1874208182365824:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384693.466661:0:19489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384693.466667:0:19489:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f8f58cc000/0x7ef423838fba3e27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3b92 expref: 14 pid: 17142 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384693.466678:0:19489:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f8f58cc000/0x7ef423838fba3e27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3b92 expref: 14 pid: 17142 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384693.466695:0:19489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f58cc000/0x7ef423838fba3e27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3b92 expref: 14 pid: 17142 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384693.466709:0:19489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384693.466771:0:19489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d8520c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b965c805-ceb8-4757-b53e-03d6d45231a8+13:2416:x1874208182365824:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 105us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384693.466803:0:19489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 13 00000100:00100000:3.0:1787384693.466858:0:19489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 14 00000100:00100000:3.0:1787384693.466865:0:19489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b965c805-ceb8-4757-b53e-03d6d45231a8+12:2416:x1874208182365952:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384693.466872:0:19489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384693.466877:0:19489:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98f8f58cc800/0x7ef423838fba3de8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3b22 expref: 12 pid: 17142 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384693.466902:0:19489:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98f8f58cc800/0x7ef423838fba3de8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3b22 expref: 12 pid: 17142 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384693.466913:0:19489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8f58cc800/0x7ef423838fba3de8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3b22 expref: 12 pid: 17142 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384693.466925:0:19489:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98f8d965a200/0x7ef423838fba3e58 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384693.466933:0:19489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8d965a200/0x7ef423838fba3e58 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384693.466947:0:19489:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f8d965a200/0x7ef423838fba3e58 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384693.466955:0:19489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98f8d965a200/0x7ef423838fba3e58 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384693.466962:0:19489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98f8d965a200/0x7ef423838fba3e58 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384693.466970:0:19489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98f8d965a200/0x7ef423838fba3e58 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384693.466976:0:19489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965a200 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:3.0:1787384693.466982:0:19489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98f8d965a200/0x7ef423838fba3e58 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384693.466990:0:19489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98f8d965a200/0x7ef423838fba3e58 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384693.467015:0:19489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98f8d965a200/0x7ef423838fba3e58 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384693.467302:0:19489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384693.467326:0:19489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b965c805-ceb8-4757-b53e-03d6d45231a8+11:2416:x1874208182365952:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 461us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384693.467333:0:19489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 14 00010000:00010000:1.0:1787384693.468408:0:20178:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98f8d965a200/0x7ef423838fba3e58 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384693.468422:0:20178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98f8d965a200/0x7ef423838fba3e58 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384693.468438:0:20178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98f8d965a200/0x7ef423838fba3e58 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787384693.559452:0:17904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787384694.134993:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384694.631694:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384694.631738:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384694.631764:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384694.631820:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384694.631842:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384694.632012:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182366080 00000100:00100000:2.0:1787384694.632031:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182366080 00000100:00100000:2.0:1787384694.632095:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 147 00000100:00100000:2.0:1787384694.632106:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c370c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b965c805-ceb8-4757-b53e-03d6d45231a8+11:2416:x1874208182366080:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384694.632199:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c370c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b965c805-ceb8-4757-b53e-03d6d45231a8+11:2416:x1874208182366080:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 86us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384694.632208:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 147 00000100:00100000:3.0:1787384694.632625:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384694.632655:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384694.632676:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384694.632695:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384694.632714:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182366336 00000100:00100000:3.0:1787384694.632718:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182366336 00000100:00100000:3.0:1787384694.632751:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182366848 00000100:00100000:3.0:1787384694.632754:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182366848 00000100:00100000:3.0:1787384694.632767:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182366208 00000100:00100000:3.0:1787384694.632769:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182366208 00000100:00100000:3.0:1787384694.632809:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182366720 00000100:00100000:3.0:1787384694.632812:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182366720 00000100:00100000:3.0:1787384694.632827:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 55 00000100:00100000:3.0:1787384694.632833:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+5:2416:x1874208182366336:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384694.633658:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+5:2416:x1874208182366336:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 819us (1914us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384694.633680:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 55 00000100:00100000:3.0:1787384694.633708:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 56 00000100:00100000:3.0:1787384694.633716:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+5:2416:x1874208182366848:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384694.633744:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+5:2416:x1874208182366848:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 29us (1924us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384694.633750:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 56 00000100:00100000:3.0:1787384694.633764:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 57 00000100:00100000:3.0:1787384694.633771:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+6:2416:x1874208182366208:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384694.633823:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+6:2416:x1874208182366208:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 53us (1200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384694.633829:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 57 00000100:00100000:3.0:1787384694.633842:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 58 00000100:00100000:3.0:1787384694.634596:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+6:2416:x1874208182366720:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384694.634633:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+6:2416:x1874208182366720:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 42us (1957us total) trans 0 rc 0/0 00000100:00080000:1.0:1787384694.635635:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787384694.635641:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787384694.635659:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182366592 00000100:00100000:1.0:1787384694.635666:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182366592 00000100:00100000:1.0:1787384694.635708:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182367104 00000100:00100000:1.0:1787384694.635711:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182367104 00000100:00100000:1.0:1787384694.635724:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182366464 00000100:00100000:1.0:1787384694.635726:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182366464 00000100:00100000:1.0:1787384694.635737:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182366976 00000100:00100000:1.0:1787384694.635739:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182366976 00000100:00100000:1.0:1787384694.635754:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 15 00000100:00100000:1.0:1787384694.635762:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+5:2416:x1874208182366592:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384694.635833:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+5:2416:x1874208182366592:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 70us (4068us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384694.635841:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 15 00000100:00100000:1.0:1787384694.635871:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 16 00000100:00100000:1.0:1787384694.635877:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+5:2416:x1874208182367104:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384694.635910:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+5:2416:x1874208182367104:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 33us (4067us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384694.635917:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 16 00000100:00100000:1.0:1787384694.635927:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 17 00000100:00100000:1.0:1787384694.635933:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c35d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+5:2416:x1874208182366464:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384694.635955:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c35d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+5:2416:x1874208182366464:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 22us (3300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384694.635961:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 17 00000100:00100000:1.0:1787384694.635984:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 18 00000100:00100000:1.0:1787384694.635990:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+5:2416:x1874208182366976:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384694.636025:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+5:2416:x1874208182366976:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 34us (3329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384694.636032:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 18 00000100:00080000:1.0:1787384694.636053:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787384694.636056:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787384694.640033:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 58 10000000:01000000:3.0:1787384694.999807:0:17146:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787384694.999816:0:17146:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98f8ee0ca000 from 13 10000000:01000000:3.0:1787384694.999821:0:17146:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787384694.999870:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc800/0x7ef423838fba3e5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384694.999896:0:17146:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc800/0x7ef423838fba3e5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384694.999926:0:17146:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc800/0x7ef423838fba3e5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384694.999953:0:17146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb126a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203423360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787384695.000029:0:17146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384695.000066:0:17146:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c29566c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384695.000621:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203423360 00000100:00100000:2.0:1787384695.000629:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203423360 00000100:00100000:2.0:1787384695.000691:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787384695.000700:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c370ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+20:17146:x1874208203423360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787384695.000714:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384695.000728:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c2091200/0x7ef423838fba3e66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba3e5f expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384695.000751:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c2091200/0x7ef423838fba3e66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba3e5f expref: 21 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384695.000762:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c2091200/0x7ef423838fba3e66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba3e5f expref: 21 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384695.000772:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2091200, rc 0) 00000100:00100000:2.0:1787384695.000858:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c370ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+21:17146:x1874208203423360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384695.000866:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787384695.001037:0:17146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb126a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203423360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787384695.001052:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc800/0x7ef423838fba3e5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3e66 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384695.001062:0:17146:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc800/0x7ef423838fba3e5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba3e66 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384695.001143:0:17146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42f3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203423488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384695.001182:0:17146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384695.001213:0:17146:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8c6361b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787384695.001817:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203423488 00000100:00100000:3.0:1787384695.001823:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203423488 00000100:00100000:3.0:1787384695.001867:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787384695.001890:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c370f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+21:17146:x1874208203423488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384695.002020:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c370f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+21:17146:x1874208203423488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 144us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384695.002027:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787384695.002064:0:17146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42f3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203423488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384695.002098:0:17146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb127100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203423616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384695.002138:0:17146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384695.002153:0:17146:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d97cc900 going to sleep for 11 seconds 00000100:00100000:3.0:1787384695.002180:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203423616 00000100:00100000:3.0:1787384695.002184:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203423616 00000100:00100000:3.0:1787384695.002201:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787384695.002206:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c370d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+21:17146:x1874208203423616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384695.002277:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c370d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+21:17146:x1874208203423616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384695.002283:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787384695.002335:0:17146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb127100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203423616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787384695.002998:0:20246:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787384695.003052:0:17146:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787384695.003071:0:17146:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787384695.003081:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc800/0x7ef423838fba3e5f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3e66 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384695.003090:0:17146:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc800/0x7ef423838fba3e5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3e66 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384695.003099:0:17146:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787384695.003102:0:17146:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98f8d9698000 from 13 10000000:01000000:3.0:1787384695.003104:0:17146:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787384695.003128:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc000/0x7ef423838fba3e6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384695.003135:0:17146:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc000/0x7ef423838fba3e6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384695.003144:0:17146:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc000/0x7ef423838fba3e6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384695.003159:0:17146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb127100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203423744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787384695.003193:0:17146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384695.003208:0:17146:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d97cc3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384695.003223:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203423744 00000100:00100000:3.0:1787384695.003226:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203423744 00000100:00100000:3.0:1787384695.003247:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787384695.003254:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c370e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+21:17146:x1874208203423744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384695.003273:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384695.003283:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8f58cce00/0x7ef423838fba3e74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba3e6d expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384695.003303:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f58cce00/0x7ef423838fba3e74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba3e6d expref: 22 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384695.003312:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8f58cce00/0x7ef423838fba3e74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba3e6d expref: 22 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384695.003320:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cce00, rc 0) 00000100:00100000:3.0:1787384695.003351:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c370e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+22:17146:x1874208203423744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384695.003357:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787384695.003389:0:17146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb127100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203423744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384695.003401:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc000/0x7ef423838fba3e6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3e74 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384695.003409:0:17146:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc000/0x7ef423838fba3e6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba3e74 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384695.003450:0:17146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb127100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203423872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384695.003472:0:17146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384695.003484:0:17146:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d97cc3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384695.003495:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203423872 00000100:00100000:3.0:1787384695.003498:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203423872 00000100:00100000:3.0:1787384695.003514:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787384695.003518:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c370f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+22:17146:x1874208203423872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384695.003600:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c370f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+22:17146:x1874208203423872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 80us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384695.003607:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787384695.003632:0:17146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb127100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203423872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384695.003654:0:17146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb127100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203424000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384695.003687:0:17146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384695.003698:0:17146:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d97cc3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384695.003709:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203424000 00000100:00100000:3.0:1787384695.003712:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203424000 00000100:00100000:3.0:1787384695.003726:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787384695.003731:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c370c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+22:17146:x1874208203424000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384695.003817:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c370c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+22:17146:x1874208203424000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384695.003824:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787384695.003856:0:17146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb127100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203424000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787384695.004450:0:20247:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787384695.004492:0:17146:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787384695.004508:0:17146:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787384695.004515:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc000/0x7ef423838fba3e6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3e74 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384695.004524:0:17146:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8f58cc000/0x7ef423838fba3e6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3e74 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384695.004532:0:17146:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787384695.004535:0:17146:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98f8f7d8f800 from 13 10000000:01000000:3.0:1787384695.004543:0:17146:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787384695.004564:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba3e7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384695.004572:0:17146:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba3e7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384695.004579:0:17146:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba3e7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384695.004593:0:17146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb127100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203424128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787384695.004624:0:17146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384695.004639:0:17146:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d97ccb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787384695.004655:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203424128 00000100:00100000:3.0:1787384695.004658:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203424128 00000100:00100000:3.0:1787384695.004677:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787384695.004683:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c370e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+22:17146:x1874208203424128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384695.004692:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384695.004701:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8f58cd600/0x7ef423838fba3e82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba3e7b expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384695.004718:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f58cd600/0x7ef423838fba3e82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba3e7b expref: 23 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384695.004728:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8f58cd600/0x7ef423838fba3e82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba3e7b expref: 23 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384695.004736:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cd600, rc 0) 00000100:00100000:3.0:1787384695.004763:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c370e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+23:17146:x1874208203424128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384695.004800:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787384695.004833:0:17146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb127100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203424128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384695.004844:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba3e7b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3e82 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384695.004853:0:17146:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba3e7b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba3e82 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384695.022186:0:17146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb127100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203424256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384695.022264:0:17146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384695.022843:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203424256 00000100:00100000:0.0:1787384695.022852:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203424256 00000100:00100000:0.0:1787384695.022917:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787384695.022926:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c370f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+23:17146:x1874208203424256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384695.023048:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c370f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+23:17146:x1874208203424256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384695.023055:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787384695.023227:0:17146:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d97ccb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787384695.023265:0:17146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb127100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203424256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384695.023304:0:17146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb127100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203424384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384695.023457:0:17146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384695.023480:0:17146:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d97ccb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787384695.023593:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384695.023764:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203424384 00000100:00100000:0.0:1787384695.023769:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203424384 00000100:00100000:0.0:1787384695.023824:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182367232 00000100:00100000:0.0:1787384695.023827:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182367232 00000100:00100000:0.0:1787384695.023840:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787384695.023847:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+23:17146:x1874208203424384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787384695.023950:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+23:17146:x1874208203424384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384695.023957:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787384695.023985:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 157 00000100:00100000:0.0:1787384695.023992:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b965c805-ceb8-4757-b53e-03d6d45231a8+11:14927:x1874208182367232:12345-192.168.203.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787384695.024000:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384695.024017:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c3b04600/0x7ef423838fba3e89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3bca expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384695.024043:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c3b04600/0x7ef423838fba3e89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3bca expref: 12 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384695.024067:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c3b04600/0x7ef423838fba3e89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3bca expref: 12 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384695.024077:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3b04600, rc 0) 00000100:00100000:0.0:1787384695.024119:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b965c805-ceb8-4757-b53e-03d6d45231a8+12:14927:x1874208182367232:12345-192.168.203.45@tcp:101:ll_cfg_requeue.0 Request processed in 127us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384695.024125:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 157 00000100:00100000:3.0:1787384695.025085:0:17146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb127100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203424384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787384695.028280:0:20248:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787384695.028672:0:17146:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787384695.028697:0:17146:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787384695.028708:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba3e7b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3e82 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384695.028720:0:17146:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f8f58cdc00/0x7ef423838fba3e7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3e82 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384695.028730:0:17146:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787384695.028733:0:17146:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff98f8f7d47800 from 13 10000000:01000000:0.0:1787384695.028736:0:17146:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787384695.028773:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05800/0x7ef423838fba3e90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384695.028805:0:17146:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05800/0x7ef423838fba3e90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384695.028816:0:17146:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05800/0x7ef423838fba3e90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384695.028841:0:17146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42f3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203424512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787384695.028940:0:17146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384695.028979:0:17146:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8293900 going to sleep for 11 seconds 00000100:00100000:3.0:1787384695.029230:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203424512 00000100:00100000:3.0:1787384695.029237:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203424512 00000100:00100000:3.0:1787384695.029277:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787384695.029285:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+23:17146:x1874208203424512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384695.029298:0:17142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1787384695.031067:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00010000:00010000:3.0:1787384695.031184:0:17142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f8f58cda00/0x7ef423838fba3e97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ef423838fba3e90 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384695.031233:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f8f58cda00/0x7ef423838fba3e97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ef423838fba3e90 expref: 24 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384695.031243:0:17142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f8f58cda00/0x7ef423838fba3e97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ef423838fba3e90 expref: 24 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384695.031253:0:17142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cda00, rc 0) 00000100:00100000:3.0:1787384695.031643:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57899b24-a33b-4177-9883-79b5fe35053f+24:17146:x1874208203424512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2020us (2364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384695.031654:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787384695.031705:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182367360 00000100:00100000:3.0:1787384695.031712:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182367360 00000100:00100000:3.0:1787384695.031741:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 159 00000100:00100000:3.0:1787384695.031749:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b965c805-ceb8-4757-b53e-03d6d45231a8+12:14927:x1874208182367360:12345-192.168.203.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384695.031899:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b965c805-ceb8-4757-b53e-03d6d45231a8+12:14927:x1874208182367360:12345-192.168.203.45@tcp:501:ll_cfg_requeue.0 Request processed in 149us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384695.031906:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 159 00000100:00100000:0.0:1787384695.032262:0:17146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42f3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203424512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787384695.032283:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05800/0x7ef423838fba3e90 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3e97 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384695.032295:0:17146:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05800/0x7ef423838fba3e90 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ef423838fba3e97 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384695.032387:0:17146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42f3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203424640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384695.032423:0:17146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384695.032453:0:17146:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8293900 going to sleep for 11 seconds 00000100:00100000:3.0:1787384695.032678:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203424640 00000100:00100000:3.0:1787384695.032683:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203424640 00000100:00100000:3.0:1787384695.032708:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787384695.032715:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+24:17146:x1874208203424640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384695.032813:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+24:17146:x1874208203424640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384695.032820:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787384695.039769:0:17146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42f3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203424640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384695.039854:0:17146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42f3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203424768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787384695.039938:0:17146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384695.039978:0:17146:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8293900 going to sleep for 11 seconds 00000100:00100000:3.0:1787384695.040347:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203424768 00000100:00100000:3.0:1787384695.040361:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203424768 00000100:00100000:3.0:1787384695.040412:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787384695.040420:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd620c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+24:17146:x1874208203424768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384695.040754:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd620c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+24:17146:x1874208203424768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 333us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384695.040762:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787384695.041230:0:17146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42f3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57899b24-a33b-4177-9883-79b5fe35053f:17146:1874208203424768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384695.044631:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384695.044715:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182367488 00000100:00100000:1.0:1787384695.044725:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182367488 00000100:00100000:1.0:1787384695.044798:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 162 00000100:00100000:1.0:1787384695.044810:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b965c805-ceb8-4757-b53e-03d6d45231a8+12:14927:x1874208182367488:12345-192.168.203.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787384695.044966:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b965c805-ceb8-4757-b53e-03d6d45231a8+12:14927:x1874208182367488:12345-192.168.203.45@tcp:503:ll_cfg_requeue.0 Request processed in 158us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384695.044975:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 162 00000100:00100000:3.0:1787384695.050316:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384695.050495:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182367616 00000100:00100000:2.0:1787384695.050507:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182367616 00000100:00100000:2.0:1787384695.050566:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 163 00000100:00100000:2.0:1787384695.050576:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b965c805-ceb8-4757-b53e-03d6d45231a8+12:14927:x1874208182367616:12345-192.168.203.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787384695.050593:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384695.050609:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98f7c2090000/0x7ef423838fba3e9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3bd1 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384695.050636:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98f7c2090000/0x7ef423838fba3e9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3bd1 expref: 13 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384695.050674:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98f7c2090000/0x7ef423838fba3e9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3bd1 expref: 13 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384695.050684:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2090000, rc 0) 00000100:00100000:2.0:1787384695.050744:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b965c805-ceb8-4757-b53e-03d6d45231a8+13:14927:x1874208182367616:12345-192.168.203.45@tcp:101:ll_cfg_requeue.0 Request processed in 170us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384695.050758:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 163 00000040:00080000:1.0:1787384695.055322:0:20249:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787384695.056000:0:17146:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787384695.056024:0:17146:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787384695.056035:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05800/0x7ef423838fba3e90 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3e97 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384695.056048:0:17146:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.145@tcp lock: ffff98f7c3b05800/0x7ef423838fba3e90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ef423838fba3e97 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384695.056235:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384695.056340:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182367744 00000100:00100000:3.0:1787384695.056349:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182367744 00000100:00100000:3.0:1787384695.056400:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 164 00000100:00100000:3.0:1787384695.056410:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd621c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b965c805-ceb8-4757-b53e-03d6d45231a8+13:14927:x1874208182367744:12345-192.168.203.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384695.056567:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd621c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b965c805-ceb8-4757-b53e-03d6d45231a8+13:14927:x1874208182367744:12345-192.168.203.45@tcp:501:ll_cfg_requeue.0 Request processed in 157us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384695.056575:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 164 00000100:00100000:3.0:1787384695.058976:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384695.060668:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182367872 00000100:00100000:1.0:1787384695.060681:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182367872 00000100:00100000:1.0:1787384695.060745:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 165 00000100:00100000:1.0:1787384695.060754:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd622450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b965c805-ceb8-4757-b53e-03d6d45231a8+13:14927:x1874208182367872:12345-192.168.203.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787384695.063118:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd622450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b965c805-ceb8-4757-b53e-03d6d45231a8+13:14927:x1874208182367872:12345-192.168.203.45@tcp:503:ll_cfg_requeue.0 Request processed in 2356us (4142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384695.063132:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 165 00010000:00010000:1.0:1787384695.161169:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384696.183298:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384696.248640:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203424896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787384696.249590:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384696.250536:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203424896 00000100:00100000:0.0:1787384696.250547:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203424896 00000100:00100000:0.0:1787384696.250631:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787384696.250641:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203424896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787384696.250674:0:18660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787384696.250758:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874208203424896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384696.250766:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1787384696.250771:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787384696.251122:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874208203424896:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787384697.211227:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384697.271303:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203425280:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787384697.271373:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384697.271470:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203425280 00000100:00100000:2.0:1787384697.271479:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203425280 00000100:00100000:2.0:1787384697.271542:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787384697.271552:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c42f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203425280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787384697.271583:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787384697.271628:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c42f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203425280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384697.271636:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787384697.271686:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203425280:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787384697.271851:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787384697.271913:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203425024:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787384697.271978:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384697.272004:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384697.272011:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203425152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787384697.272033:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384697.272213:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203425024 00000100:00100000:0.0:1787384697.272218:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203425024 00000100:00100000:0.0:1787384697.272253:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203425152 00000100:00100000:0.0:1787384697.272256:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203425152 00000100:00100000:0.0:1787384697.272273:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787384697.272279:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203425024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787384697.272297:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787384697.272328:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203425024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384697.272334:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787384697.272348:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787384697.272354:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203425152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787384697.272363:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787384697.272384:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203425152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 30us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384697.272389:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787384697.272755:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7f07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203425792:0@lo:400:kworker.0 00000100:00100000:2.0:1787384697.272813:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384697.272830:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7f07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874208203426304:0@lo:400:kworker.0 00000100:00100000:2.0:1787384697.272862:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384697.272891:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787384697.272898:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57899b24-a33b-4177-9883-79b5fe35053f:3651:1874208203425408:0@lo:400:kworker.0 00000100:00100000:2.0:1787384697.272924:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384697.272947:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7f04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203425920:0@lo:400:kworker.0 00000100:00100000:2.0:1787384697.272985:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384697.272999:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7f06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874208203426432:0@lo:400:kworker.0 00000100:00100000:2.0:1787384697.273018:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384697.273041:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203425792 00000100:00100000:2.0:1787384697.273045:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203425792 00000100:00100000:2.0:1787384697.273071:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203426304 00000100:00100000:2.0:1787384697.273074:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203426304 00000100:00100000:2.0:1787384697.273088:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203426432 00000100:00100000:2.0:1787384697.273090:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203426432 00000100:00100000:2.0:1787384697.273104:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787384697.273111:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203425792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384697.273146:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203425792:12345-0@lo:400:kworker.0 Request processed in 35us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384697.273153:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787384697.273165:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787384697.273171:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874208203426304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384697.273196:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874208203426304:12345-0@lo:400:kworker.0 Request processed in 25us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384697.273203:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787384697.273213:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787384697.273219:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874208203426432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384697.273254:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874208203426432:12345-0@lo:400:kworker.0 Request processed in 34us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384697.273260:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787384697.273279:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203425408 00000100:00100000:2.0:1787384697.273282:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203425408 00000100:00100000:2.0:1787384697.273303:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787384697.273309:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+24:3651:x1874208203425408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384697.273337:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57899b24-a33b-4177-9883-79b5fe35053f+24:3651:x1874208203425408:12345-0@lo:400:kworker.0 Request processed in 27us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384697.273343:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787384697.273383:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57899b24-a33b-4177-9883-79b5fe35053f:3651:1874208203425408:0@lo:400:kworker.0 00000100:00100000:2.0:1787384697.273396:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7f06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874208203426432:0@lo:400:kworker.0 00000100:00100000:2.0:1787384697.273404:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7f07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203425792:0@lo:400:kworker.0 00010000:00080000:2.0:1787384697.273415:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7f07800 x1874208203426304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384697.273424:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7f07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874208203426304:0@lo:400:kworker.0 00000100:00080000:3.0:1787384697.274108:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787384697.274114:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787384697.274117:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787384697.274131:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203425536:0@lo:400:kworker.0 00000100:00100000:3.0:1787384697.274178:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384697.274216:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7f05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874208203426048:0@lo:400:kworker.0 00000100:00100000:3.0:1787384697.274237:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384697.274261:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7f07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874208203426560:0@lo:400:kworker.0 00000100:00100000:3.0:1787384697.274281:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384697.274317:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203425152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787384697.274332:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203425024:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787384697.274350:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787384697.274356:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c42f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203425664:0@lo:400:kworker.0 00000100:00100000:3.0:1787384697.274380:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384697.274396:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7f06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203426176:0@lo:400:kworker.0 00000100:00100000:3.0:1787384697.274414:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384697.274435:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203426048 00000100:00100000:3.0:1787384697.274440:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203426048 00000100:00100000:3.0:1787384697.274467:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203426560 00000100:00100000:3.0:1787384697.274470:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203426560 00000100:00100000:3.0:1787384697.274487:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203426176 00000100:00100000:3.0:1787384697.274490:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203426176 00000100:00100000:3.0:1787384697.274504:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787384697.274511:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874208203426048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384697.274549:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874208203426048:12345-0@lo:400:kworker.0 Request processed in 38us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384697.274555:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787384697.274718:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787384697.274727:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874208203426560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384697.274767:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874208203426560:12345-0@lo:400:kworker.0 Request processed in 41us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384697.274773:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787384697.274813:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787384697.274819:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203426176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384697.274846:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874208203426176:12345-0@lo:400:kworker.0 Request processed in 27us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384697.274853:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1787384697.274901:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787384697.274904:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787384697.276951:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7f06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874208203426176:0@lo:400:kworker.0 00000100:00100000:3.0:1787384697.277039:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7f05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874208203426048:0@lo:400:kworker.0 00010000:00080000:3.0:1787384697.277069:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8f7f07480 x1874208203426560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384697.277080:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7f07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874208203426560:0@lo:400:kworker.0 00000100:00100000:1.0:1787384697.277198:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203425920 00000100:00100000:1.0:1787384697.277206:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203425920 00000100:00100000:1.0:1787384697.277239:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203425536 00000100:00100000:1.0:1787384697.277242:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203425536 00000100:00100000:1.0:1787384697.277256:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787384697.277263:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203425920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384697.277352:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203425920:12345-0@lo:400:kworker.0 Request processed in 89us (4367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384697.277359:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787384697.277374:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787384697.277380:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203425536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384697.277409:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203425536:12345-0@lo:400:kworker.0 Request processed in 30us (3232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384697.277415:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787384697.277434:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203425664 00000100:00100000:1.0:1787384697.277438:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203425664 00000100:00100000:1.0:1787384697.277463:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787384697.277469:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203425664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384697.277497:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203425664:12345-0@lo:400:kworker.0 Request processed in 28us (3116us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384697.277503:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787384697.277988:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203425664:0@lo:400:kworker.0 00000100:00100000:0.0:1787384697.277999:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c42f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203425536:0@lo:400:kworker.0 00000100:00100000:3.0:1787384697.279532:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7f04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203425920:0@lo:400:kworker.0 00000100:00100000:2.0:1787384697.784870:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8d9b55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203426688:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787384697.784954:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384697.785055:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203426688 00000100:00100000:1.0:1787384697.785065:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203426688 00000100:00100000:1.0:1787384697.785120:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787384697.785130:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203426688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787384697.785165:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787384697.785217:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203426688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384697.785237:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787384697.785281:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8d9b55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203426688:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787384697.785807:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787384697.785819:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203426816:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787384697.785852:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384697.786046:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203426816 00000100:00100000:2.0:1787384697.786052:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203426816 00000100:00100000:2.0:1787384697.786081:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787384697.786087:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203426816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787384697.786109:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787384697.786155:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203426816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384697.786171:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787384697.787676:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203426816:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787384697.986232:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384697.986352:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182368000 00000100:00100000:2.0:1787384697.986365:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182368000 00000100:00100000:2.0:1787384697.986463:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 23 00000100:00100000:2.0:1787384697.986474:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+6:15596:x1874208182368000:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787384697.986493:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384697.986516:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090200/0x7ef423838fba3ea5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3bd8 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384697.986580:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090800/0x7ef423838fba3eac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384697.986593:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090800/0x7ef423838fba3eac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384697.986606:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090800/0x7ef423838fba3eac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384697.986619:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba3eb3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384697.986626:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba3eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384697.986633:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba3eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384697.986713:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba3eba lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384697.986737:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba3eba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384697.986744:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba3eba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384697.986775:0:17152:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787384697.986821:0:17152:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787384697.986857:0:17152:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba3eba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384697.986877:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090800/0x7ef423838fba3eac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384697.986883:0:17152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090800/0x7ef423838fba3eac lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384697.986889:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090800/0x7ef423838fba3eac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384697.986895:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2090800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384697.986900:0:17152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090800/0x7ef423838fba3eac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384697.986907:0:17152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090800/0x7ef423838fba3eac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384697.986918:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f8edc2f300) 00010000:00010000:2.0:1787384697.986921:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384697.986926:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090800/0x7ef423838fba3eac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384697.986942:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090800/0x7ef423838fba3eac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384697.986957:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba3eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384697.986963:0:17152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba3eb3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384697.986969:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba3eb3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384697.986975:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2090400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384697.986978:0:17152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba3eb3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384697.986984:0:17152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba3eb3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384697.986991:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff98f8fc248700) 00010000:00010000:2.0:1787384697.986994:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384697.986996:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba3eb3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384697.987003:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba3eb3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384697.987036:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090200/0x7ef423838fba3ea5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3bd8 expref: 8 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384697.987062:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091400/0x7ef423838fba3eba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3bd8 expref: 7 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384697.987070:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98f8fc248200) 00010000:00010000:2.0:1787384697.987072:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787384697.987075:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2091400, rc 0) 00000100:00100000:2.0:1787384697.987136:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+7:15596:x1874208182368000:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 665us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384697.987144:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 23 00000100:00080000:0.0:1787384697.988933:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787384697.993070:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384697.993272:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182368128 00000100:00100000:3.0:1787384697.993286:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182368128 00000100:00100000:3.0:1787384697.993363:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 5 00000100:00100000:3.0:1787384697.993376:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8741dc33-c445-439b-a6e3-d8ded553bb00+7:15596:x1874208182368128:12345-192.168.203.45@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787384697.993488:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8741dc33-c445-439b-a6e3-d8ded553bb00+7:15596:x1874208182368128:12345-192.168.203.45@tcp:900:lhsmtool_posix.0 Request processed in 114us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384697.993497:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 5 00000100:00100000:1.0:1787384697.996999:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384697.997398:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182368384 00000100:00100000:0.0:1787384697.997412:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182368384 00000100:00100000:0.0:1787384697.997494:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 24 00000100:00100000:0.0:1787384697.997508:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+7:15596:x1874208182368384:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787384697.997539:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384697.997568:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba3ec1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3bdf expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384697.997692:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05600/0x7ef423838fba3ec8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384697.997735:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05600/0x7ef423838fba3ec8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384697.997749:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05600/0x7ef423838fba3ec8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.003122:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05e00/0x7ef423838fba3ecf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.003148:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05e00/0x7ef423838fba3ecf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.003162:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05e00/0x7ef423838fba3ecf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.003362:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05000/0x7ef423838fba3ed6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.003371:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05000/0x7ef423838fba3ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.003379:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05000/0x7ef423838fba3ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384698.003391:0:17150:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1787384698.006040:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05600/0x7ef423838fba3ec8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.006058:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05600/0x7ef423838fba3ec8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.006066:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05600/0x7ef423838fba3ec8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.006086:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b05600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384698.006091:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05600/0x7ef423838fba3ec8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.006098:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05600/0x7ef423838fba3ec8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.006113:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98f8fc248200) 00010000:00010000:0.0:1787384698.006116:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384698.006121:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05600/0x7ef423838fba3ec8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.006127:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05600/0x7ef423838fba3ec8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.006142:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05e00/0x7ef423838fba3ecf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.006149:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05e00/0x7ef423838fba3ecf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.006156:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05e00/0x7ef423838fba3ecf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.006161:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b05e00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384698.006163:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05e00/0x7ef423838fba3ecf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.006169:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05e00/0x7ef423838fba3ecf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.006188:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98f7c3a9dc00) 00010000:00010000:0.0:1787384698.006191:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384698.006194:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05e00/0x7ef423838fba3ecf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.006200:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05e00/0x7ef423838fba3ecf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.011968:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba3ec1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3bdf expref: 10 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.012008:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05000/0x7ef423838fba3ed6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3bdf expref: 9 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.012018:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98f7c3a9dd00) 00010000:00010000:0.0:1787384698.012021:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384698.012025:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3b05000, rc 0) 00000100:00100000:0.0:1787384698.012099:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+9:15596:x1874208182368384:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 14593us (15122us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787384698.012108:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 24 00000100:00100000:0.0:1787384698.023181:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384698.023280:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182368512 00000100:00100000:2.0:1787384698.023299:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182368512 00000100:00100000:2.0:1787384698.023362:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 25 00000100:00100000:2.0:1787384698.023372:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+9:15596:x1874208182368512:12345-192.168.203.45@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787384698.023476:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+9:15596:x1874208182368512:12345-192.168.203.45@tcp:59:lhsmtool_posix.0 Request processed in 104us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384698.023484:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 25 00000100:00100000:1.0:1787384698.035952:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384698.037558:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182368640 00000100:00100000:3.0:1787384698.037580:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182368640 00000100:00100000:3.0:1787384698.037704:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 26 00000100:00100000:3.0:1787384698.037722:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+5:15596:x1874208182368640:12345-192.168.203.45@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1787384698.038176:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1787384698.055721:0:18681:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 17877us 00000100:00100000:1.0:1787384698.095701:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+5:15596:x1874208182368640:12345-192.168.203.45@tcp:59:lhsmtool_posix.0 Request processed in 57970us (59741us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384698.095719:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 26 00000100:00100000:1.0:1787384698.134494:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384698.136142:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182368768 00000100:00100000:2.0:1787384698.136161:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182368768 00000100:00100000:2.0:1787384698.136252:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 27 00000100:00100000:2.0:1787384698.136265:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+9:15602:x1874208182368768:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:2.0:1787384698.136293:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384698.136319:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090200/0x7ef423838fba3ee4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3be6 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384698.137006:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba3eeb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384698.137025:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba3eeb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384698.137041:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba3eeb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384698.137063:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090800/0x7ef423838fba3ef2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384698.137071:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090800/0x7ef423838fba3ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384698.137078:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090800/0x7ef423838fba3ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384698.137130:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba3eeb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384698.137138:0:17152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba3eeb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384698.137144:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba3eeb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384698.137151:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2090400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384698.137155:0:17152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba3eeb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384698.137177:0:17152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba3eeb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384698.137192:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f8edc2f300) 00010000:00010000:2.0:1787384698.137195:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384698.137202:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba3eeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384698.137208:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba3eeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384698.137227:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090800/0x7ef423838fba3ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384698.137233:0:17152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090800/0x7ef423838fba3ef2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384698.137239:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090800/0x7ef423838fba3ef2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384698.137249:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2090800 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384698.137252:0:17152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090800/0x7ef423838fba3ef2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384698.137258:0:17152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090800/0x7ef423838fba3ef2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384698.137265:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98f8fc248700) 00010000:00010000:2.0:1787384698.137268:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384698.137271:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090800/0x7ef423838fba3ef2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384698.137292:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090800/0x7ef423838fba3ef2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384698.137336:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090200/0x7ef423838fba3ee4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3be6 expref: 10 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384698.137347:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f8edc2f300) 00010000:00010000:2.0:1787384698.137349:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384698.137352:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090200/0x7ef423838fba3ee4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3be6 expref: 10 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384698.137361:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2090200, rc 0) 00000100:00100000:2.0:1787384698.137456:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+9:15602:x1874208182368768:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 1193us (2977us total) trans 0 rc 301/301 00000100:00100000:2.0:1787384698.137465:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 27 00000100:00100000:1.0:1787384698.144822:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384698.148185:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182368896 00000100:00100000:2.0:1787384698.148206:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182368896 00000100:00100000:2.0:1787384698.148346:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 0 00000100:00100000:2.0:1787384698.148359:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8741dc33-c445-439b-a6e3-d8ded553bb00+9:15602:x1874208182368896:12345-192.168.203.45@tcp:700:lfs.0 00000100:00100000:2.0:1787384698.148489:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8741dc33-c445-439b-a6e3-d8ded553bb00+9:15602:x1874208182368896:12345-192.168.203.45@tcp:700:lfs.0 Request processed in 131us (3727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384698.148498:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 0 00000100:00100000:1.0:1787384698.153412:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384698.153522:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182369152 00000100:00100000:3.0:1787384698.153536:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182369152 00000100:00100000:3.0:1787384698.153611:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 28 00000100:00100000:3.0:1787384698.153624:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+9:15602:x1874208182369152:12345-192.168.203.45@tcp:36:lfs.0 00010000:00010000:3.0:1787384698.153755:0:17150:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384698.153915:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba3e12 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3b53 expref: 9 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384698.153942:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f8edc2f300) 00010000:00010000:3.0:1787384698.153948:0:17150:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787384698.154151:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd400/0x7ef423838fba3ef9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384698.154168:0:17150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba3e51 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3bc3 expref: 5 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384698.154178:0:17150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd400/0x7ef423838fba3ef9 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384698.154220:0:17150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba3e51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3bc3 expref: 5 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384698.154237:0:17150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba3e51 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3bc3 expref: 5 pid: 17150 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384698.154255:0:17150:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8cb126680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17150:1874208203426944:192.168.203.45@tcp:104: 00000100:00100000:3.0:1787384698.154370:0:17150:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fc1ddc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787384698.162158:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384698.162204:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182369280 00000100:00100000:1.0:1787384698.162216:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182369280 00010000:00010000:1.0:1787384698.162282:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba3e51 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3bc3 expref: 6 pid: 17150 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384698.162329:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 15 00000100:00100000:1.0:1787384698.162342:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+6:2416:x1874208182369280:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384698.162363:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384698.162371:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba3e51 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3bc3 expref: 6 pid: 17150 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.162387:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba3e51 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3bc3 expref: 6 pid: 17150 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.162416:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f8edc2f300) 00010000:00010000:1.0:1787384698.162441:0:17135:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd400/0x7ef423838fba3ef9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.162452:0:17135:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd400/0x7ef423838fba3ef9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.162461:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd400/0x7ef423838fba3ef9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.162485:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384698.162552:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+6:2416:x1874208182369280:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 212us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384698.162561:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 15 00000100:00080000:0.0:1787384698.162813:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787384698.162871:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba3e51 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3bc3 expref: 5 pid: 17150 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384698.162893:0:17150:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8cb126680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17150:1874208203426944:192.168.203.45@tcp:104: 00010000:00010000:0.0:1787384698.162929:0:17150:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd400/0x7ef423838fba3ef9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.162941:0:17150:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd400/0x7ef423838fba3ef9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.162947:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd400/0x7ef423838fba3ef9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.162979:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba3f00 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.162990:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba3f00 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.162998:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba3f00 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.168468:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05e00/0x7ef423838fba3f07 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.168491:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05e00/0x7ef423838fba3f07 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.168503:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05e00/0x7ef423838fba3f07 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787384698.168655:0:17150:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d6f20b14 reply state 00000000c5fd4469 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05e00/0x7ef423838fba3f07 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.168669:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05e00/0x7ef423838fba3f07 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.168695:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98f7c3a9d200) 00010000:00010000:0.0:1787384698.168698:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787384698.168703:0:17150:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787384698.168709:0:17150:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787384698.168720:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd400/0x7ef423838fba3ef9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.168727:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd400/0x7ef423838fba3ef9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.168735:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd400/0x7ef423838fba3ef9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.168741:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cd400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384698.170325:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd400/0x7ef423838fba3ef9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.170466:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd400/0x7ef423838fba3ef9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.170485:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f8edc2f300) 00010000:00010000:0.0:1787384698.170489:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384698.170495:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd400/0x7ef423838fba3ef9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.170502:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd400/0x7ef423838fba3ef9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787384698.170532:0:17150:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d6f20b14 reply state 00000000c5fd4469 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba3f00 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.170623:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba3f00 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.170629:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98f7c3a9dc00) 00010000:00010000:0.0:1787384698.170632:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787384698.170634:0:17150:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1787384698.171905:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+10:15602:x1874208182369152:12345-192.168.203.45@tcp:36:lfs.0 Request processed in 17126us (17349us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787384698.171918:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 28 00010000:00010000:1.0:1787384698.232603:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384698.298049:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384698.300250:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182369408 00000100:00100000:0.0:1787384698.300276:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182369408 00000100:00100000:0.0:1787384698.300386:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 29 00000100:00100000:0.0:1787384698.300399:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+10:15610:x1874208182369408:12345-192.168.203.45@tcp:101:lctl.0 00010000:00010000:0.0:1787384698.300446:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384698.300479:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba3f0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3bed expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.300574:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05600/0x7ef423838fba3f15 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.300592:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05600/0x7ef423838fba3f15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.300606:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05600/0x7ef423838fba3f15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384698.301558:0:17151:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787384698.301568:0:17151:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787384698.301646:0:17151:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05600/0x7ef423838fba3f15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.302087:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba3f0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3bed expref: 12 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.302112:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05600/0x7ef423838fba3f15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3bed expref: 11 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.302123:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c3a9d500) 00010000:00010000:0.0:1787384698.302127:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787384698.302131:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3b05600, rc 0) 00000100:00100000:0.0:1787384698.302230:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+11:15610:x1874208182369408:12345-192.168.203.45@tcp:101:lctl.0 Request processed in 1833us (4195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384698.302240:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 29 00000100:00100000:1.0:1787384698.352397:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384698.353308:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182369536 00000100:00100000:2.0:1787384698.353326:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182369536 00000100:00100000:2.0:1787384698.353415:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 30 00000100:00100000:2.0:1787384698.353426:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+5:15611:x1874208182369536:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:2.0:1787384698.353476:0:18681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384698.353504:0:18681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090200/0x7ef423838fba3f1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3bf4 expref: -99 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384698.353584:0:18681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090800/0x7ef423838fba3f23 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384698.353601:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090800/0x7ef423838fba3f23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384698.353613:0:18681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090800/0x7ef423838fba3f23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384698.353904:0:18681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787384698.353909:0:18681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787384698.353941:0:18681:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090800/0x7ef423838fba3f23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384698.353973:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090200/0x7ef423838fba3f1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3bf4 expref: 7 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384698.353994:0:18681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090800/0x7ef423838fba3f23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3bf4 expref: 6 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384698.354004:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c3a9d500) 00010000:00010000:2.0:1787384698.354007:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787384698.354012:0:18681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2090800, rc 0) 00000100:00100000:2.0:1787384698.354105:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+6:15611:x1874208182369536:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 679us (1717us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384698.354115:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 30 00000100:00100000:1.0:1787384698.356894:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384698.357890:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182369664 00000100:00100000:0.0:1787384698.357913:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182369664 00000100:00100000:0.0:1787384698.358009:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 31 00000100:00100000:0.0:1787384698.358022:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+6:15611:x1874208182369664:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:0.0:1787384698.358050:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384698.358078:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba3f2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3bfb expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.358163:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba3f31 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.358180:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba3f31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.358195:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba3f31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.358226:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba3f38 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.358233:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba3f38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.358239:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba3f38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.358336:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04400/0x7ef423838fba3f3f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.358345:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04400/0x7ef423838fba3f3f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.358352:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04400/0x7ef423838fba3f3f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384698.358398:0:17150:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787384698.358403:0:17150:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787384698.358428:0:17150:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04400/0x7ef423838fba3f3f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.358443:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba3f31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.358451:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba3f31 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.358458:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba3f31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.358475:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b04000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384698.358479:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba3f31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.358487:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba3f31 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.358502:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c3a9d500) 00010000:00010000:0.0:1787384698.358504:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384698.358509:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba3f31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.358515:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba3f31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.358532:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba3f38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.358538:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba3f38 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.358545:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba3f38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.358549:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b05400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384698.358552:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba3f38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.358558:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba3f38 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.358578:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98f7c3a9dc00) 00010000:00010000:0.0:1787384698.358581:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384698.358584:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba3f38 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.358590:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba3f38 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.358621:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba3f2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3bfb expref: 8 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.358635:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04400/0x7ef423838fba3f3f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3bfb expref: 7 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.358642:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98f7c3a9d200) 00010000:00010000:0.0:1787384698.358645:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787384698.358648:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3b04400, rc 0) 00000100:00100000:0.0:1787384698.358767:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+7:15611:x1874208182369664:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 746us (1881us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384698.358776:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 31 00000100:00100000:3.0:1787384698.366262:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384698.370289:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182369792 00000100:00100000:0.0:1787384698.370310:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182369792 00000100:00100000:0.0:1787384698.370441:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 6 00000100:00100000:0.0:1787384698.370455:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+5:15611:x1874208182369792:12345-192.168.203.45@tcp:900:lfs.0 00000100:00080000:2.0:1787384698.370466:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787384698.370571:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+5:15611:x1874208182369792:12345-192.168.203.45@tcp:900:lfs.0 Request processed in 118us (4316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384698.370580:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 6 00000100:00100000:1.0:1787384698.387208:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384698.387336:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182370048 00000100:00100000:3.0:1787384698.387350:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182370048 00000100:00100000:3.0:1787384698.387448:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 32 00000100:00100000:3.0:1787384698.387461:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+7:15611:x1874208182370048:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:3.0:1787384698.387511:0:18681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384698.387541:0:18681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba3f46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3c02 expref: -99 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384698.387693:0:18681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787384698.387892:0:18681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba3f46 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c02 expref: 9 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384698.387910:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c3a9d500) 00010000:00010000:3.0:1787384698.387913:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787384698.387920:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba3f46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c02 expref: 9 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384698.387938:0:18681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cc600, rc 0) 00000100:00100000:3.0:1787384698.388015:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+8:15611:x1874208182370048:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 557us (824us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1787384698.388023:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 32 00000100:00100000:1.0:1787384698.394174:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384698.394277:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182370304 00000100:00100000:0.0:1787384698.394290:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182370304 00000100:00100000:0.0:1787384698.394371:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 33 00000100:00100000:0.0:1787384698.394382:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+8:15611:x1874208182370304:12345-192.168.203.45@tcp:36:lfs.0 00010000:00010000:0.0:1787384698.394468:0:17150:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384698.394503:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04400/0x7ef423838fba3f3f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3bfb expref: 8 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.394526:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98f7c3a9d200) 00010000:00010000:0.0:1787384698.394532:0:17150:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787384698.394560:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba3f54 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.394575:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba3f54 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.394587:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba3f54 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787384698.394901:0:17150:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001096a576 reply state 00000000d2da9450 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba3f54 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.394917:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba3f54 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.394923:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98f7c3a9d200) 00010000:00010000:0.0:1787384698.394925:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1787384698.394928:0:17150:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787384698.394939:0:17150:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787384698.395293:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+9:15611:x1874208182370304:12345-192.168.203.45@tcp:36:lfs.0 Request processed in 910us (1133us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1787384698.395326:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 33 00000100:00100000:1.0:1787384698.398281:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384698.398417:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182370560 00000100:00100000:3.0:1787384698.398430:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182370560 00000100:00100000:3.0:1787384698.398507:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 2 00000100:00100000:3.0:1787384698.398520:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+9:15611:x1874208182370560:12345-192.168.203.45@tcp:35:lfs.0 00000100:00100000:3.0:1787384698.398868:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+10:15611:x1874208182370560:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 340us (592us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1787384698.398877:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 2 00000100:00100000:3.0:1787384698.409479:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384698.409608:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182370816 00000100:00100000:1.0:1787384698.409622:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182370816 00000100:00100000:1.0:1787384698.409702:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 34 00000100:00100000:1.0:1787384698.409714:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+10:15611:x1874208182370816:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:1.0:1787384698.409750:0:18681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384698.409823:0:18681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba3f5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3c09 expref: -99 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.409932:0:18681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba3f62 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.409972:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba3f62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.409995:0:18681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba3f62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.410009:0:18681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3f69 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.410017:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3f69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.410025:0:18681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3f69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384698.410180:0:18681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787384698.410275:0:18681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba3f62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.410283:0:18681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba3f62 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.410291:0:18681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba3f62 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.410297:0:18681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965b600 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384698.410302:0:18681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba3f62 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.410311:0:18681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba3f62 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.410337:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c3a9d500) 00010000:00010000:1.0:1787384698.410341:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384698.410346:0:18681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba3f62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.410352:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba3f62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.410369:0:18681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3f69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.410376:0:18681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3f69 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.410382:0:18681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3f69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.410387:0:18681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965ae00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384698.410389:0:18681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3f69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.410395:0:18681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3f69 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.410403:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98f7c3a9dc00) 00010000:00010000:1.0:1787384698.410406:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384698.410408:0:18681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3f69 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.410413:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3f69 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.410473:0:18681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba3f5b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c09 expref: 12 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.410485:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c3a9d500) 00010000:00010000:1.0:1787384698.410488:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787384698.410492:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba3f5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c09 expref: 12 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.410501:0:18681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965b200, rc 0) 00000100:00100000:1.0:1787384698.410587:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+11:15611:x1874208182370816:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 875us (1123us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1787384698.410595:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 34 00000100:00100000:1.0:1787384698.413602:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384698.415274:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182370944 00000100:00100000:0.0:1787384698.415292:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182370944 00000100:00100000:1.0:1787384698.415577:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 35 00000100:00100000:1.0:1787384698.415589:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+11:15611:x1874208182370944:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:1.0:1787384698.415625:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384698.415657:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba3f77 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3c10 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.415832:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba3f7e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.415849:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba3f7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.415873:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba3f7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384698.415930:0:17150:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787384698.415934:0:17150:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787384698.415961:0:17150:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba3f7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.415994:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba3f77 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c10 expref: 13 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.416016:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba3f7e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c10 expref: 12 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.416026:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98f7c3a9d200) 00010000:00010000:1.0:1787384698.416029:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787384698.416033:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965b400, rc 0) 00000100:00100000:1.0:1787384698.416129:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+12:15611:x1874208182370944:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 542us (2544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384698.416137:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 35 00000100:00100000:3.0:1787384698.419920:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384698.420062:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182371072 00000100:00100000:0.0:1787384698.420076:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182371072 00000100:00100000:0.0:1787384698.420149:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 3 00000100:00100000:0.0:1787384698.420161:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+12:15611:x1874208182371072:12345-192.168.203.45@tcp:37:lfs.0 00000100:00100000:0.0:1787384698.425496:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+12:15611:x1874208182371072:12345-192.168.203.45@tcp:37:lfs.0 Request processed in 5318us (5571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384698.425514:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 3 00000100:00100000:3.0:1787384698.440664:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384698.440905:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182371328 00000100:00100000:2.0:1787384698.440920:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182371328 00000100:00100000:2.0:1787384698.441004:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 4 00000100:00100000:2.0:1787384698.441018:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb74450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+12:15611:x1874208182371328:12345-192.168.203.45@tcp:35:lfs.0 00000100:00100000:2.0:1787384698.441334:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb74450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+13:15611:x1874208182371328:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 318us (685us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787384698.441343:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 4 00000100:00100000:3.0:1787384698.515022:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384698.515103:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182371456 00000100:00100000:1.0:1787384698.515117:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182371456 00000100:00100000:1.0:1787384698.515200:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 36 00000100:00100000:1.0:1787384698.515213:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+11:15617:x1874208182371456:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:1.0:1787384698.515241:0:18681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384698.515270:0:18681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba3f85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3c17 expref: -99 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.515351:0:18681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba3f8c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.515389:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba3f8c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.515402:0:18681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba3f8c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.515415:0:18681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3f93 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.515993:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3f93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.516016:0:18681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3f93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.516126:0:18681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba3f9a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.516137:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba3f9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.516145:0:18681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba3f9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384698.516191:0:18681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787384698.516195:0:18681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787384698.516241:0:18681:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba3f9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.516256:0:18681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba3f8c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.516276:0:18681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba3f8c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.516284:0:18681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba3f8c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.516290:0:18681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965b200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384698.516296:0:18681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba3f8c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.516303:0:18681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba3f8c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.517634:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c3a9d500) 00010000:00010000:1.0:1787384698.518273:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384698.518287:0:18681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba3f8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.518298:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba3f8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.518325:0:18681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3f93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.518332:0:18681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3f93 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.518339:0:18681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3f93 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.518345:0:18681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965ae00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384698.518370:0:18681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3f93 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.518380:0:18681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3f93 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.518395:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98f7c3a9dc00) 00010000:00010000:1.0:1787384698.518398:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384698.518401:0:18681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3f93 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.518407:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3f93 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.521188:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba3f85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c17 expref: 13 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.521229:0:18681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b600/0x7ef423838fba3f9a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c17 expref: 12 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.521241:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98f7c3a9d200) 00010000:00010000:1.0:1787384698.521245:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787384698.521249:0:18681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965b600, rc 0) 00000100:00100000:1.0:1787384698.521363:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+12:15617:x1874208182371456:12345-192.168.203.45@tcp:101:bash.0 Request processed in 6151us (6354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384698.521374:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 36 00000100:00100000:3.0:1787384698.523880:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384698.526562:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182371584 00000100:00100000:0.0:1787384698.526582:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182371584 00000100:00100000:0.0:1787384698.526675:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 7 00000100:00100000:0.0:1787384698.526687:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8741dc33-c445-439b-a6e3-d8ded553bb00+5:15617:x1874208182371584:12345-192.168.203.45@tcp:900:bash.0 00000100:00100000:0.0:1787384698.526877:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8741dc33-c445-439b-a6e3-d8ded553bb00+5:15617:x1874208182371584:12345-192.168.203.45@tcp:900:bash.0 Request processed in 191us (3020us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384698.526886:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 7 00000100:00100000:3.0:1787384698.530532:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384698.531989:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182371840 00000100:00100000:0.0:1787384698.532016:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182371840 00000100:00100000:0.0:1787384698.532104:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 37 00000100:00100000:0.0:1787384698.532117:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+12:15617:x1874208182371840:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:0.0:1787384698.532147:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384698.532173:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04400/0x7ef423838fba3fa1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3c1e expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.532317:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba3fa8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.532351:0:17150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba3f7e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c10 expref: 12 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.532361:0:17150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba3fa8 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.532403:0:17150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba3f7e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c10 expref: 12 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.532419:0:17150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba3f7e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c10 expref: 12 pid: 17150 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384698.532451:0:17150:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7f06300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17150:1874208203427072:192.168.203.45@tcp:104: 00000100:00100000:0.0:1787384698.532563:0:17150:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8293a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787384698.535432:0:17150:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7f06300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17150:1874208203427072:192.168.203.45@tcp:104: 00010000:00010000:0.0:1787384698.535471:0:17150:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba3fa8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384698.539171:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384698.552626:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182371968 00000100:00100000:2.0:1787384698.552647:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182371968 00010000:00010000:3.0:1787384698.552750:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba3f7e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c10 expref: 13 pid: 17150 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384698.552838:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 16 00000100:00100000:3.0:1787384698.552849:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb127b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+13:2415:x1874208182371968:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384698.552879:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384698.552887:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba3f7e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c10 expref: 13 pid: 17150 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384698.552905:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba3f7e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c10 expref: 13 pid: 17150 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384698.552931:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba3f7e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c10 expref: 13 pid: 17150 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384698.552951:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98f7c3a9d200) 00010000:00010000:3.0:1787384698.552956:0:17137:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba3fa8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384698.552967:0:17137:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba3fa8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384698.552976:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba3fa8 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384698.553028:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787384698.553101:0:17150:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba3fa8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.553114:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba3fa8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384698.553115:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb127b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+12:2415:x1874208182371968:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 265us (13956us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384698.553126:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 16 00010000:00010000:1.0:1787384698.553161:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba3faf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.553172:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba3faf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.553180:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba3faf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.554592:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3fb6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.554613:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.554624:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384698.554637:0:17150:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787384698.554679:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba3fa8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.554687:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba3fa8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.554694:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba3fa8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.554700:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b05400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384698.554706:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba3fa8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.554731:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba3fa8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.554745:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98f7c3a9d200) 00010000:00010000:1.0:1787384698.554749:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384698.554755:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba3fa8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.554762:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba3fa8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787384698.554795:0:17150:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008926d35e reply state 0000000040814cb9 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba3faf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.554807:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba3faf lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.554813:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98f8fd1d3d00) 00010000:00010000:1.0:1787384698.554816:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787384698.554819:0:17150:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787384698.555473:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04400/0x7ef423838fba3fa1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c1e expref: 15 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.555498:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c1e expref: 14 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.555507:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:1.0:1787384698.555509:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1787384698.555512:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965ae00, rc 0) 00000100:00100000:1.0:1787384698.555626:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+15:15617:x1874208182371840:12345-192.168.203.45@tcp:101:bash.0 Request processed in 23510us (25110us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787384698.555636:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 37 00000100:00100000:3.0:1787384698.570641:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384698.570763:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182372096 00000100:00100000:0.0:1787384698.570828:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182372096 00000100:00100000:0.0:1787384698.570903:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 38 00000100:00100000:0.0:1787384698.570917:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+15:15617:x1874208182372096:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:0.0:1787384698.570948:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384698.570975:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba3fc4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3c25 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.571145:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04a00/0x7ef423838fba3fcb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.571162:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04a00/0x7ef423838fba3fcb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.571176:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04a00/0x7ef423838fba3fcb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384698.571315:0:17151:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787384698.571320:0:17151:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787384698.571346:0:17151:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04a00/0x7ef423838fba3fcb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.571358:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04a00/0x7ef423838fba3fcb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.571387:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba3fc4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c25 expref: 17 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.571408:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04a00/0x7ef423838fba3fcb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c25 expref: 16 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.571418:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:0.0:1787384698.571422:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787384698.571425:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3b04a00, rc 0) 00000100:00100000:0.0:1787384698.571570:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+16:15617:x1874208182372096:12345-192.168.203.45@tcp:101:bash.0 Request processed in 655us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384698.571579:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 38 00000100:00100000:3.0:1787384698.574571:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384698.574744:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182372352 00000100:00100000:2.0:1787384698.574755:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182372352 00000100:00100000:3.0:1787384698.575211:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 5 00000100:00100000:3.0:1787384698.575233:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8cb126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+16:15617:x1874208182372352:12345-192.168.203.45@tcp:35:bash.0 00000100:00100000:3.0:1787384698.575621:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8cb126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+17:15617:x1874208182372352:12345-192.168.203.45@tcp:35:bash.0 Request processed in 398us (1061us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1787384698.575638:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 5 00000100:00100000:0.0:1787384698.635176:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384698.635394:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182372608 00000100:00100000:1.0:1787384698.635407:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182372608 00000100:00100000:0.0:1787384698.635615:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 39 00000100:00100000:0.0:1787384698.635629:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+17:15627:x1874208182372608:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:0.0:1787384698.635664:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384698.635694:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba3fd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3c2c expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384698.635990:0:17152:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787384698.636125:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba3fd2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c2c expref: 19 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.636144:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c3a9d500) 00010000:00010000:0.0:1787384698.636147:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787384698.636152:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba3fd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c2c expref: 19 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384698.636168:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3b04000, rc 0) 00000100:00100000:0.0:1787384698.636310:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+18:15627:x1874208182372608:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 684us (1150us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1787384698.636319:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 39 00000100:00100000:1.0:1787384698.639506:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384698.639564:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182372864 00000100:00100000:0.0:1787384698.639579:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182372864 00000100:00100000:0.0:1787384698.639660:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 6 00000100:00100000:0.0:1787384698.639672:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+18:15627:x1874208182372864:12345-192.168.203.45@tcp:35:lfs.0 00000100:00100000:0.0:1787384698.641064:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+19:15627:x1874208182372864:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 1382us (1558us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1787384698.641078:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 6 00000040:00080000:0.0:1787384698.680880:0:17904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1787384698.681450:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787384698.690848:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384698.691468:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182373120 00000100:00100000:1.0:1787384698.691481:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182373120 00000100:00100000:1.0:1787384698.691561:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 40 00000100:00100000:1.0:1787384698.691572:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+19:15630:x1874208182373120:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:1.0:1787384698.691610:0:18681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384698.691634:0:18681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba3fe0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3c33 expref: -99 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.691903:0:18681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba3fe7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.691922:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba3fe7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.691937:0:18681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba3fe7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384698.691952:0:18681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787384698.692153:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ba00/0x7ef423838fba3fe0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c33 expref: 22 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.692175:0:18681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba3fe7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c33 expref: 21 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.692208:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:1.0:1787384698.692211:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787384698.692216:0:18681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965a400, rc 0) 00000100:00100000:1.0:1787384698.692352:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+21:15630:x1874208182373120:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 781us (1518us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1787384698.692361:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 40 00000100:00100000:3.0:1787384698.699379:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384698.699439:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384698.699527:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182373248 00000100:00100000:1.0:1787384698.699541:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182373248 00000100:00100000:2.0:1787384698.699591:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182373376 00000100:00100000:2.0:1787384698.699597:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182373376 00000100:00100000:1.0:1787384698.699627:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 41 00000100:00100000:1.0:1787384698.699641:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+22:15630:x1874208182373248:12345-192.168.203.45@tcp:54:lfs.0 00000100:00100000:2.0:1787384698.699745:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 0 00000100:00100000:2.0:1787384698.699755:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+22:2416:x1874208182373376:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384698.699770:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384698.699839:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba3fe7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c33 expref: 22 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384698.699876:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:2.0:1787384698.699883:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384698.699946:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+21:2416:x1874208182373376:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 192us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384698.699954:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 0 00010000:00010000:1.0:1787384698.701402:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3ff5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.701429:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.701444:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.701497:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.701505:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3ff5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.701512:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.701519:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965be00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384698.701543:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.701551:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3ff5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.701565:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:1.0:1787384698.701568:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787384698.701572:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3ff5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384698.701578:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba3ff5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384698.701759:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+20:15630:x1874208182373248:12345-192.168.203.45@tcp:54:lfs.0 Request processed in 2116us (2389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384698.701916:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 41 00000100:00100000:3.0:1787384698.710554:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384698.711493:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182373632 00000100:00100000:0.0:1787384698.711507:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182373632 00000100:00100000:0.0:1787384698.711577:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 7 00000100:00100000:0.0:1787384698.711587:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+20:15630:x1874208182373632:12345-192.168.203.45@tcp:35:lfs.0 00000100:00100000:0.0:1787384698.711920:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+21:15630:x1874208182373632:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 333us (1379us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1787384698.711929:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 7 00000100:00100000:1.0:1787384699.079036:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384699.079207:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182373888 00000100:00100000:0.0:1787384699.079222:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182373888 00000100:00100000:0.0:1787384699.079331:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 42 00000100:00100000:0.0:1787384699.079346:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+21:15661:x1874208182373888:12345-192.168.203.45@tcp:101:cat.0 00010000:00010000:0.0:1787384699.079385:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384699.079416:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05c00/0x7ef423838fba3ffc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3c3a expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384699.079575:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04e00/0x7ef423838fba4003 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384699.079595:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04e00/0x7ef423838fba4003 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384699.079612:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04e00/0x7ef423838fba4003 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384699.079627:0:17151:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787384699.079852:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05c00/0x7ef423838fba3ffc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c3a expref: 24 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384699.079905:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04e00/0x7ef423838fba4003 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c3a expref: 23 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384699.079915:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:0.0:1787384699.079919:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787384699.079923:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3b04e00, rc 0) 00000100:00100000:0.0:1787384699.080069:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+23:15661:x1874208182373888:12345-192.168.203.45@tcp:101:cat.0 Request processed in 727us (1049us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1787384699.080081:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 42 00000100:00080000:2.0:1787384699.080755:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384699.090382:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384699.090476:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182374016 00000100:00100000:3.0:1787384699.090491:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182374016 00000100:00100000:3.0:1787384699.090574:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 1 00000100:00100000:3.0:1787384699.090584:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+23:2416:x1874208182374016:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384699.090603:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384699.090633:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04e00/0x7ef423838fba4003 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c3a expref: 23 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384699.090659:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:3.0:1787384699.090681:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384699.090744:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+22:2416:x1874208182374016:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 161us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384699.090753:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 1 00000100:00100000:3.0:1787384699.096266:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384699.100157:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182374272 00000100:00100000:0.0:1787384699.100178:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182374272 00000100:00100000:0.0:1787384699.100268:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 8 00000100:00100000:0.0:1787384699.100281:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+22:15661:x1874208182374272:12345-192.168.203.45@tcp:35:cat.0 00000100:00100000:0.0:1787384699.100690:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+23:15661:x1874208182374272:12345-192.168.203.45@tcp:35:cat.0 Request processed in 411us (4440us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1787384699.100700:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 8 00000100:00100000:1.0:1787384699.199505:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384699.199580:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182374528 00000100:00100000:0.0:1787384699.199593:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182374528 00000100:00100000:0.0:1787384699.199673:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 43 00000100:00100000:0.0:1787384699.199684:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+23:15667:x1874208182374528:12345-192.168.203.45@tcp:101:dd.0 00010000:00010000:0.0:1787384699.199820:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384699.199849:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05c00/0x7ef423838fba4011 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3c41 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384699.200010:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04800/0x7ef423838fba4018 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384699.200044:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04800/0x7ef423838fba4018 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384699.200059:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04800/0x7ef423838fba4018 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384699.200074:0:17152:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787384699.200324:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05c00/0x7ef423838fba4011 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c41 expref: 26 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384699.200350:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04800/0x7ef423838fba4018 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c41 expref: 25 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384699.200360:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:1.0:1787384699.200364:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787384699.200368:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3b04800, rc 0) 00000100:00100000:1.0:1787384699.200453:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+25:15667:x1874208182374528:12345-192.168.203.45@tcp:101:dd.0 Request processed in 769us (961us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1787384699.200469:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 43 00000100:00100000:1.0:1787384699.205214:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384699.207208:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384699.207426:0:19489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182374784 00000100:00100000:3.0:1787384699.207439:0:19489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182374784 00000100:00100000:3.0:1787384699.207516:0:19489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 2 00000100:00100000:3.0:1787384699.207529:0:19489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+25:2415:x1874208182374784:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384699.207548:0:19489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384699.207581:0:19489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04800/0x7ef423838fba4018 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c41 expref: 25 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384699.207604:0:19489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:3.0:1787384699.207611:0:19489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384699.207722:0:19489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+24:2415:x1874208182374784:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 194us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384699.207730:0:19489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 2 00000100:00100000:0.0:1787384699.207830:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182374656 00000100:00100000:0.0:1787384699.207836:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182374656 00000100:00100000:0.0:1787384699.207882:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 44 00000100:00100000:0.0:1787384699.207890:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d9b54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+24:15667:x1874208182374656:12345-192.168.203.45@tcp:101:dd.0 00010000:00010000:0.0:1787384699.207927:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384699.207947:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05200/0x7ef423838fba4026 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3c48 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384699.207999:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba402d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384699.208014:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba402d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384699.208027:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba402d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384699.208179:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05200/0x7ef423838fba4026 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c48 expref: 26 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384699.208196:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba402d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c48 expref: 25 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384699.208217:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:0.0:1787384699.208220:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787384699.208223:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3b04200, rc 0) 00000100:00100000:0.0:1787384699.217177:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d9b54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+25:15667:x1874208182374656:12345-192.168.203.45@tcp:101:dd.0 Request processed in 9265us (11956us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384699.217197:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 44 00000100:00100000:1.0:1787384699.233619:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384699.233732:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182375040 00000100:00100000:2.0:1787384699.233746:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182375040 00000100:00100000:2.0:1787384699.234345:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 45 00000100:00100000:2.0:1787384699.234358:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4aced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+25:15667:x1874208182375040:12345-192.168.203.45@tcp:36:dd.0 00010000:00010000:2.0:1787384699.234431:0:17152:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384699.234467:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04a00/0x7ef423838fba3fcb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c25 expref: 25 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384699.234489:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:2.0:1787384699.234495:0:17152:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787384699.234741:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba4034 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384699.234757:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba4034 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384699.234884:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba4034 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787384699.234953:0:17152:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1787384699.235102:0:17152:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000012f60e7b reply state 0000000090163f1f transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba4034 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384699.235336:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba4034 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384699.235345:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:2.0:1787384699.235348:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787384699.235351:0:17152:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787384699.235552:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4aced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+27:15667:x1874208182375040:12345-192.168.203.45@tcp:36:dd.0 Request processed in 1194us (1945us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1787384699.235563:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 45 00000020:00080000:2.0:1787384699.235581:0:17152:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787384699.255200:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384699.354451:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384699.355096:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182375296 00000100:00100000:0.0:1787384699.355110:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182375296 00000100:00100000:0.0:1787384699.355191:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 9 00000100:00100000:0.0:1787384699.355202:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4acd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+27:15667:x1874208182375296:12345-192.168.203.45@tcp:35:dd.0 00000100:00100000:0.0:1787384699.355519:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4acd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+28:15667:x1874208182375296:12345-192.168.203.45@tcp:35:dd.0 Request processed in 317us (1083us total) trans 8589934611 rc 0/0 00000100:00100000:0.0:1787384699.355528:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 9 00000100:00100000:0.0:1787384699.660924:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384699.662964:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182375424 00000100:00100000:3.0:1787384699.662994:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182375424 00000100:00100000:3.0:1787384699.663106:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 46 00000100:00100000:3.0:1787384699.663119:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+28:15681:x1874208182375424:12345-192.168.203.45@tcp:101:stat.0 00010000:00010000:3.0:1787384699.663348:0:18681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384699.663376:0:18681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba403b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3c4f expref: -99 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384699.663463:0:18681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc400/0x7ef423838fba4042 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384699.663500:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc400/0x7ef423838fba4042 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384699.663514:0:18681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc400/0x7ef423838fba4042 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384699.663528:0:18681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd000/0x7ef423838fba4049 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384699.663535:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd000/0x7ef423838fba4049 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384699.663542:0:18681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd000/0x7ef423838fba4049 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384699.664594:0:18681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd400/0x7ef423838fba4050 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384699.664614:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd400/0x7ef423838fba4050 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384699.664623:0:18681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd400/0x7ef423838fba4050 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384699.664685:0:18681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787384699.664690:0:18681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787384699.664734:0:18681:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd400/0x7ef423838fba4050 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384699.664749:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd400/0x7ef423838fba4050 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384699.664806:0:18681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc400/0x7ef423838fba4042 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384699.664812:0:18681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc400/0x7ef423838fba4042 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384699.664819:0:18681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc400/0x7ef423838fba4042 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384699.664824:0:18681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cc400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384699.664829:0:18681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc400/0x7ef423838fba4042 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384699.664838:0:18681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc400/0x7ef423838fba4042 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384699.664882:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98f7c3a9d200) 00010000:00010000:3.0:1787384699.664886:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384699.664891:0:18681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc400/0x7ef423838fba4042 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384699.664902:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc400/0x7ef423838fba4042 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384699.664920:0:18681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd000/0x7ef423838fba4049 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384699.664926:0:18681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd000/0x7ef423838fba4049 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384699.664931:0:18681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd000/0x7ef423838fba4049 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384699.664943:0:18681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8f58cd000 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:3.0:1787384699.664947:0:18681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd000/0x7ef423838fba4049 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384699.664953:0:18681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd000/0x7ef423838fba4049 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384699.664961:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98f8fd1d3d00) 00010000:00010000:3.0:1787384699.664964:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384699.664967:0:18681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd000/0x7ef423838fba4049 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384699.664972:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd000/0x7ef423838fba4049 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384699.665038:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba403b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c4f expref: 30 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384699.665055:0:18681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd400/0x7ef423838fba4050 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c4f expref: 29 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384699.665062:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:3.0:1787384699.665065:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787384699.665067:0:18681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cd400, rc 0) 00000100:00100000:3.0:1787384699.666755:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+29:15681:x1874208182375424:12345-192.168.203.45@tcp:101:stat.0 Request processed in 3623us (5831us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384699.666771:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 46 00000100:00100000:1.0:1787384699.759144:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384699.759209:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384699.759252:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384699.759286:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384699.759307:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384699.759324:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384699.759362:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182375808 00000100:00100000:1.0:1787384699.759363:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182376320 00000100:00100000:2.0:1787384699.759376:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182375808 00000100:00100000:1.0:1787384699.759376:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182376320 00000100:00100000:0.0:1787384699.759473:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182376064 00000100:00100000:0.0:1787384699.759478:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182376064 00000100:00100000:0.0:1787384699.759516:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182375680 00000100:00100000:0.0:1787384699.759519:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182375680 00000100:00100000:0.0:1787384699.759542:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 65 00000100:00100000:0.0:1787384699.759553:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4acc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+12:2414:x1874208182376064:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384699.759646:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4acc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+12:2414:x1874208182376064:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 95us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384699.759654:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 65 00000100:00100000:0.0:1787384699.759671:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 66 00000100:00100000:0.0:1787384699.759676:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4acc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+5:2413:x1874208182375680:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384699.759717:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4acc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+5:2413:x1874208182375680:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 41us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384699.759723:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 66 00000100:00100000:0.0:1787384699.759760:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384699.759836:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182375936 00000100:00100000:1.0:1787384699.759841:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182375936 00000100:00100000:1.0:1787384699.759872:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 20 00000100:00100000:1.0:1787384699.759880:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4acf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+5:2414:x1874208182376320:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384699.759912:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4acf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+5:2414:x1874208182376320:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 33us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384699.759918:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 20 00000100:00100000:1.0:1787384699.759931:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 21 00000100:00100000:1.0:1787384699.759937:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4ace680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+5:2413:x1874208182375936:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384699.759960:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4ace680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+5:2413:x1874208182375936:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 23us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384699.759966:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 21 00000100:00100000:0.0:1787384699.760017:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182376192 00000100:00100000:0.0:1787384699.760022:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182376192 00000100:00100000:0.0:1787384699.760049:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 67 00000100:00100000:0.0:1787384699.760055:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+5:2413:x1874208182376192:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384699.760082:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+5:2413:x1874208182376192:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 27us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384699.760089:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 67 00000100:00100000:3.0:1787384699.760114:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182375552 00000100:00100000:3.0:1787384699.760126:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182375552 00000100:00100000:3.0:1787384699.760168:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 167 00000100:00100000:3.0:1787384699.760177:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b965c805-ceb8-4757-b53e-03d6d45231a8+13:2414:x1874208182375552:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384699.760211:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b965c805-ceb8-4757-b53e-03d6d45231a8+13:2414:x1874208182375552:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 36us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384699.760218:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 167 00000100:00080000:1.0:1787384699.760229:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787384699.760234:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787384699.760285:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384699.761331:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182376448 00000100:00100000:3.0:1787384699.761343:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182376448 00000100:00080000:0.0:1787384699.761650:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787384699.761895:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 22 00000100:00100000:2.0:1787384699.761911:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8c6db8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+5:2414:x1874208182375808:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787384699.762006:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8c6db8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+5:2414:x1874208182375808:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 100us (2796us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384699.762016:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 22 00000100:00100000:3.0:1787384699.774767:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 23 00000100:00100000:3.0:1787384699.774837:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4acd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+5:2413:x1874208182376448:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787384699.774971:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4acd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+5:2413:x1874208182376448:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 147us (14686us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384699.774980:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 23 00000100:00100000:0.0:1787384699.826453:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384699.826678:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182376704 00000100:00100000:2.0:1787384699.826692:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182376704 00000100:00100000:2.0:1787384699.827062:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 47 00000100:00100000:2.0:1787384699.827082:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7f06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+29:15687:x1874208182376704:12345-192.168.203.45@tcp:36:truncate.0 00010000:00010000:2.0:1787384699.827157:0:17150:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384699.827196:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd400/0x7ef423838fba4050 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c4f expref: 29 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384699.827219:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:2.0:1787384699.827225:0:17150:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787384699.828728:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090200/0x7ef423838fba4057 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384699.828756:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090200/0x7ef423838fba4057 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384699.830047:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090200/0x7ef423838fba4057 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787384699.830184:0:17150:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:2.0:1787384699.833069:0:17150:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000022a6ca31 reply state 0000000034adbeb8 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090200/0x7ef423838fba4057 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384699.833106:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090200/0x7ef423838fba4057 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384699.833118:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:2.0:1787384699.833122:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787384699.833128:0:17150:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787384699.833402:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7f06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+31:15687:x1874208182376704:12345-192.168.203.45@tcp:36:truncate.0 Request processed in 6319us (6959us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1787384699.833414:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 47 00000020:00080000:2.0:1787384699.833422:0:17150:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787384700.137579:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384700.137710:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182376832 00000100:00100000:1.0:1787384700.137724:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182376832 00000100:00100000:1.0:1787384700.137862:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 48 00000100:00100000:1.0:1787384700.137875:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+31:15701:x1874208182376832:12345-192.168.203.45@tcp:101:stat.0 00010000:00010000:1.0:1787384700.137906:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384700.137933:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba405e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3c56 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.138020:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba4065 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.138037:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba4065 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.138052:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba4065 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.138065:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba406c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.138071:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba406c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.138078:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba406c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.138169:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba4073 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.138200:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba4073 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.138208:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba4073 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384700.138266:0:17152:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:1.0:1787384700.138271:0:17152:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787384700.138301:0:17152:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba4073 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.138316:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba4073 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.138326:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba4065 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.138335:0:17152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba4065 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.138343:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba4065 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.138349:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965b200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384700.138353:0:17152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba4065 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.138361:0:17152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba4065 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.138375:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98f7c3a9d200) 00010000:00010000:1.0:1787384700.138384:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384700.138390:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba4065 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.138397:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba4065 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.138414:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba406c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.138421:0:17152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba406c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.138428:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba406c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.138434:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965bc00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384700.138438:0:17152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba406c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.138444:0:17152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba406c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.138453:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98f8fd1d3d00) 00010000:00010000:1.0:1787384700.138456:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384700.138459:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba406c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.138466:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba406c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.138499:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba405e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c56 expref: 33 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.138527:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba4073 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c56 expref: 32 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.138535:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:1.0:1787384700.138537:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787384700.138540:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965be00, rc 0) 00000100:00100000:1.0:1787384700.138633:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+32:15701:x1874208182376832:12345-192.168.203.45@tcp:101:stat.0 Request processed in 761us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384700.138642:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 48 00010000:00010000:2.0:1787384700.279704:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384700.287824:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384700.288366:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182377088 00000100:00100000:0.0:1787384700.288384:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182377088 00000100:00100000:0.0:1787384700.288471:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 49 00000100:00100000:0.0:1787384700.288485:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+32:15711:x1874208182377088:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:0.0:1787384700.288513:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384700.288554:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04400/0x7ef423838fba407a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3c5d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384700.288704:0:17151:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787384700.288887:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04400/0x7ef423838fba407a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c5d expref: 34 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384700.289065:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c3a9d500) 00010000:00010000:0.0:1787384700.289069:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787384700.289076:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04400/0x7ef423838fba407a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c5d expref: 34 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384700.289094:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3b04400, rc 0) 00000100:00100000:0.0:1787384700.289446:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+33:15711:x1874208182377088:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 962us (1677us total) trans 8589934614 rc 301/301 00000100:00100000:0.0:1787384700.289456:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 49 00000100:00100000:0.0:1787384700.315592:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384700.316147:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182377344 00000100:00100000:3.0:1787384700.316161:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182377344 00000100:00100000:3.0:1787384700.316247:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 10 00000100:00100000:3.0:1787384700.316259:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8efb76050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+33:15711:x1874208182377344:12345-192.168.203.45@tcp:35:lfs.0 00000100:00100000:3.0:1787384700.316596:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8efb76050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+34:15711:x1874208182377344:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 338us (1019us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1787384700.316606:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 10 00000100:00100000:1.0:1787384700.441081:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384700.441409:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182377600 00000100:00100000:2.0:1787384700.441423:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182377600 00000100:00100000:2.0:1787384700.441504:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 50 00000100:00100000:2.0:1787384700.441517:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4acf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+34:15717:x1874208182377600:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:2.0:1787384700.441548:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384700.441576:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090600/0x7ef423838fba4088 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3c64 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.441722:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090a00/0x7ef423838fba408f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.441740:0:17152:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3fb6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c1e expref: 35 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.441749:0:17152:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba4073 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c56 expref: 35 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.441956:0:17152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090a00/0x7ef423838fba408f lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.442429:0:17152:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba4073 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c56 expref: 35 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.442449:0:17152:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba4073 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c56 expref: 35 pid: 17152 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384700.442468:0:17152:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e06300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17152:1874208203427200:192.168.203.45@tcp:104: 00010000:00010000:2.0:1787384700.442669:0:17152:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c1e expref: 35 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.442678:0:17152:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3fb6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c1e expref: 35 pid: 17150 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384700.442687:0:17152:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e06a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17152:1874208203427328:192.168.203.45@tcp:104: 00000100:00100000:2.0:1787384700.442714:0:17152:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fd1eb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384700.458672:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384700.458728:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384700.459267:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182377728 00000100:00100000:3.0:1787384700.459280:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182377728 00010000:00010000:3.0:1787384700.459337:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba4073 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c56 expref: 36 pid: 17152 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384700.459409:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182377856 00000100:00100000:3.0:1787384700.459413:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182377856 00010000:00010000:3.0:1787384700.459431:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3fb6 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c1e expref: 37 pid: 17150 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384700.459458:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 17 00000100:00100000:3.0:1787384700.459469:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d8523050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+37:2416:x1874208182377728:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384700.459488:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384700.459496:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba4073 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c56 expref: 37 pid: 17152 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384700.459510:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba4073 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c56 expref: 37 pid: 17152 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384700.459537:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:3.0:1787384700.459543:0:17137:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090a00/0x7ef423838fba408f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384700.459553:0:17137:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090a00/0x7ef423838fba408f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384700.459560:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384700.459628:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d8523050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+37:2416:x1874208182377728:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 160us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384700.459636:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 17 00000100:00100000:3.0:1787384700.459693:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 18 00000100:00100000:3.0:1787384700.459700:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+36:2416:x1874208182377856:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384700.459716:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384700.459722:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3fb6 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c1e expref: 36 pid: 17150 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384700.459732:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3fb6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c1e expref: 36 pid: 17150 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384700.459744:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:3.0:1787384700.459748:0:17137:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090a00/0x7ef423838fba408f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384700.459756:0:17137:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090a00/0x7ef423838fba408f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384700.459775:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090a00/0x7ef423838fba408f lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384700.460079:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384700.460104:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+36:2416:x1874208182377856:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 404us (1376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384700.460111:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 18 00010000:00010000:2.0:1787384700.461486:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965be00/0x7ef423838fba4073 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c56 expref: 35 pid: 17152 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384700.461516:0:17152:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e06300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17152:1874208203427200:192.168.203.45@tcp:104: 00010000:00010000:2.0:1787384700.461531:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba3fb6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c1e expref: 34 pid: 17150 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384700.461566:0:17152:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e06a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17152:1874208203427328:192.168.203.45@tcp:104: 00010000:00010000:2.0:1787384700.461598:0:17152:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090a00/0x7ef423838fba408f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.461609:0:17152:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090a00/0x7ef423838fba408f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.461614:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090a00/0x7ef423838fba408f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384700.461640:0:17152:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:2.0:1787384700.462036:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090600/0x7ef423838fba4088 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c64 expref: 35 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.462055:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090a00/0x7ef423838fba408f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c64 expref: 34 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.462064:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:2.0:1787384700.462068:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787384700.462071:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2090a00, rc 0) 00000100:00100000:2.0:1787384700.462329:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4acf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+34:15717:x1874208182377600:12345-192.168.203.45@tcp:101:bash.0 Request processed in 20704us (21151us total) trans 8589934616 rc 0/0 00000100:00100000:2.0:1787384700.462969:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 50 00000100:00100000:1.0:1787384700.473268:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384700.473450:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182378112 00000100:00100000:0.0:1787384700.473463:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182378112 00000100:00100000:0.0:1787384700.473544:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 51 00000100:00100000:0.0:1787384700.473556:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4acc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+34:15717:x1874208182378112:12345-192.168.203.45@tcp:36:bash.0 00010000:00010000:0.0:1787384700.474194:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04400/0x7ef423838fba409d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384700.474217:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04400/0x7ef423838fba409d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384700.474233:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04400/0x7ef423838fba409d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787384700.474293:0:17151:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:0.0:1787384700.474332:0:17151:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000056796557 reply state 000000002ae4b774 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04400/0x7ef423838fba409d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384700.474362:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04400/0x7ef423838fba409d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384700.474371:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:0.0:1787384700.474374:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787384700.474379:0:17151:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787384700.474504:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4acc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+37:15717:x1874208182378112:12345-192.168.203.45@tcp:36:bash.0 Request processed in 948us (1250us total) trans 8589934618 rc 0/0 00000100:00100000:0.0:1787384700.474513:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 51 00000020:00080000:0.0:1787384700.474519:0:17151:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787384700.499208:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384700.499955:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182378240 00000100:00100000:3.0:1787384700.499979:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182378240 00000100:00100000:3.0:1787384700.500067:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 52 00000100:00100000:3.0:1787384700.500081:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4ace300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+37:15717:x1874208182378240:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:3.0:1787384700.500117:0:18681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384700.500151:0:18681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba40a4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3c6b expref: -99 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384700.500253:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba40a4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c6b expref: 38 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384700.500272:0:18681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba40a4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c6b expref: 38 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384700.500300:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:3.0:1787384700.500303:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787384700.500308:0:18681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cc600, rc 0) 00000100:00100000:3.0:1787384700.500396:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4ace300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+38:15717:x1874208182378240:12345-192.168.203.45@tcp:101:bash.0 Request processed in 317us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384700.500403:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 52 00000100:00100000:1.0:1787384700.508182:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384700.508358:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182378368 00000100:00100000:0.0:1787384700.508371:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182378368 00000100:00100000:0.0:1787384700.508447:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 53 00000100:00100000:0.0:1787384700.508459:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4acf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+38:15717:x1874208182378368:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:0.0:1787384700.508485:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384700.508511:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba40ab lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3c72 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384700.508641:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba40b2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384700.508673:0:17151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090a00/0x7ef423838fba408f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c64 expref: 39 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384700.508683:0:17151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba40b2 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384700.508727:0:17151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090a00/0x7ef423838fba408f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c64 expref: 39 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384700.508767:0:17151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090a00/0x7ef423838fba408f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c64 expref: 39 pid: 17152 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384700.509259:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c422c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17151:1874208203427456:192.168.203.45@tcp:104: 00000100:00100000:0.0:1787384700.509373:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d82933c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384700.516285:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384700.516446:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182378496 00000100:00100000:3.0:1787384700.516460:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182378496 00010000:00010000:3.0:1787384700.516514:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090a00/0x7ef423838fba408f lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c64 expref: 40 pid: 17152 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384700.516571:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 19 00000100:00100000:3.0:1787384700.516582:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4acea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+40:2415:x1874208182378496:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384700.516602:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384700.516610:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090a00/0x7ef423838fba408f lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c64 expref: 40 pid: 17152 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384700.516626:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090a00/0x7ef423838fba408f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c64 expref: 40 pid: 17152 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384700.516693:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:3.0:1787384700.516699:0:17137:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba40b2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384700.516710:0:17137:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba40b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384700.516718:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba40b2 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384700.516742:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384700.517306:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4acea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+40:2415:x1874208182378496:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 722us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384700.517316:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 19 00010000:00010000:0.0:1787384700.517536:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090a00/0x7ef423838fba408f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c64 expref: 39 pid: 17152 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384700.517557:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c422c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17151:1874208203427456:192.168.203.45@tcp:104: 00010000:00010000:0.0:1787384700.517584:0:17151:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba40b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384700.517595:0:17151:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba40b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384700.517602:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba40b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384700.518015:0:17151:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787384700.518021:0:17151:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787384700.518049:0:17151:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba40b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384700.518097:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba40ab lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c72 expref: 39 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384700.518114:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba40b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c72 expref: 38 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384700.518143:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:0.0:1787384700.518146:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787384700.518150:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3b04000, rc 0) 00000100:00100000:0.0:1787384700.518202:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4acf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+38:15717:x1874208182378368:12345-192.168.203.45@tcp:101:bash.0 Request processed in 9745us (10034us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384700.518210:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 53 00000100:00100000:1.0:1787384700.525384:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384700.525577:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182378752 00000100:00100000:3.0:1787384700.525591:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182378752 00000100:00100000:3.0:1787384700.525673:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 3 00000100:00100000:3.0:1787384700.525685:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4acdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+38:15717:x1874208182378752:12345-192.168.203.45@tcp:103:bash.0 00010000:00010000:3.0:1787384700.525704:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787384700.525734:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba40a4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c6b expref: 38 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384700.525768:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04000/0x7ef423838fba40b2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c72 expref: 37 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384700.526031:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:3.0:1787384700.526038:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384700.526105:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4acdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+36:15717:x1874208182378752:12345-192.168.203.45@tcp:103:bash.0 Request processed in 422us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384700.526114:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 3 00000100:00100000:3.0:1787384700.528961:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384700.533421:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182378880 00000100:00100000:0.0:1787384700.533441:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182378880 00000100:00100000:0.0:1787384700.533535:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 54 00000100:00100000:0.0:1787384700.533546:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+36:15717:x1874208182378880:12345-192.168.203.45@tcp:58:bash.0 00010000:00010000:0.0:1787384700.533687:0:18681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba40b9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384700.533709:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba40b9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384700.533727:0:18681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba40b9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787384700.539125:0:18681:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787384700.539571:0:18681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1787384700.539720:0:18681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1787384700.540393:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+36:15717:x1874208182378880:12345-192.168.203.45@tcp:58:bash.0 Request processed in 6837us (11432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384700.540407:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 54 00000100:00100000:1.0:1787384700.548650:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384700.558946:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182379008 00000100:00100000:2.0:1787384700.558967:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182379008 00000100:00100000:2.0:1787384700.559060:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 55 00000100:00100000:2.0:1787384700.559072:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4acd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+36:15717:x1874208182379008:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:2.0:1787384700.559099:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384700.559126:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090600/0x7ef423838fba40c0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3c79 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.559197:0:17150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba40b9 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.559210:0:17150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090600/0x7ef423838fba40c0 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c79 expref: 37 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.559235:0:17150:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba40b9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.559251:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090600/0x7ef423838fba40c0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c79 expref: 37 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.559266:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:2.0:1787384700.559270:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787384700.559274:0:17150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090600/0x7ef423838fba40c0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c79 expref: 37 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.559281:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2090600, rc 0) 00000100:00100000:2.0:1787384700.559371:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4acd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+37:15717:x1874208182379008:12345-192.168.203.45@tcp:101:bash.0 Request processed in 301us (10735us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384700.559379:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 55 00000040:00080000:3.0:1787384700.727402:0:17184:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787384700.727417:0:17184:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787384700.727473:0:17184:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787384700.727487:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787384700.727677:0:17184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c20d0e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17184:1874208203427584:192.168.203.45@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787384700.728049:0:17184:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fc1dd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384700.733616:0:17184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c20d0e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17184:1874208203427584:192.168.203.45@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787384700.737350:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384700.737706:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182379136 00000100:00100000:1.0:1787384700.737716:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182379136 00000100:00100000:1.0:1787384700.737817:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 56 00000100:00100000:1.0:1787384700.737828:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+37:15718:x1874208182379136:12345-192.168.203.45@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787384700.737878:0:17152:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787384700.738018:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+37:15718:x1874208182379136:12345-192.168.203.45@tcp:53:lhsmtool_posix.0 Request processed in 192us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384700.738044:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 56 00000100:00100000:1.0:1787384700.745212:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384700.745317:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182379264 00000100:00100000:2.0:1787384700.745327:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182379264 00000100:00100000:2.0:1787384700.745387:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 57 00000100:00100000:2.0:1787384700.745397:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4acca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+37:15718:x1874208182379264:12345-192.168.203.45@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787384700.745465:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091e00/0x7ef423838fba40c7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.745482:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091e00/0x7ef423838fba40c7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.745493:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091e00/0x7ef423838fba40c7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.745544:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090e00/0x7ef423838fba40ce lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.745553:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090e00/0x7ef423838fba40ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.745560:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090e00/0x7ef423838fba40ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.745581:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091c00/0x7ef423838fba40d5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.745589:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091c00/0x7ef423838fba40d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.745596:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091c00/0x7ef423838fba40d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384700.745639:0:17150:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787384700.745655:0:17150:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787384700.745668:0:17150:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091c00/0x7ef423838fba40d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.745679:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091e00/0x7ef423838fba40c7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.745685:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091e00/0x7ef423838fba40c7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.745693:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091e00/0x7ef423838fba40c7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.745699:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2091e00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384700.745703:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091e00/0x7ef423838fba40c7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.745710:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091e00/0x7ef423838fba40c7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.745722:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98f7c3a9dd00) 00010000:00010000:2.0:1787384700.745726:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384700.745730:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091e00/0x7ef423838fba40c7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.745737:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091e00/0x7ef423838fba40c7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.745750:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090e00/0x7ef423838fba40ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.745756:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090e00/0x7ef423838fba40ce lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.745772:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090e00/0x7ef423838fba40ce lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.746049:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2090e00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384700.746052:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090e00/0x7ef423838fba40ce lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.746059:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090e00/0x7ef423838fba40ce lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.746068:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff98f8fc248700) 00010000:00010000:2.0:1787384700.746071:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384700.746074:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090e00/0x7ef423838fba40ce lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.746080:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090e00/0x7ef423838fba40ce lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.746097:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091c00/0x7ef423838fba40d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.746104:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091c00/0x7ef423838fba40d5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.746110:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091c00/0x7ef423838fba40d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.746115:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2091c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384700.746118:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091c00/0x7ef423838fba40d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.746135:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091c00/0x7ef423838fba40d5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.746143:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:2.0:1787384700.746146:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384700.746149:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091c00/0x7ef423838fba40d5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.746154:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091c00/0x7ef423838fba40d5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384700.746236:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4acca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+37:15718:x1874208182379264:12345-192.168.203.45@tcp:34:lhsmtool_posix.0 Request processed in 839us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384700.746244:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 57 00000100:00100000:2.0:1787384700.755023:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384700.755188:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182379520 00000100:00100000:1.0:1787384700.755197:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182379520 00000100:00100000:1.0:1787384700.755255:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 58 00000100:00100000:1.0:1787384700.755266:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+37:15718:x1874208182379520:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787384700.755285:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384700.755308:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba40dc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3c80 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.755414:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba40e3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.755429:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba40e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.755440:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba40e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384700.755450:0:17152:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787384700.755544:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba40e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.755551:0:17152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba40e3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.755556:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba40e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.755562:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965bc00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384700.755579:0:17152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba40e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.755586:0:17152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba40e3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.755598:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:1.0:1787384700.755601:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787384700.755605:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba40e3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.755611:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba40e3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.755653:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba40dc lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c80 expref: 39 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.755663:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98f7c3a9dd00) 00010000:00010000:1.0:1787384700.755666:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787384700.755669:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b400/0x7ef423838fba40dc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c80 expref: 39 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.755677:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965b400, rc 0) 00000100:00100000:1.0:1787384700.755740:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+38:15718:x1874208182379520:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 476us (727us total) trans 8589934619 rc 301/301 00000100:00100000:1.0:1787384700.755747:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 58 00000100:00100000:1.0:1787384700.766830:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384700.766928:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182379648 00000100:00100000:0.0:1787384700.766937:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182379648 00000100:00100000:0.0:1787384700.767022:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 59 00000100:00100000:0.0:1787384700.767033:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4acce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+38:15718:x1874208182379648:12345-192.168.203.45@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787384700.767065:0:17151:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787384700.767190:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4acce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+38:15718:x1874208182379648:12345-192.168.203.45@tcp:53:lhsmtool_posix.0 Request processed in 158us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384700.767198:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 59 00000100:00100000:3.0:1787384700.779544:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384700.780148:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182379904 00000100:00100000:1.0:1787384700.780157:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182379904 00000100:00100000:1.0:1787384700.780218:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 60 00000100:00100000:1.0:1787384700.780242:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+38:15718:x1874208182379904:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787384700.780264:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384700.780283:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba40f1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3c87 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787384700.780662:0:17152:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:1.0:1787384700.780669:0:17152:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:1.0:1787384700.780689:0:17152:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:1.0:1787384700.781643:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba40f8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.781660:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba40f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.781671:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba40f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.781725:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba40f1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c87 expref: 41 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.781744:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba40f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c87 expref: 40 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.781753:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98f8fd1d3900) 00010000:00010000:1.0:1787384700.781756:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787384700.781918:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965b200, rc 0) 00000100:00100000:1.0:1787384700.782001:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+40:15718:x1874208182379904:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 1760us (2465us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1787384700.782009:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 60 00000100:00100000:0.0:1787384700.797264:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384700.797385:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182380160 00000100:00100000:2.0:1787384700.797395:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182380160 00000100:00100000:2.0:1787384700.797456:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 61 00000100:00100000:2.0:1787384700.797467:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+40:15718:x1874208182380160:12345-192.168.203.45@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787384700.797526:0:17151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384700.797552:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965b200/0x7ef423838fba40f8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c87 expref: 40 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.797571:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98f8fd1d3900) 00010000:00010000:2.0:1787384700.797582:0:17151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787384700.797604:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090e00/0x7ef423838fba4106 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.797634:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090e00/0x7ef423838fba4106 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.797644:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090e00/0x7ef423838fba4106 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.798043:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091e00/0x7ef423838fba410d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc5b19d45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.798053:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091e00/0x7ef423838fba410d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc5b19d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.798061:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091e00/0x7ef423838fba410d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc5b19d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.798114:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090e00/0x7ef423838fba4106 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.798121:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090e00/0x7ef423838fba4106 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.798126:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090e00/0x7ef423838fba4106 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.798132:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2090e00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384700.798136:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090e00/0x7ef423838fba4106 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.798143:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090e00/0x7ef423838fba4106 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.798151:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98f7c3a9d200) 00010000:00010000:2.0:1787384700.798160:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384700.798164:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090e00/0x7ef423838fba4106 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.798170:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090e00/0x7ef423838fba4106 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.798179:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091e00/0x7ef423838fba410d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc5b19d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.798185:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091e00/0x7ef423838fba410d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc5b19d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.798190:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091e00/0x7ef423838fba410d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc5b19d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.798194:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2091e00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384700.798197:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091e00/0x7ef423838fba410d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc5b19d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.798203:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091e00/0x7ef423838fba410d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc5b19d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.798211:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xc5b19d45 (ffff98f8fc248700) 00010000:00010000:2.0:1787384700.798213:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384700.798215:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091e00/0x7ef423838fba410d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc5b19d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.798221:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2091e00/0x7ef423838fba410d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc5b19d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384700.798350:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+39:15718:x1874208182380160:12345-192.168.203.45@tcp:36:lhsmtool_posix.0 Request processed in 884us (1095us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787384700.798368:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 61 00000100:00100000:3.0:1787384700.809520:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384700.809611:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182380288 00000100:00100000:0.0:1787384700.809621:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182380288 00000100:00100000:0.0:1787384700.809682:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 62 00000100:00100000:0.0:1787384700.809692:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+39:15718:x1874208182380288:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787384700.809710:0:18681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384700.809730:0:18681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04e00/0x7ef423838fba4114 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3c8e expref: -99 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384700.809812:0:18681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05c00/0x7ef423838fba411b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384700.809826:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05c00/0x7ef423838fba411b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384700.809838:0:18681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05c00/0x7ef423838fba411b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384700.810106:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04e00/0x7ef423838fba4114 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c8e expref: 41 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384700.810123:0:18681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05c00/0x7ef423838fba411b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c8e expref: 40 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384700.810137:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98f7c3a9d000) 00010000:00010000:0.0:1787384700.810140:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787384700.810144:0:18681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3b05c00, rc 0) 00000100:00100000:0.0:1787384700.810195:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+40:15718:x1874208182380288:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 505us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384700.810203:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 62 00000100:00100000:3.0:1787384700.822377:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384700.822469:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182380544 00000100:00100000:0.0:1787384700.822477:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182380544 00000100:00100000:0.0:1787384700.822538:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 63 00000100:00100000:0.0:1787384700.822548:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+40:15718:x1874208182380544:12345-192.168.203.45@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787384700.822622:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04e00/0x7ef423838fba4122 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384700.822639:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04e00/0x7ef423838fba4122 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384700.822650:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04e00/0x7ef423838fba4122 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787384700.822871:0:17150:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1787384700.822882:0:17150:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 595903102450ns, next at 596903100252ns, rc = 0 00000004:00010000:0.0:1787384700.822952:0:17150:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000039cac425 reply state 00000000db4d5647 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04e00/0x7ef423838fba4122 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384700.822966:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04e00/0x7ef423838fba4122 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384700.823169:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98f7c3a9d000) 00010000:00010000:0.0:1787384700.823178:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787384700.823182:0:17150:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787384700.823330:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+42:15718:x1874208182380544:12345-192.168.203.45@tcp:36:lhsmtool_posix.0 Request processed in 782us (960us total) trans 8589934621 rc 0/0 00000100:00100000:0.0:1787384700.823338:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 63 00000100:00100000:0.0:1787384700.828634:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384700.830228:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182380672 00000100:00100000:3.0:1787384700.830241:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182380672 00000100:00100000:3.0:1787384700.830314:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 64 00000100:00100000:3.0:1787384700.830324:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+42:15718:x1874208182380672:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787384700.830347:0:18681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384700.830367:0:18681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba4129 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3c95 expref: -99 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384700.830424:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba4129 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c95 expref: 43 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384700.830441:0:18681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba4129 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c95 expref: 43 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384700.830461:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98f7c3a9d000) 00010000:00010000:3.0:1787384700.830477:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787384700.830481:0:18681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cc600, rc 0) 00000100:00100000:3.0:1787384700.830553:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+43:15718:x1874208182380672:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 230us (1927us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384700.830561:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 64 00000100:00100000:1.0:1787384700.837342:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384700.840473:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182380800 00000100:00100000:0.0:1787384700.840489:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182380800 00000100:00100000:0.0:1787384700.840569:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 23 00000100:00100000:0.0:1787384700.840580:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4acdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+5:2415:x1874208182380800:12345-192.168.203.45@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787384700.840835:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4acdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+6:2415:x1874208182380800:12345-192.168.203.45@tcp:2:lhsmtool_posix.0 Request processed in 247us (3491us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1787384700.840849:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 23 00000100:00100000:0.0:1787384700.851611:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384700.855110:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182381056 00000100:00100000:3.0:1787384700.855126:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182381056 00000100:00100000:0.0:1787384700.855279:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 11 00000100:00100000:0.0:1787384700.855293:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c422e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+43:15718:x1874208182381056:12345-192.168.203.45@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787384700.855540:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c422e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+44:15718:x1874208182381056:12345-192.168.203.45@tcp:35:lhsmtool_posix.0 Request processed in 249us (3935us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1787384700.855549:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 11 00000100:00100000:2.0:1787384700.862912:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384700.863202:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182381312 00000100:00100000:0.0:1787384700.863212:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182381312 00000100:00100000:0.0:1787384700.863272:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 65 00000100:00100000:0.0:1787384700.863282:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+44:15718:x1874208182381312:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787384700.863391:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+44:15718:x1874208182381312:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 Request processed in 110us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384700.863415:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 65 00000100:00100000:1.0:1787384700.866448:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384700.866527:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182381440 00000100:00100000:3.0:1787384700.866537:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182381440 00000100:00100000:3.0:1787384700.866591:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 66 00000100:00100000:3.0:1787384700.866601:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f4acd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+44:15718:x1874208182381440:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787384700.866619:0:18681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384700.866639:0:18681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd000/0x7ef423838fba4130 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3c9c expref: -99 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384700.866701:0:18681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc400/0x7ef423838fba4137 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384700.866715:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc400/0x7ef423838fba4137 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384700.866726:0:18681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc400/0x7ef423838fba4137 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384700.866771:0:18681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787384700.868043:0:18681:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc400/0x7ef423838fba4137 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384700.868080:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cd000/0x7ef423838fba4130 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c9c expref: 46 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384700.868118:0:18681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc400/0x7ef423838fba4137 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c9c expref: 45 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384700.868127:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98f7c3a9d000) 00010000:00010000:3.0:1787384700.868131:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787384700.868134:0:18681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cc400, rc 0) 00000100:00100000:2.0:1787384700.885684:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f4acd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+45:15718:x1874208182381440:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 19072us (19234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384700.885697:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 66 00000100:00100000:3.0:1787384700.888594:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384700.888692:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182381568 00000100:00100000:1.0:1787384700.888702:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182381568 00000100:00100000:1.0:1787384700.888821:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 24 00000100:00100000:1.0:1787384700.888831:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+6:2416:x1874208182381568:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787384700.888856:0:18657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384700.888879:0:18657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007948e30b/0x7ef423838fba413e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3ca3 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787384700.888903:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a89537c, blocks: 0x0 00010000:00010000:1.0:1787384700.888922:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=595s v=(0 0) 00010000:00010000:1.0:1787384700.888926:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384700.888936:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007948e30b/0x7ef423838fba413e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3ca3 expref: 7 pid: 18657 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.888954:0:18657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007948e30b/0x7ef423838fba413e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3ca3 expref: 7 pid: 18657 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.888976:0:18657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965be00, rc 0) 00000100:00100000:1.0:1787384700.889038:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+7:2416:x1874208182381568:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 209us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384700.889044:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 24 00000100:00100000:0.0:1787384700.902506:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384700.902831:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182381824 00000100:00100000:2.0:1787384700.902848:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182381824 00000100:00100000:2.0:1787384700.902907:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 67 00000100:00100000:2.0:1787384700.902916:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+45:15718:x1874208182381824:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787384700.903036:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+45:15718:x1874208182381824:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 Request processed in 120us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384700.903044:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 67 00000100:00100000:0.0:1787384700.913705:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384700.914110:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182381952 00000100:00100000:1.0:1787384700.914120:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182381952 00000100:00100000:1.0:1787384700.914185:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 68 00000100:00100000:1.0:1787384700.914263:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee146a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+45:15718:x1874208182381952:12345-192.168.203.45@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787384700.933390:0:17130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:0.0:1787384700.933407:0:17130:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1787384700.933458:0:17130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:1.0:1787384700.934339:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba3f54 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.934352:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba3f54 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.934361:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba3f54 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.934367:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b05a00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384700.934372:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba3f54 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.934380:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba3f54 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.934400:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98f7c3a9d200) 00010000:00010000:1.0:1787384700.934404:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1787384700.934408:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba3f54 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.934415:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05a00/0x7ef423838fba3f54 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384700.934439:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787384700.934455:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c20d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203427712:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787384700.934524:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384700.934672:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee146a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+20:15718:x1874208182381952:12345-192.168.203.45@tcp:44:lhsmtool_posix.0 Request processed in 20476us (20974us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384700.934682:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 68 00010000:00010000:2.0:1787384700.935317:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba3f00 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935327:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba3f00 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935333:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba3f00 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935338:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b04c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384700.935341:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba3f00 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935347:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba3f00 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935367:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98f7c3a9dc00) 00010000:00010000:2.0:1787384700.935370:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384700.935373:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba3f00 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935380:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba3f00 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935398:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05e00/0x7ef423838fba3f07 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935403:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05e00/0x7ef423838fba3f07 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935409:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05e00/0x7ef423838fba3f07 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935413:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b05e00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384700.935416:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05e00/0x7ef423838fba3f07 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935421:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05e00/0x7ef423838fba3f07 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935429:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98f7c3a9d200) 00010000:00010000:2.0:1787384700.935431:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384700.935434:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05e00/0x7ef423838fba3f07 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935440:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05e00/0x7ef423838fba3f07 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935462:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba3faf lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935468:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba3faf lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935473:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba3faf lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935479:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965a200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384700.935482:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba3faf lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935487:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba3faf lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935495:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98f8fd1d3d00) 00010000:00010000:2.0:1787384700.935498:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384700.935500:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba3faf lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935506:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a200/0x7ef423838fba3faf lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935521:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba4034 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935527:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba4034 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935532:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba4034 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935542:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2090400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384700.935546:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba4034 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935551:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba4034 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935559:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:2.0:1787384700.935561:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384700.935564:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba4034 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935569:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba4034 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384700.935576:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203427712 00010000:00010000:2.0:1787384700.935580:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090200/0x7ef423838fba4057 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384700.935584:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203427712 00010000:00010000:2.0:1787384700.935585:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090200/0x7ef423838fba4057 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935589:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090200/0x7ef423838fba4057 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935594:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2090200 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384700.935596:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090200/0x7ef423838fba4057 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935602:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090200/0x7ef423838fba4057 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935618:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:2.0:1787384700.935620:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384700.935622:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090200/0x7ef423838fba4057 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935628:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090200/0x7ef423838fba4057 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935638:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04400/0x7ef423838fba409d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935650:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04400/0x7ef423838fba409d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935656:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04400/0x7ef423838fba409d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935660:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b04400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384700.935663:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04400/0x7ef423838fba409d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935669:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04400/0x7ef423838fba409d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935676:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:2.0:1787384700.935678:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384700.935681:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04400/0x7ef423838fba409d lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787384700.935685:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787384700.935686:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04400/0x7ef423838fba409d lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935707:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04e00/0x7ef423838fba4122 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935714:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04e00/0x7ef423838fba4122 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935720:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04e00/0x7ef423838fba4122 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935725:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b04e00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:2.0:1787384700.935728:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04e00/0x7ef423838fba4122 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935735:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04e00/0x7ef423838fba4122 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935743:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98f7c3a9d000) 00010000:00010000:2.0:1787384700.935745:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787384700.935748:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04e00/0x7ef423838fba4122 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.935753:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04e00/0x7ef423838fba4122 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384700.935893:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787384700.935904:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203427712:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787384700.936036:0:18656:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787384700.936040:0:18656:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1787384700.936042:0:18656:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787384700.936044:0:18656:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787384700 -> 1787384700 00002000:00010000:3.0:1787384700.936046:0:18656:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1787384700.936110:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1874208203427712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 209us (1586us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787384700.936118:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000004:00080000:2.0:1787384700.936186:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98f7c20d3100/2, rc 0, transno 8589934596 00000100:00100000:2.0:1787384700.936202:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c20d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203427712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787384700.945907:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384700.945990:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182382080 00000100:00100000:1.0:1787384700.946000:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182382080 00000100:00100000:1.0:1787384700.946056:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 26 00000100:00100000:1.0:1787384700.946065:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+7:2416:x1874208182382080:12345-192.168.203.45@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787384700.946169:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+7:2416:x1874208182382080:12345-192.168.203.45@tcp:16:lhsmtool_posix.0 Request processed in 104us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384700.946177:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 26 00000100:00100000:1.0:1787384700.951437:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384700.951511:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182382336 00000100:00100000:2.0:1787384700.951521:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182382336 00000100:00100000:2.0:1787384700.951585:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 69 00000100:00100000:2.0:1787384700.951595:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0fd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+14:15718:x1874208182382336:12345-192.168.203.45@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787384700.951672:0:17150:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384700.951698:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc400/0x7ef423838fba4137 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c9c expref: 14 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.951715:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98f7c3a9d000) 00010000:00010000:2.0:1787384700.951719:0:17150:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787384700.951748:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090e00/0x7ef423838fba4145 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.951760:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090e00/0x7ef423838fba4145 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.951770:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090e00/0x7ef423838fba4145 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787384700.951951:0:17150:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000351120fb reply state 00000000aa4bc057 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090e00/0x7ef423838fba4145 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.951964:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090e00/0x7ef423838fba4145 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.951971:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98f7c3a9d000) 00010000:00010000:2.0:1787384700.951974:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787384700.951976:0:17150:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787384700.952068:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0fd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+15:15718:x1874208182382336:12345-192.168.203.45@tcp:36:lhsmtool_posix.0 Request processed in 474us (638us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1787384700.952076:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 69 00000100:00100000:0.0:1787384700.955083:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384700.962071:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182382464 00000100:00100000:1.0:1787384700.962084:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182382464 00000100:00100000:1.0:1787384700.962164:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 27 00000100:00100000:1.0:1787384700.962174:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+7:15718:x1874208182382464:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787384700.962191:0:18658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384700.962209:0:18658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c307a2c8/0x7ef423838fba414c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3caa expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.962240:0:18658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007948e30b/0x7ef423838fba413e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3ca3 expref: 8 pid: 18657 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.962249:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787384700.962253:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384700.962258:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c307a2c8/0x7ef423838fba414c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3caa expref: 8 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.962292:0:18658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007948e30b/0x7ef423838fba413e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3ca3 expref: 8 pid: 18657 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384700.962326:0:18658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007948e30b/0x7ef423838fba413e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3ca3 expref: 8 pid: 18657 timeout: 696 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384700.962342:0:18658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0fd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:18658:1874208203427840:192.168.203.45@tcp:104: 00000100:00100000:1.0:1787384700.962425:0:18658:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f7c356b840 going to sleep for 11 seconds 00000100:00100000:0.0:1787384700.967411:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384700.967886:0:18658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0fd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:18658:1874208203427840:192.168.203.45@tcp:104: 00010000:00010000:2.0:1787384700.967917:0:18658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c307a2c8/0x7ef423838fba414c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3caa expref: 8 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384700.967954:0:18658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8d965ba00, rc 0) 00000100:00100000:2.0:1787384700.968002:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+8:15718:x1874208182382464:12345-192.168.203.45@tcp:101:lhsmtool_posix.0 Request processed in 5829us (12928us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384700.968011:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 27 00000100:00100000:3.0:1787384700.968998:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182382592 00000100:00100000:3.0:1787384700.969007:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182382592 00010000:00010000:3.0:1787384700.969039:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007948e30b/0x7ef423838fba413e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3ca3 expref: 8 pid: 18657 timeout: 696 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384700.969075:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 20 00000100:00100000:3.0:1787384700.969083:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee145500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+8:2415:x1874208182382592:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384700.969111:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384700.969131:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007948e30b/0x7ef423838fba413e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3ca3 expref: 8 pid: 18657 timeout: 696 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384700.969145:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007948e30b/0x7ef423838fba413e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3ca3 expref: 8 pid: 18657 timeout: 696 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384700.969168:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007948e30b/0x7ef423838fba413e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3ca3 expref: 8 pid: 18657 timeout: 696 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384700.969183:0:17137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384700.969187:0:17137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384700.969193:0:17137:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c307a2c8/0x7ef423838fba414c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3caa expref: 7 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384700.969203:0:17137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c307a2c8/0x7ef423838fba414c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3caa expref: 7 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384700.969234:0:17137:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c307a2c8/0x7ef423838fba414c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3caa expref: 7 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384700.969249:0:17137:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c20d2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:17137:1874208203427968:192.168.203.45@tcp:105: 00000100:00100000:3.0:1787384700.969320:0:17137:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fc1dd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384700.984456:0:17137:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c20d2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:17137:1874208203427968:192.168.203.45@tcp:105: 00010000:00010000:3.0:1787384700.984486:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384700.984560:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee145500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+7:2415:x1874208182382592:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 15476us (17155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384700.984570:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 20 00000100:00100000:0.0:1787384700.989165:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384700.989300:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182382720 00000100:00100000:1.0:1787384700.989310:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182382720 00000100:00100000:1.0:1787384700.989368:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 28 00000100:00100000:1.0:1787384700.989377:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+7:2415:x1874208182382720:12345-192.168.203.45@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787384700.989530:0:18657:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787384700.989534:0:18657:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1787384699 00002000:00010000:1.0:1787384700.989536:0:18657:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1787384697 00002000:00010000:1.0:1787384700.989538:0:18657:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787384700 -> 1787384699 00002000:00010000:1.0:1787384700.989540:0:18657:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787384700.989600:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+8:2415:x1874208182382720:12345-192.168.203.45@tcp:2:lhsmtool_posix.0 Request processed in 223us (442us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787384700.989608:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 28 00000100:00100000:0.0:1787384700.992546:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384700.992701:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182382848 00000100:00100000:3.0:1787384700.992710:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182382848 00000100:00100000:0.0:1787384700.994047:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 29 00000100:00100000:0.0:1787384700.994064:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+8:2416:x1874208182382848:12345-192.168.203.45@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787384700.994116:0:18656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b8deedf4/0x7ef423838fba4153 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384700.994139:0:18656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c307a2c8/0x7ef423838fba414c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3caa expref: 8 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384700.994149:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384700.994153:0:18656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787384700.994158:0:18656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8deedf4/0x7ef423838fba4153 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384700.994192:0:18656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c307a2c8/0x7ef423838fba414c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3caa expref: 8 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384700.994223:0:18656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c307a2c8/0x7ef423838fba414c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3caa expref: 8 pid: 18658 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384700.994239:0:18656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee146300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18656:1874208203428096:192.168.203.45@tcp:104: 00000100:00100000:0.0:1787384700.994323:0:18656:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d82933c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384701.000681:0:18656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee146300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18656:1874208203428096:192.168.203.45@tcp:104: 00010000:00010000:1.0:1787384701.000714:0:18656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b8deedf4/0x7ef423838fba4153 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384701.001199:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384701.001265:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182382976 00000100:00100000:1.0:1787384701.001272:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182382976 00010000:00010000:1.0:1787384701.001332:0:17136:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c307a2c8/0x7ef423838fba414c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3caa expref: 9 pid: 18658 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384701.001367:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 21 00000100:00100000:1.0:1787384701.001376:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee144700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+9:2415:x1874208182382976:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384701.001389:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384701.001407:0:17136:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c307a2c8/0x7ef423838fba414c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3caa expref: 9 pid: 18658 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.001419:0:17136:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c307a2c8/0x7ef423838fba414c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3caa expref: 9 pid: 18658 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.001442:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c307a2c8/0x7ef423838fba414c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3caa expref: 9 pid: 18658 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.001457:0:17136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787384701.001461:0:17136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787384701.001466:0:17136:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b8deedf4/0x7ef423838fba4153 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.001475:0:17136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8deedf4/0x7ef423838fba4153 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.001497:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384701.001545:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee144700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+8:2415:x1874208182382976:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 170us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384701.001560:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 21 00010000:00010000:1.0:1787384701.001583:0:18656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b8deedf4/0x7ef423838fba4153 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.001590:0:18656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8deedf4/0x7ef423838fba4153 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.001608:0:18656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b8deedf4/0x7ef423838fba4153 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.001616:0:18656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8deedf4/0x7ef423838fba4153 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.001623:0:18656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8deedf4/0x7ef423838fba4153 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.001629:0:18656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b05e00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384701.001633:0:18656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8deedf4/0x7ef423838fba4153 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.001642:0:18656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8deedf4/0x7ef423838fba4153 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.001653:0:18656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8deedf4/0x7ef423838fba4153 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.001669:0:18656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8deedf4/0x7ef423838fba4153 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384701.001715:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+7:2416:x1874208182382848:12345-192.168.203.45@tcp:1:lhsmtool_posix.0 Request processed in 7657us (9177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384701.001724:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 29 00000100:00080000:0.0:1787384701.001815:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787384701.007905:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384701.008058:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182383232 00000100:00100000:2.0:1787384701.008067:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182383232 00000100:00100000:2.0:1787384701.008144:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 70 00000100:00100000:2.0:1787384701.008154:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee147100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+15:15718:x1874208182383232:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787384701.008232:0:18681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba415a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384701.008250:0:18681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba402d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c48 expref: 15 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384701.008260:0:18681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba415a lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384701.008294:0:18681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba402d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c48 expref: 15 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384701.008308:0:18681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba402d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c48 expref: 15 pid: 17151 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384701.008322:0:18681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e07100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18681:1874208203428224:192.168.203.45@tcp:104: 00000100:00100000:2.0:1787384701.008408:0:18681:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8fd1ebd80 going to sleep for 11 seconds 00000100:00080000:0.0:1787384701.010103:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384701.013052:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384701.013206:0:19489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182383360 00000100:00100000:1.0:1787384701.013214:0:19489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182383360 00010000:00010000:1.0:1787384701.013253:0:19489:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba402d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c48 expref: 16 pid: 17151 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384701.013297:0:19489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 22 00000100:00100000:1.0:1787384701.013307:0:19489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+16:2416:x1874208182383360:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384701.013321:0:19489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384701.013327:0:19489:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba402d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c48 expref: 16 pid: 17151 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.013339:0:19489:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba402d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c48 expref: 16 pid: 17151 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.013360:0:19489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:1.0:1787384701.013366:0:19489:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090600/0x7ef423838fba40c0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c79 expref: 16 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.013375:0:19489:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba415a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.013397:0:19489:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba415a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.013404:0:19489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba415a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.013422:0:19489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384701.013480:0:19489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+16:2416:x1874208182383360:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 173us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384701.013488:0:19489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 22 00010000:00010000:0.0:1787384701.013641:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba402d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c48 expref: 15 pid: 17151 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384701.013659:0:18681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e07100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18681:1874208203428224:192.168.203.45@tcp:104: 00010000:00010000:0.0:1787384701.013682:0:18681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba415a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.013690:0:18681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba415a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.013695:0:18681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba415a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.013940:0:18681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba4161 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.013953:0:18681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba4129 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c95 expref: 15 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.013971:0:18681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba4161 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.013999:0:18681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba4129 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c95 expref: 15 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.014012:0:18681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba4129 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c95 expref: 15 pid: 18681 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384701.014025:0:18681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee144000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18681:1874208203428352:192.168.203.45@tcp:104: 00000100:00100000:0.0:1787384701.014076:0:18681:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d82933c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384701.021317:0:18681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee144000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18681:1874208203428352:192.168.203.45@tcp:104: 00010000:00010000:0.0:1787384701.021347:0:18681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba4161 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384701.025469:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384701.025570:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182383488 00000100:00100000:1.0:1787384701.025580:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182383488 00010000:00010000:1.0:1787384701.025622:0:17136:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba4129 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c95 expref: 16 pid: 18681 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384701.025672:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 23 00000100:00100000:1.0:1787384701.025681:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8d8523450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+16:2416:x1874208182383488:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384701.025696:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384701.025702:0:17136:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba4129 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c95 expref: 16 pid: 18681 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.025718:0:17136:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba4129 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c95 expref: 16 pid: 18681 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.025742:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8f58cc600/0x7ef423838fba4129 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c95 expref: 16 pid: 18681 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.025822:0:17136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98f7c3a9d000) 00010000:00010000:1.0:1787384701.025828:0:17136:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba4161 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.025838:0:17136:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba4161 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.025853:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba4161 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.025875:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384701.025928:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8d8523450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+15:2416:x1874208182383488:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 247us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384701.025936:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 23 00010000:00010000:0.0:1787384701.026037:0:18681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba4161 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.026046:0:18681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba4161 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787384701.026161:0:18681:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1787384701.026271:0:18681:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:0.0:1787384701.026308:0:18681:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:0.0:1787384701.026384:0:18681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee144000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18681:1874208203428480:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787384701.026429:0:18681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384701.026466:0:18681:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8d8293a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787384701.026629:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203428480 00000100:00100000:1.0:1787384701.026635:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203428480 00000100:00100000:1.0:1787384701.026674:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787384701.026682:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18681:x1874208203428480:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787384701.026751:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18681:x1874208203428480:12345-0@lo:1000:mdt00_003.0 Request processed in 70us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384701.026758:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787384701.026909:0:18681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee144000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18681:1874208203428480:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1787384701.027064:0:18681:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:0.0:1787384701.027117:0:18681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee144000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18681:1874208203428608:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787384701.027155:0:18681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384701.027178:0:18681:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f57b43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384701.027371:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203428608 00000100:00100000:1.0:1787384701.027376:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203428608 00000100:00100000:1.0:1787384701.027409:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787384701.027416:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18681:x1874208203428608:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787384701.027510:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:18681:x1874208203428608:12345-0@lo:1000:mdt00_003.0 Request processed in 94us (353us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1787384701.027525:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787384701.028534:0:18681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee144000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18681:1874208203428608:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1787384701.028575:0:18681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba4161 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.028585:0:18681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba4161 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.028591:0:18681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba4161 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.028596:0:18681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b04c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384701.028601:0:18681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba4161 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.028607:0:18681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba4161 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.028621:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98f7c3a9d000) 00010000:00010000:0.0:1787384701.028624:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787384701.028628:0:18681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba4161 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.028634:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba4161 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.028662:0:18681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba40b9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.028677:0:18681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba40b9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.028683:0:18681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba40b9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.028687:0:18681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b05400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384701.028690:0:18681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba40b9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.028695:0:18681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba40b9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.028704:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:0.0:1787384701.028706:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787384701.028713:0:18681:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090600/0x7ef423838fba40c0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c79 expref: 18 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.028723:0:18681:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090600/0x7ef423838fba40c0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c79 expref: 18 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.028731:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090600/0x7ef423838fba40c0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c79 expref: 18 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.028818:0:18681:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090600/0x7ef423838fba40c0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3c79 expref: 18 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384701.028832:0:18681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee145c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18681:1874208203428736:192.168.203.45@tcp:105: 00000100:00100000:0.0:1787384701.028916:0:18681:0:(client.c:2702:ptlrpc_set_wait()) set ffff98f8f57b4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787384701.041915:0:18681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee145c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18681:1874208203428736:192.168.203.45@tcp:105: 00010000:00010000:0.0:1787384701.041946:0:18681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba40b9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.041957:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b05400/0x7ef423838fba40b9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.041990:0:18681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba4168 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.042004:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba4168 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.042015:0:18681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba4168 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.042024:0:18681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba4168 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.042031:0:18681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba4168 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.042037:0:18681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba4168 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.042043:0:18681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b04c00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384701.042047:0:18681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba4168 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.042055:0:18681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba4168 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.042086:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:0.0:1787384701.042089:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384701.042093:0:18681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba4168 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.042099:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba4168 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.042109:0:18681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba415a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.042115:0:18681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba415a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.042121:0:18681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba415a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.042126:0:18681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c2090400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:0.0:1787384701.042129:0:18681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba415a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.042135:0:18681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba415a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.042143:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:0.0:1787384701.042145:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787384701.042148:0:18681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba415a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.042154:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090400/0x7ef423838fba415a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384701.042333:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee147100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+18:15718:x1874208182383232:12345-192.168.203.45@tcp:57:lhsmtool_posix.0 Request processed in 34179us (34436us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1787384701.042345:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 70 00000020:00080000:0.0:1787384701.042351:0:18681:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787384701.042550:0:17184:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787384701.042555:0:17184:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787384701.042570:0:17184:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787384701.042577:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787384701.054421:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384701.054555:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182383872 00000100:00100000:0.0:1787384701.054565:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182383872 00000100:00100000:0.0:1787384701.054618:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 12 00000100:00100000:0.0:1787384701.054628:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+18:15717:x1874208182383872:12345-192.168.203.45@tcp:49:bash.0 00000100:00100000:0.0:1787384701.054771:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+18:15717:x1874208182383872:12345-192.168.203.45@tcp:49:bash.0 Request processed in 144us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384701.054814:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 12 00000100:00100000:2.0:1787384701.056265:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384701.056386:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182383744 00000100:00100000:0.0:1787384701.056393:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182383744 00000100:00100000:0.0:1787384701.056440:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 13 00000100:00100000:0.0:1787384701.056449:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+18:15718:x1874208182383744:12345-192.168.203.45@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787384701.056691:0:17153:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787384701.056724:0:17153:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:0.0:1787384701.056773:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba416f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.056812:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba416f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.056835:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba416f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.056852:0:17153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba416f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.056876:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba416f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.056882:0:17153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba416f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.056904:0:17153:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787384701.056986:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+20:15718:x1874208182383744:12345-192.168.203.45@tcp:35:lhsmtool_posix.0 Request processed in 536us (725us total) trans 8589934630 rc 0/0 00000100:00100000:0.0:1787384701.056993:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 13 00000020:00080000:0.0:1787384701.056998:0:17153:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787384701.057126:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384701.057133:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba416f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.057141:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f7c3b04c00 already unused, calling callback (ffffffffc0cbde90) 00010000:00010000:1.0:1787384701.057146:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba416f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.057154:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba416f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.057167:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98f7c3a9d000) 00010000:00010000:1.0:1787384701.057170:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787384701.057174:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba416f lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.057180:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04c00/0x7ef423838fba416f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.057193:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384701.057195:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384701.057196:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384701.057575:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384701.057688:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182384000 00000100:00100000:3.0:1787384701.057694:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182384000 00000100:00100000:3.0:1787384701.057742:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 30 00000100:00100000:3.0:1787384701.057751:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+7:15717:x1874208182384000:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:3.0:1787384701.057762:0:18657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384701.057800:0:18657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae0da09f/0x7ef423838fba4176 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3cb1 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787384701.057833:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a89537b, atime: 0x6a895379, ctime: 0x6a89537b, blocks: 0x0 00010000:00010000:3.0:1787384701.057857:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=596s v=(0 0) 00010000:00010000:3.0:1787384701.057870:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384701.057880:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae0da09f/0x7ef423838fba4176 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3cb1 expref: 8 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384701.057894:0:18657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ae0da09f/0x7ef423838fba4176 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3cb1 expref: 8 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384701.057904:0:18657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f8f58cd000, rc 0) 00000100:00100000:3.0:1787384701.058146:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+8:15717:x1874208182384000:12345-192.168.203.45@tcp:101:bash.0 Request processed in 396us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384701.058153:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 30 00000100:00100000:2.0:1787384701.063098:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384701.063186:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182384128 00000100:00100000:0.0:1787384701.063196:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182384128 00000100:00100000:0.0:1787384701.063259:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 71 00000100:00100000:0.0:1787384701.063269:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+20:15717:x1874208182384128:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:0.0:1787384701.063291:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384701.063309:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba417d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3cb8 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.063340:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04800/0x7ef423838fba4184 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.063354:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04800/0x7ef423838fba4184 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.063365:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04800/0x7ef423838fba4184 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.063474:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04200/0x7ef423838fba417d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3cb8 expref: 22 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.063498:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c3b04800/0x7ef423838fba4184 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3cb8 expref: 21 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384701.063507:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:0.0:1787384701.063510:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787384701.063513:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c3b04800, rc 0) 00000100:00100000:0.0:1787384701.063574:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+21:15717:x1874208182384128:12345-192.168.203.45@tcp:101:bash.0 Request processed in 306us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384701.063582:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 71 00000100:00100000:0.0:1787384701.071086:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384701.071387:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182384384 00000100:00100000:3.0:1787384701.071397:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182384384 00000100:00100000:3.0:1787384701.071453:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 14 00000100:00100000:3.0:1787384701.071463:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee145c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+21:15717:x1874208182384384:12345-192.168.203.45@tcp:35:bash.0 00000001:00080000:3.0:1787384701.071679:0:17153:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:3.0:1787384701.071770:0:17153:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:3.0:1787384701.073982:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee145c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+24:15717:x1874208182384384:12345-192.168.203.45@tcp:35:bash.0 Request processed in 2510us (2895us total) trans 8589934633 rc 0/0 00000100:00100000:3.0:1787384701.073996:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 14 00000020:00080000:3.0:1787384701.074004:0:17153:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787384701.236406:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384701.236514:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182384640 00000100:00100000:2.0:1787384701.236524:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182384640 00000100:00100000:2.0:1787384701.236587:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 72 00000100:00100000:2.0:1787384701.236597:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+24:15728:x1874208182384640:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:2.0:1787384701.236622:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384701.236642:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba418b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3cc418d70ce3cbf expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384701.236753:0:17152:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787384701.236903:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba418b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3cbf expref: 26 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384701.236917:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98f7c3a9d500) 00010000:00010000:2.0:1787384701.236920:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787384701.236925:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f7c2090c00/0x7ef423838fba418b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0xc3cc418d70ce3cbf expref: 26 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384701.236939:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98f7c2090c00, rc 0) 00000100:00100000:2.0:1787384701.236996:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+25:15728:x1874208182384640:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 400us (598us total) trans 8589934634 rc 301/301 00000100:00100000:2.0:1787384701.237003:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 72 00000100:00100000:2.0:1787384701.242140:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384701.242239:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182384768 00000100:00100000:1.0:1787384701.242249:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182384768 00000100:00100000:1.0:1787384701.242305:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 73 00000100:00100000:1.0:1787384701.242315:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+25:15728:x1874208182384768:12345-192.168.203.45@tcp:34:lfs.0 00010000:00010000:1.0:1787384701.242387:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba4199 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.242412:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba4199 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.242425:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba4199 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.242440:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba41a0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.242448:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba41a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.242454:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba41a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.242518:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba41a7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.242528:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba41a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.242535:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba41a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787384701.242576:0:17151:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba41a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.242588:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba4199 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.242595:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba4199 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.242612:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba4199 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.242618:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965ae00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384701.242623:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba4199 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.242630:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba4199 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.242642:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98f7c3a9d200) 00010000:00010000:1.0:1787384701.242645:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384701.242650:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba4199 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.242657:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965ae00/0x7ef423838fba4199 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.242667:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba41a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.242675:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba41a0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.242680:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba41a0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.242686:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965a400 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384701.242689:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba41a0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.242704:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba41a0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.242713:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98f8fd1d3100) 00010000:00010000:1.0:1787384701.242716:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384701.242719:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba41a0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.242725:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965a400/0x7ef423838fba41a0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.242740:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba41a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.242747:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba41a7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.242752:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba41a7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.242770:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98f8d965bc00 already unused, calling callback (ffffffffc18c74f0) 00010000:00010000:1.0:1787384701.242773:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba41a7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.242820:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba41a7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.242828:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98f8fd1d3200) 00010000:00010000:1.0:1787384701.242830:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384701.242833:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba41a7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384701.242859:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98f8d965bc00/0x7ef423838fba41a7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384701.242927:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+25:15728:x1874208182384768:12345-192.168.203.45@tcp:34:lfs.0 Request processed in 612us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384701.242935:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 73 00000100:00100000:1.0:1787384701.250114:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787384701.250214:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182385024 00000100:00100000:0.0:1787384701.250224:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182385024 00000100:00100000:0.0:1787384701.250287:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 15 00000100:00100000:0.0:1787384701.250467:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0fd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+25:15728:x1874208182385024:12345-192.168.203.45@tcp:35:lfs.0 00000100:00100000:0.0:1787384701.250674:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0fd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8741dc33-c445-439b-a6e3-d8ded553bb00+26:15728:x1874208182385024:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 374us (567us total) trans 8589934635 rc 0/0 00000100:00100000:0.0:1787384701.250682:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 15 00010000:00010000:2.0:1787384701.303177:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384701.368451:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787384701.368475:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee147800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203428864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787384701.368543:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384701.369960:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203428864 00000100:00100000:0.0:1787384701.369980:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203428864 00000100:00100000:0.0:1787384701.370050:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787384701.370060:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203428864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787384701.370090:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787384701.370162:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874208203428864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (1617us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384701.370171:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787384701.370242:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee147800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203428864:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787384701.371291:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787384702.327130:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384702.391649:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203428992:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787384702.391718:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384702.391759:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203429504:0@lo:400:kworker.0 00000100:00100000:0.0:1787384702.391799:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384702.391817:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203430016:0@lo:400:kworker.0 00000100:00100000:0.0:1787384702.391848:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384702.391874:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57899b24-a33b-4177-9883-79b5fe35053f:3651:1874208203429120:0@lo:400:kworker.0 00000100:00100000:2.0:1787384702.391911:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384702.391948:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f7e6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203429632:0@lo:400:kworker.0 00000100:00100000:2.0:1787384702.391973:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384702.391991:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203430144:0@lo:400:kworker.0 00000100:00100000:2.0:1787384702.392010:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384702.392025:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd75b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203430656:0@lo:400:kworker.0 00000100:00100000:2.0:1787384702.392046:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384702.392063:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787384702.392069:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203429248:0@lo:400:kworker.0 00000100:00100000:2.0:1787384702.392115:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384702.392180:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203429760:0@lo:400:kworker.0 00000100:00100000:2.0:1787384702.392204:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384702.392221:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd758380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203430272:0@lo:400:kworker.0 00000100:00100000:1.0:1787384702.392237:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203429376:0@lo:400:kworker.0 00000100:00100000:2.0:1787384702.392241:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384702.392271:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203428992 00000100:00100000:1.0:1787384702.392271:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203429248 00000100:00100000:2.0:1787384702.392278:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203428992 00000100:00100000:1.0:1787384702.392278:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203429248 00000100:00100000:1.0:1787384702.392309:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203429760 00000100:00100000:1.0:1787384702.392312:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203429760 00000100:00100000:2.0:1787384702.392315:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787384702.392323:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203428992:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787384702.392325:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787384702.392329:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd75b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203429248:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1787384702.392344:0:18660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787384702.392371:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203428992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384702.392372:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd75b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203429248:12345-0@lo:400:kworker.0 Request processed in 42us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384702.392379:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787384702.392379:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787384702.392394:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787384702.392400:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203429760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384702.392418:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203429248:0@lo:400:kworker.0 00000100:00100000:1.0:1787384702.392424:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874208203429760:12345-0@lo:400:kworker.0 Request processed in 25us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384702.392430:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787384702.392436:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874208203429760:0@lo:400:kworker.0 00000100:00080000:1.0:1787384702.392452:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787384702.392459:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203429504 00000100:00100000:1.0:1787384702.392461:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203429632 00000100:00100000:2.0:1787384702.392462:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203429504 00000100:00100000:1.0:1787384702.392463:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203429632 00000100:00100000:1.0:1787384702.392479:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203430144 00000100:00100000:1.0:1787384702.392481:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203430144 00000100:00100000:1.0:1787384702.392489:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203430656 00000100:00100000:2.0:1787384702.392490:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787384702.392491:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203430656 00000100:00100000:2.0:1787384702.392496:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3654:x1874208203429504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384702.392501:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203430272 00000100:00100000:1.0:1787384702.392504:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203430272 00000100:00100000:1.0:1787384702.392515:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787384702.392521:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd75ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203429632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384702.392523:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3654:x1874208203429504:12345-0@lo:400:kworker.0 Request processed in 28us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384702.392528:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787384702.392546:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787384702.392559:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd75ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874208203429632:12345-0@lo:400:kworker.0 Request processed in 38us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384702.392564:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874208203429632:0@lo:400:kworker.0 00000100:00100000:1.0:1787384702.392565:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787384702.392576:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787384702.392582:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd75aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203430144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384702.392582:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874208203430656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384702.392615:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874208203430656:12345-0@lo:400:kworker.0 Request processed in 33us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384702.392621:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787384702.392642:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787384702.392648:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203430272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384702.392676:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203429120 00000100:00100000:3.0:1787384702.392680:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203429120 00000100:00100000:3.0:1787384702.392707:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787384702.392712:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874208203430528:0@lo:400:kworker.0 00000100:00100000:3.0:1787384702.392713:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+24:3651:x1874208203429120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384702.392734:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384702.392754:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203428992:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787384702.392761:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd75aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874208203430144:12345-0@lo:400:kworker.0 Request processed in 210us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384702.392768:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787384702.392771:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874208203429504:0@lo:400:kworker.0 00000100:00100000:0.0:1787384702.392803:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203430528 00000100:00100000:0.0:1787384702.392807:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203430528 00000100:00100000:0.0:1787384702.392843:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787384702.392859:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874208203430528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384702.392892:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874208203430528:12345-0@lo:400:kworker.0 Request processed in 43us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384702.392898:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787384702.392921:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874208203430528:0@lo:400:kworker.0 00000100:00100000:0.0:1787384702.392978:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203430016 00000100:00100000:0.0:1787384702.392982:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203430016 00000100:00100000:0.0:1787384702.393009:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787384702.393015:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203430016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384702.393050:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203430016:12345-0@lo:400:kworker.0 Request processed in 35us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384702.393063:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1787384702.393078:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787384702.393081:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787384702.393083:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787384702.393099:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203430016:0@lo:400:kworker.0 00000100:00100000:0.0:1787384702.393122:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384702.393142:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c3a82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203429888:0@lo:400:kworker.0 00000100:00100000:0.0:1787384702.393162:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384702.393175:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8fd75bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203430400:0@lo:400:kworker.0 00000100:00100000:0.0:1787384702.393194:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384702.393214:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203429376 00000100:00100000:0.0:1787384702.393218:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203429376 00000100:00100000:0.0:1787384702.393232:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203429888 00000100:00100000:0.0:1787384702.393235:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203429888 00000100:00100000:0.0:1787384702.393245:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787384702.393250:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd759180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203429376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384702.393282:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd759180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874208203429376:12345-0@lo:400:kworker.0 Request processed in 32us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384702.393287:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787384702.393297:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787384702.393303:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203429888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384702.393326:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874208203429888:12345-0@lo:400:kworker.0 Request processed in 24us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384702.393332:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787384702.393354:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203429376:0@lo:400:kworker.0 00000100:00100000:0.0:1787384702.393362:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874208203429888:0@lo:400:kworker.0 00000100:00100000:0.0:1787384702.393388:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203430400 00000100:00100000:0.0:1787384702.393391:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203430400 00000100:00080000:0.0:1787384702.393404:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787384702.393420:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787384702.393426:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203430400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384702.393461:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874208203430400:12345-0@lo:400:kworker.0 Request processed in 35us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384702.393467:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:0.0:1787384702.393490:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8fd75bb80 x1874208203430400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384702.393501:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd75bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874208203430400:0@lo:400:kworker.0 00000100:00100000:0.0:1787384702.393621:0:3653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee115880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203430912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384702.393646:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384702.393748:0:19944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203430912 00000100:00100000:0.0:1787384702.393753:0:19944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203430912 00000100:00100000:0.0:1787384702.393804:0:19944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787384702.393811:0:19944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee114e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3653:x1874208203430912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787384702.393841:0:19944:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787384702.393876:0:19944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee114e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3653:x1874208203430912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384702.393881:0:19944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787384702.393899:0:3652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8ee114700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203430784:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787384702.393921:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384702.393956:0:3653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee115880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874208203430912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384702.393972:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203430784 00000100:00100000:0.0:1787384702.393982:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203430784 00000100:00100000:0.0:1787384702.394003:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787384702.394009:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee115180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203430784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787384702.394018:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787384702.394046:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee115180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874208203430784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384702.394051:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787384702.394078:0:3652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8ee114700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874208203430784:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787384702.399531:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874208203430272:12345-0@lo:400:kworker.0 Request processed in 6871us (7277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384702.399547:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787384702.400091:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd758380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874208203430272:0@lo:400:kworker.0 00000100:00100000:3.0:1787384702.400151:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57899b24-a33b-4177-9883-79b5fe35053f+24:3651:x1874208203429120:12345-0@lo:400:kworker.0 Request processed in 7436us (8237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384702.400161:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787384702.409199:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f7e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57899b24-a33b-4177-9883-79b5fe35053f:3651:1874208203429120:0@lo:400:kworker.0 00000100:00100000:2.0:1787384702.409223:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c3a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874208203430144:0@lo:400:kworker.0 00010000:00080000:2.0:1787384702.409237:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff98f8fd75b100 x1874208203430656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384702.409248:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8fd75b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874208203430656:0@lo:400:kworker.0 00000100:00100000:0.0:1787384702.903108:0:3654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f7c20d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203431040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787384702.903186:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384702.903321:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203431040 00000100:00100000:2.0:1787384702.903329:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203431040 00000100:00100000:2.0:1787384702.903381:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787384702.903401:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8ee114700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203431040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787384702.903433:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1787384702.903492:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8ee114700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874208203431040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384702.903500:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787384702.903554:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff98f8f0fd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203431168:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787384702.903579:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384702.903854:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208203431168 00000100:00100000:1.0:1787384702.903860:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208203431168 00000100:00100000:1.0:1787384702.903886:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787384702.903894:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203431168:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787384702.903914:0:3654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f7c20d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874208203431040:0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787384702.903935:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787384702.904060:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874208203431168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 166us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384702.904067:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787384702.904217:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff98f8f0fd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874208203431168:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787384703.356831:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787384703.406654:0:20329:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000040:00080000:1.0:1787384703.802691:0:17904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787384704.353371:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787384704.353426:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384704.353549:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182385152 00000100:00100000:1.0:1787384704.353560:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182385152 00002000:00100000:1.0:1787384704.353630:0:18662:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff98f7c20d0380 x1874208182385152/t0(0) o4->8741dc33-c445-439b-a6e3-d8ded553bb00@192.168.203.45@tcp:735/0 lens 504/0 e 0 to 0 dl 1787384715 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1787384704.353641:0:18662:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98f7c20d0380 with x1874208182385152 ext(0->8) 00002000:00010000:1.0:1787384704.353648:0:18662:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98f7c20d0380 00000100:00100000:1.0:1787384704.353674:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 0 00000100:00100000:1.0:1787384704.353684:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+8:2414:x1874208182385152:12345-192.168.203.45@tcp:4:bash.0 00000100:00080000:2.0:1787384704.354377:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787384704.355061:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8741dc33-c445-439b-a6e3-d8ded553bb00+10:2414:x1874208182385152:12345-192.168.203.45@tcp:4:bash.0 Request processed in 1372us (1695us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1787384704.355073:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 0 00002000:00100000:1.0:1787384704.355083:0:18662:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff98f7c20d0380 x1874208182385152/t8589934599(0) o4->8741dc33-c445-439b-a6e3-d8ded553bb00@192.168.203.45@tcp:735/0 lens 504/448 e 0 to 0 dl 1787384715 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1787384704.355093:0:18662:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98f7c20d0380 with x1874208182385152 ext(0->8) 00002000:00010000:1.0:1787384704.355098:0:18662:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98f7c20d0380 00000100:00100000:0.0:1787384704.355216:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182385280 00000100:00100000:0.0:1787384704.355223:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182385280 00000100:00100000:0.0:1787384704.355269:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 31 00000100:00100000:0.0:1787384704.355278:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c20d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+10:2414:x1874208182385280:12345-192.168.203.45@tcp:16:kworker.0 00000001:00080000:0.0:1787384704.358384:0:19472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:0.0:1787384704.358404:0:19472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000100:00100000:2.0:1787384704.358582:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c20d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8741dc33-c445-439b-a6e3-d8ded553bb00+6:2414:x1874208182385280:12345-192.168.203.45@tcp:16:kworker.0 Request processed in 3298us (5148us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384704.358594:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 31 00010000:00010000:2.0:1787384704.375101:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384704.869626:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384704.869662:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384704.869686:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384704.869712:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182385664 00000100:00100000:1.0:1787384704.869720:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182385664 00000100:00100000:1.0:1787384704.869771:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182385536 00000100:00100000:1.0:1787384704.869774:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182385536 00000100:00100000:1.0:1787384704.869823:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 74 00000100:00100000:1.0:1787384704.869841:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0fd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+5:2416:x1874208182385664:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384704.869923:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0fd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+5:2416:x1874208182385664:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 83us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384704.869930:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 74 00000100:00100000:1.0:1787384704.869946:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 75 00000100:00100000:1.0:1787384704.869953:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+26:2416:x1874208182385536:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384704.869981:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+26:2416:x1874208182385536:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 28us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384704.869987:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 75 00000100:00080000:1.0:1787384704.870003:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787384704.870007:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787384704.872898:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182385408 00000100:00100000:0.0:1787384704.872976:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182385408 00000100:00100000:0.0:1787384704.873038:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 169 00000100:00100000:0.0:1787384704.873049:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8fd623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b965c805-ceb8-4757-b53e-03d6d45231a8+13:2416:x1874208182385408:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787384704.873139:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8fd623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b965c805-ceb8-4757-b53e-03d6d45231a8+13:2416:x1874208182385408:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 91us (3531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384704.873148:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 169 00000100:00100000:1.0:1787384704.881032:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384704.881064:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384704.881093:0:19186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182385792 00000100:00100000:1.0:1787384704.881102:0:19186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182385792 00000100:00100000:1.0:1787384704.881153:0:19186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182385920 00000100:00100000:1.0:1787384704.881157:0:19186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182385920 00000100:00100000:1.0:1787384704.881178:0:19186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 28 00000100:00100000:1.0:1787384704.881187:0:19186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+6:2415:x1874208182385920:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384704.881256:0:19186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+6:2415:x1874208182385920:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 69us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384704.881263:0:19186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 28 00000100:00100000:1.0:1787384704.881279:0:19186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 32 00000100:00100000:1.0:1787384704.881285:0:19186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f0fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+5:2412:x1874208182385792:12345-192.168.203.45@tcp:9:kworker.0 00000020:00000080:1.0:1787384704.881304:0:19186:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3dfd 00000100:00080000:1.0:1787384704.881331:0:19186:0:(import.c:65:import_set_state_nolock()) ffff98f7c2369000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787384704.881370:0:19186:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1787384704.881490:0:19186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f0fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8741dc33-c445-439b-a6e3-d8ded553bb00+2:2412:x1874208182385792:12345-192.168.203.45@tcp:9:kworker.0 Request processed in 203us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384704.881497:0:19186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 32 00000100:00080000:1.0:1787384704.881516:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787384704.882163:0:17902:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384704.886136:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384704.886180:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384704.886212:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787384704.886246:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182386304 00000100:00100000:2.0:1787384704.886255:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182386304 00000100:00100000:2.0:1787384704.886312:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182386432 00000100:00100000:2.0:1787384704.886315:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182386432 00000100:00100000:2.0:1787384704.886343:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 33 00000100:00100000:2.0:1787384704.886352:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+5:2412:x1874208182386304:12345-192.168.203.45@tcp:9:kworker.0 00000020:00000080:2.0:1787384704.886389:0:18657:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3e3c 00000100:00080000:2.0:1787384704.886398:0:18657:0:(import.c:65:import_set_state_nolock()) ffff98f7c222a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787384704.886462:0:18657:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1787384704.886594:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+2:2412:x1874208182386304:12345-192.168.203.45@tcp:9:kworker.0 Request processed in 243us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384704.886607:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 33 00000100:00100000:2.0:1787384704.886624:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 34 00000100:00100000:2.0:1787384704.886630:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+5:2412:x1874208182386432:12345-192.168.203.45@tcp:9:kworker.0 00000020:00000080:2.0:1787384704.886642:0:18657:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7ef423838fba3e43 00000100:00080000:2.0:1787384704.886648:0:18657:0:(import.c:65:import_set_state_nolock()) ffff98f7c40d4800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787384704.886672:0:18657:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:2.0:1787384704.886749:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+2:2412:x1874208182386432:12345-192.168.203.45@tcp:9:kworker.0 Request processed in 118us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384704.886756:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 34 00010000:00010000:2.0:1787384704.886807:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384704.886824:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787384704.886836:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787384704.886840:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787384704.887573:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182386048 00000100:00100000:1.0:1787384704.887579:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182386048 00000100:00100000:1.0:1787384704.887644:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 76 00000100:00100000:1.0:1787384704.887653:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f7c4307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+6:2415:x1874208182386048:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384704.887698:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f7c4307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+6:2415:x1874208182386048:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 47us (1573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384704.887705:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 76 00000100:00080000:2.0:1787384704.888146:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384704.893882:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787384704.897082:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208182386176 00000100:00100000:1.0:1787384704.897095:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208182386176 00000100:00100000:1.0:1787384704.897179:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 77 00000100:00100000:1.0:1787384704.897189:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f8f7e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+5:2415:x1874208182386176:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787384704.897281:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f8f7e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd0e9f41-df2c-4a7c-aa79-798e7ec4de38+5:2415:x1874208182386176:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 94us (3406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384704.897290:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 77 00000100:00080000:2.0:1787384704.901915:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 Debug log: 43395 lines, 43395 kept, 0 dropped, 0 bad.